2024-03-25T08:56:40.042 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-25T08:56:40.042 DEBUG:teuthology.run:Teuthology command: teuthology --description rbd:nvmeof/{base/install centos_latest conf/{disable-pool-app} workloads/nvmeof_thrash} --name vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi --archive /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216 --verbose --owner scheduled_vallariag@teuthology -- /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/orig.config.yaml 2024-03-25T08:56:40.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T08:56:40.154 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216 branch: ceph-nvmeof-mon description: rbd:nvmeof/{base/install centos_latest conf/{disable-pool-app} workloads/nvmeof_thrash} email: null first_in_suite: false job_id: '7621216' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: ceph-nvmeof-mon ceph: conf: global: mon warn on pool no app: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 47ea673ae9ebf51b2ebc505093bd7272422045e4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 47ea673ae9ebf51b2ebc505093bd7272422045e4 workunit: branch: wip-nvmeof-test-v4-subsystem-debug sha1: fb51d73931124de2f09457eaa7f1219e2aeb2c0d owner: scheduled_vallariag@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - mon.a - mgr.x - osd.0 - osd.1 - client.0 - ceph.nvmeof.nvmeof.a - - host.b - mon.b - osd.2 - osd.3 - osd.4 - client.1 - ceph.nvmeof.nvmeof.b - - host.c - mon.c - osd.5 - osd.6 - osd.7 - client.2 - ceph.nvmeof.nvmeof.c - - client.3 seed: 9105 sha1: 47ea673ae9ebf51b2ebc505093bd7272422045e4 sleep_before_teardown: 0 suite: rbd:nvmeof suite_branch: wip-nvmeof-test-v4-subsystem-debug suite_path: /home/teuthworker/src/github.com_vallariag_ceph_fb51d73931124de2f09457eaa7f1219e2aeb2c0d/qa suite_relpath: qa suite_repo: https://github.com/vallariag/ceph.git suite_sha1: fb51d73931124de2f09457eaa7f1219e2aeb2c0d targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPuIeGqnvwNV4xy88yhxozguu9uPfpxOMi1ABHJOqYA7grr6Szcuis9ENLMEpXgFvTLH+vVO5IR2rzV4ioThpIM= smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAueTtKLAoQDbDaO0bk6NfZrO8eSSs25Yc76HvpiK0Io6AwItJBWEQWrLRqBO6grJ9OUOfySGKfOwDdAWPw4zg4= smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI/qZPy6SQKMPnTGXHLa3FGz3Eun6avjX8Ndp9GfKykFNfR+kz49nSU3VmxsZgGzX+tAHUHz5aSEBBaHEiE8uN8= smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDRpG4d7Jh8rgSk32AhjKnXHGEoCFwUAwvTSc27NF0W6y3NsNfDr1BnjMXE0Gx7fmPzvkHhFDzDnXkDE6+OMoRM= tasks: - install: null - cephadm: null - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch host ls - ceph orch device ls - ceph osd lspools - nvmeof: client: client.0 gateway_config: cli_version: 1.1.0 namespaces_count: 20 subsystems_count: 3 rbd: image_name_prefix: myimage pool_name: mypool version: 1.1.0 - cephadm.wait_for_service: service: nvmeof.mypool - workunit: clients: client.3: - rbd/nvmeof_setup_subsystem.sh - rbd/nvmeof_basic_tests.sh env: RBD_IMAGE_PREFIX: myimage RBD_POOL: mypool no_coverage_and_limits: true - nvmeof.thrash: null - workunit: clients: client.3: - rbd/nvmeof_fio_test.sh --rbd_iostat env: IOSTAT_INTERVAL: '10' RBD_POOL: mypool RUNTIME: '600' no_coverage_and_limits: true teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-25_08:42:26 tube: smithi use_shaman: true user: vallariag verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-25T08:56:40.155 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vallariag_ceph_fb51d73931124de2f09457eaa7f1219e2aeb2c0d/qa; will attempt to use it 2024-03-25T08:56:40.155 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vallariag_ceph_fb51d73931124de2f09457eaa7f1219e2aeb2c0d/qa/tasks 2024-03-25T08:56:40.155 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-25T08:56:40.157 INFO:teuthology.task.internal:Checking packages... 2024-03-25T08:56:40.181 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '47ea673ae9ebf51b2ebc505093bd7272422045e4' 2024-03-25T08:56:40.181 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-25T08:56:40.181 INFO:teuthology.packaging:ref: None 2024-03-25T08:56:40.181 INFO:teuthology.packaging:tag: None 2024-03-25T08:56:40.181 INFO:teuthology.packaging:branch: ceph-nvmeof-mon 2024-03-25T08:56:40.181 INFO:teuthology.packaging:sha1: 47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T08:56:40.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=ceph-nvmeof-mon 2024-03-25T08:56:40.555 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2382.gbf9505fb 2024-03-25T08:56:40.557 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-25T08:56:40.563 INFO:teuthology.task.internal:no buildpackages task found 2024-03-25T08:56:40.563 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-25T08:56:40.646 INFO:teuthology.task.internal:Saving configuration 2024-03-25T08:56:40.656 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-25T08:56:40.662 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-25T08:56:40.690 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 08:51:26.182516', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPuIeGqnvwNV4xy88yhxozguu9uPfpxOMi1ABHJOqYA7grr6Szcuis9ENLMEpXgFvTLH+vVO5IR2rzV4ioThpIM='} 2024-03-25T08:56:40.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 08:51:26.180907', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAueTtKLAoQDbDaO0bk6NfZrO8eSSs25Yc76HvpiK0Io6AwItJBWEQWrLRqBO6grJ9OUOfySGKfOwDdAWPw4zg4='} 2024-03-25T08:56:40.732 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 08:51:26.183540', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI/qZPy6SQKMPnTGXHLa3FGz3Eun6avjX8Ndp9GfKykFNfR+kz49nSU3VmxsZgGzX+tAHUHz5aSEBBaHEiE8uN8='} 2024-03-25T08:56:40.751 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 08:51:26.184882', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDRpG4d7Jh8rgSk32AhjKnXHGEoCFwUAwvTSc27NF0W6y3NsNfDr1BnjMXE0Gx7fmPzvkHhFDzDnXkDE6+OMoRM='} 2024-03-25T08:56:40.751 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-25T08:56:40.757 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0', 'ceph.nvmeof.nvmeof.a'] 2024-03-25T08:56:40.757 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['host.b', 'mon.b', 'osd.2', 'osd.3', 'osd.4', 'client.1', 'ceph.nvmeof.nvmeof.b'] 2024-03-25T08:56:40.757 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['host.c', 'mon.c', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'ceph.nvmeof.nvmeof.c'] 2024-03-25T08:56:40.757 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['client.3'] 2024-03-25T08:56:40.757 INFO:teuthology.run_tasks:Running task console_log... 2024-03-25T08:56:40.883 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd101757160>, signals=[15]) 2024-03-25T08:56:40.883 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-25T08:56:40.889 INFO:teuthology.task.internal:Opening connections... 2024-03-25T08:56:40.889 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-03-25T08:56:40.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:56:40.998 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-03-25T08:56:40.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:56:41.101 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-03-25T08:56:41.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:56:41.204 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2024-03-25T08:56:41.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:56:41.289 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-25T08:56:41.295 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-03-25T08:56:41.314 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-03-25T08:56:41.314 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T08:56:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T08:56:41.373 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-03-25T08:56:41.391 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-03-25T08:56:41.409 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-03-25T08:56:41.410 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-03-25T08:56:41.467 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-03-25T08:56:41.467 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-03-25T08:56:41.467 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-03-25T08:56:41.467 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-03-25T08:56:41.467 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-03-25T08:56:41.467 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-03-25T08:56:41.467 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T08:56:41.467 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-03-25T08:56:41.467 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-03-25T08:56:41.467 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T08:56:41.468 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-03-25T08:56:41.468 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T08:56:41.468 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T08:56:41.468 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T08:56:41.468 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-03-25T08:56:41.483 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-03-25T08:56:41.500 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-03-25T08:56:41.501 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-03-25T08:56:41.558 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-03-25T08:56:41.558 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-03-25T08:56:41.558 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T08:56:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T08:56:41.559 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-03-25T08:56:41.575 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-03-25T08:56:41.592 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-03-25T08:56:41.592 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-03-25T08:56:41.649 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-03-25T08:56:41.649 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-03-25T08:56:41.649 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-03-25T08:56:41.649 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-03-25T08:56:41.649 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-03-25T08:56:41.649 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-03-25T08:56:41.649 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T08:56:41.649 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-03-25T08:56:41.649 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-03-25T08:56:41.650 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T08:56:41.650 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-03-25T08:56:41.650 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T08:56:41.650 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T08:56:41.650 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T08:56:41.650 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-03-25T08:56:41.666 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-25T08:56:41.675 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-25T08:56:41.683 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-25T08:56:41.684 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-03-25T08:56:41.686 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-03-25T08:56:41.688 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-03-25T08:56:41.691 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2024-03-25T08:56:41.706 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-25T08:56:41.711 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-25T08:56:41.712 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-03-25T08:56:41.743 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-03-25T08:56:41.746 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-03-25T08:56:41.748 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2024-03-25T08:56:41.775 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-25T08:56:41.867 INFO:teuthology.run_tasks:Running task kernel... 2024-03-25T08:56:41.881 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-25T08:56:41.881 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}, 'host.c': {'kdb': True, 'sha1': 'distro'}, 'client.3': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-25T08:56:41.881 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-25T08:56:41.882 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-25T08:56:41.882 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-25T08:56:41.882 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-25T08:56:41.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T08:56:41.899 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-03-25T08:56:41.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T08:56:41.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T08:56:41.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T08:56:41.901 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-03-25T08:56:41.901 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-03-25T08:56:41.902 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-03-25T08:56:41.956 INFO:teuthology.orchestra.run.smithi129.stdout:5.14.0-361.el9.x86_64 2024-03-25T08:56:41.956 INFO:teuthology.task.kernel:Running kernel on smithi129: 5.14.0-361.el9.x86_64 2024-03-25T08:56:41.956 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum install -y kernel 2024-03-25T08:56:41.959 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-361.el9.x86_64 2024-03-25T08:56:41.959 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.14.0-361.el9.x86_64 2024-03-25T08:56:41.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y kernel 2024-03-25T08:56:41.961 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-361.el9.x86_64 2024-03-25T08:56:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-361.el9.x86_64 2024-03-25T08:56:41.961 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.14.0-361.el9.x86_64 2024-03-25T08:56:41.961 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2024-03-25T08:56:41.961 INFO:teuthology.task.kernel:Running kernel on smithi059: 5.14.0-361.el9.x86_64 2024-03-25T08:56:41.961 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y kernel 2024-03-25T08:56:44.620 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS-9 - AppStream 6.5 MB/s | 6.7 MB 00:01 2024-03-25T08:56:44.746 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - AppStream 6.0 MB/s | 6.7 MB 00:01 2024-03-25T08:56:45.024 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - AppStream 4.7 MB/s | 6.7 MB 00:01 2024-03-25T08:56:45.028 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - AppStream 5.1 MB/s | 6.7 MB 00:01 2024-03-25T08:56:45.987 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-03-25T08:56:46.195 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.0 MB 00:00 2024-03-25T08:56:46.453 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2024-03-25T08:56:46.457 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-03-25T08:56:46.719 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.0 MB 00:00 2024-03-25T08:56:47.822 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.0 MB 00:01 2024-03-25T08:56:47.875 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.0 MB 00:01 2024-03-25T08:56:49.831 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-03-25T08:56:49.960 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.0 MB 00:03 2024-03-25T08:56:50.795 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-03-25T08:56:51.390 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 19 MB 00:02 2024-03-25T08:56:51.711 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-03-25T08:56:55.438 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.1 MB 00:01 2024-03-25T08:56:55.887 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.1 MB 00:00 2024-03-25T08:56:56.913 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-03-25T08:56:57.538 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-03-25T08:56:57.681 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 31 MB/s | 21 MB 00:00 2024-03-25T08:56:58.247 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 35 MB/s | 21 MB 00:00 2024-03-25T08:57:02.531 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-03-25T08:57:03.297 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-25T08:57:04.596 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-25T08:57:04.597 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-25T08:57:04.689 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T08:57:04.697 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout: kernel x86_64 5.14.0-430.el9 baseos 44 k 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-core x86_64 5.14.0-430.el9 baseos 15 M 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules x86_64 5.14.0-430.el9 baseos 33 M 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-core x86_64 5.14.0-430.el9 baseos 27 M 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout:Install 4 Packages 2024-03-25T08:57:04.698 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T08:57:04.699 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 76 M 2024-03-25T08:57:04.699 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 123 M 2024-03-25T08:57:04.699 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi129.stdout:(1/4): kernel-5.14.0-430.el9.x86_64.rpm 128 kB/s | 44 kB 00:00 2024-03-25T08:57:05.445 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-25T08:57:05.446 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-25T08:57:05.532 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T08:57:05.538 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 5.14.0-430.el9 baseos 44 k 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 5.14.0-430.el9 baseos 15 M 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 5.14.0-430.el9 baseos 33 M 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core x86_64 5.14.0-430.el9 baseos 27 M 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout:Install 4 Packages 2024-03-25T08:57:05.539 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T08:57:05.540 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 76 M 2024-03-25T08:57:05.540 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 123 M 2024-03-25T08:57:05.540 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T08:57:06.082 INFO:teuthology.orchestra.run.smithi019.stdout:(1/4): kernel-5.14.0-430.el9.x86_64.rpm 116 kB/s | 44 kB 00:00 2024-03-25T08:57:08.070 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 429 kB/s | 6.1 MB 00:14 2024-03-25T08:57:08.356 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 471 kB/s | 6.1 MB 00:13 2024-03-25T08:57:09.520 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 16 kB 00:00 2024-03-25T08:57:09.790 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 16 kB 00:00 2024-03-25T08:57:11.194 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-03-25T08:57:11.507 INFO:teuthology.orchestra.run.smithi129.stdout:(2/4): kernel-modules-5.14.0-430.el9.x86_64.rpm 5.0 MB/s | 33 MB 00:06 2024-03-25T08:57:12.538 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 7.1 MB/s | 21 MB 00:02 2024-03-25T08:57:16.359 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-03-25T08:57:17.572 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-03-25T08:57:18.507 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-25T08:57:18.507 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-25T08:57:18.606 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T08:57:18.609 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout: kernel x86_64 5.14.0-430.el9 baseos 44 k 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-core x86_64 5.14.0-430.el9 baseos 15 M 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules x86_64 5.14.0-430.el9 baseos 33 M 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-core x86_64 5.14.0-430.el9 baseos 27 M 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T08:57:18.610 INFO:teuthology.orchestra.run.smithi059.stdout:Install 4 Packages 2024-03-25T08:57:18.611 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T08:57:18.611 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 76 M 2024-03-25T08:57:18.611 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 123 M 2024-03-25T08:57:18.611 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T08:57:18.743 INFO:teuthology.orchestra.run.smithi059.stdout:(1/4): kernel-5.14.0-430.el9.x86_64.rpm 497 kB/s | 44 kB 00:00 2024-03-25T08:57:19.069 INFO:teuthology.orchestra.run.smithi059.stdout:(2/4): kernel-core-5.14.0-430.el9.x86_64.rpm 36 MB/s | 15 MB 00:00 2024-03-25T08:57:19.449 INFO:teuthology.orchestra.run.smithi129.stdout:(3/4): kernel-core-5.14.0-430.el9.x86_64.rpm 1.0 MB/s | 15 MB 00:14 2024-03-25T08:57:19.469 INFO:teuthology.orchestra.run.smithi059.stdout:(3/4): kernel-modules-5.14.0-430.el9.x86_64.rpm 41 MB/s | 33 MB 00:00 2024-03-25T08:57:19.744 INFO:teuthology.orchestra.run.smithi059.stdout:(4/4): kernel-modules-core-5.14.0-430.el9.x86_6 27 MB/s | 27 MB 00:01 2024-03-25T08:57:19.744 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T08:57:19.745 INFO:teuthology.orchestra.run.smithi059.stdout:Total 67 MB/s | 76 MB 00:01 2024-03-25T08:57:19.770 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-25T08:57:19.770 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-25T08:57:19.874 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout: kernel x86_64 5.14.0-430.el9 baseos 44 k 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-core x86_64 5.14.0-430.el9 baseos 15 M 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules x86_64 5.14.0-430.el9 baseos 33 M 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-core x86_64 5.14.0-430.el9 baseos 27 M 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T08:57:19.890 INFO:teuthology.orchestra.run.smithi040.stdout:Install 4 Packages 2024-03-25T08:57:19.891 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T08:57:19.891 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 76 M 2024-03-25T08:57:19.891 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 123 M 2024-03-25T08:57:19.891 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T08:57:20.140 INFO:teuthology.orchestra.run.smithi040.stdout:(1/4): kernel-5.14.0-430.el9.x86_64.rpm 479 kB/s | 44 kB 00:00 2024-03-25T08:57:20.437 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T08:57:20.472 INFO:teuthology.orchestra.run.smithi019.stdout:(2/4): kernel-core-5.14.0-430.el9.x86_64.rpm 1.0 MB/s | 15 MB 00:14 2024-03-25T08:57:20.482 INFO:teuthology.orchestra.run.smithi040.stdout:(2/4): kernel-core-5.14.0-430.el9.x86_64.rpm 34 MB/s | 15 MB 00:00 2024-03-25T08:57:20.832 INFO:teuthology.orchestra.run.smithi040.stdout:(3/4): kernel-modules-core-5.14.0-430.el9.x86_6 40 MB/s | 27 MB 00:00 2024-03-25T08:57:20.871 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T08:57:20.872 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T08:57:21.174 INFO:teuthology.orchestra.run.smithi040.stdout:(4/4): kernel-modules-5.14.0-430.el9.x86_64.rpm 30 MB/s | 33 MB 00:01 2024-03-25T08:57:21.174 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T08:57:21.174 INFO:teuthology.orchestra.run.smithi040.stdout:Total 59 MB/s | 76 MB 00:01 2024-03-25T08:57:21.872 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T08:57:21.907 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T08:57:21.907 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T08:57:22.280 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T08:57:22.281 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T08:57:23.388 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T08:57:23.389 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T08:57:24.516 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T08:57:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-modules-core-5.14.0-430.el9.x86_64 1/4 2024-03-25T08:57:25.286 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:57:26.027 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T08:57:26.653 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-modules-core-5.14.0-430.el9.x86_64 1/4 2024-03-25T08:57:26.749 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:57:28.177 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:57:28.372 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:57:29.633 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:57:29.768 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:57:30.973 INFO:teuthology.orchestra.run.smithi129.stdout:(4/4): kernel-modules-core-5.14.0-430.el9.x86_6 1.1 MB/s | 27 MB 00:25 2024-03-25T08:57:30.973 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T08:57:30.973 INFO:teuthology.orchestra.run.smithi129.stdout:Total 2.9 MB/s | 76 MB 00:26 2024-03-25T08:57:31.635 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T08:57:31.993 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T08:57:31.993 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T08:57:33.025 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T08:57:33.025 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T08:57:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:57:33.523 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:57:34.071 INFO:teuthology.orchestra.run.smithi019.stdout:(3/4): kernel-modules-core-5.14.0-430.el9.x86_6 1.0 MB/s | 27 MB 00:27 2024-03-25T08:57:34.873 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:57:34.918 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:57:35.596 INFO:teuthology.orchestra.run.smithi019.stdout:(4/4): kernel-modules-5.14.0-430.el9.x86_64.rpm 1.1 MB/s | 33 MB 00:29 2024-03-25T08:57:35.597 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T08:57:35.597 INFO:teuthology.orchestra.run.smithi019.stdout:Total 2.5 MB/s | 76 MB 00:30 2024-03-25T08:57:35.667 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T08:57:36.290 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T08:57:36.342 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-modules-core-5.14.0-430.el9.x86_64 1/4 2024-03-25T08:57:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:57:36.724 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T08:57:36.725 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T08:57:37.779 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T08:57:37.779 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T08:57:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:57:39.145 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:57:39.273 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:57:40.045 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:57:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T08:57:41.027 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-core-5.14.0-430.el9.x86_64 1/4 2024-03-25T08:57:41.114 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:57:43.990 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:57:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:57:44.106 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:57:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:57:48.827 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:57:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:57:49.273 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:57:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:09.695 INFO:teuthology.orchestra.run.smithi059.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-25T08:58:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T08:58:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:10.095 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:10.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-5.14.0-430.el9.x86_64 1/4 2024-03-25T08:58:10.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:58:10.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:58:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T08:58:10.510 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T08:58:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-core-5.14.0-430.el9.x86_64 2024-03-25T08:58:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-5.14.0-430.el9.x86_64 2024-03-25T08:58:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-core-5.14.0-430.el9.x86_64 2024-03-25T08:58:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T08:58:10.510 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T08:58:10.730 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:10.730 INFO:teuthology.orchestra.run.smithi040.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-25T08:58:10.730 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T08:58:10.777 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:10.828 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2024-03-25T08:58:10.925 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:10.926 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-25T08:58:10.926 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-430.el9.x86_64 2024-03-25T08:58:10.926 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-25T08:58:10.926 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-25T08:58:10.926 INFO:teuthology.task.kernel:Installing distro kernel on host.c... 2024-03-25T08:58:10.926 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=None, version=distro) 2024-03-25T08:58:10.926 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2024-03-25T08:58:11.009 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:11.009 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-25T08:58:11.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -qi grub2-tools 2024-03-25T08:58:11.051 INFO:teuthology.orchestra.run.smithi059.stdout:Name : grub2-tools 2024-03-25T08:58:11.051 INFO:teuthology.orchestra.run.smithi059.stdout:Epoch : 1 2024-03-25T08:58:11.051 INFO:teuthology.orchestra.run.smithi059.stdout:Version : 2.06 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Release : 68.el9 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: x86_64 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Group : Unspecified 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Size : 8264254 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:License : GPLv3+ 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Packager : builder@centos.org 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Vendor : CentOS 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Summary : Support tools for GRUB. 2024-03-25T08:58:11.052 INFO:teuthology.orchestra.run.smithi059.stdout:Description : 2024-03-25T08:58:11.053 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T08:58:11.053 INFO:teuthology.orchestra.run.smithi059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-25T08:58:11.053 INFO:teuthology.orchestra.run.smithi059.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-25T08:58:11.053 INFO:teuthology.orchestra.run.smithi059.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-25T08:58:11.053 INFO:teuthology.orchestra.run.smithi059.stdout:hardware devices. 2024-03-25T08:58:11.053 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T08:58:11.053 INFO:teuthology.orchestra.run.smithi059.stdout:This subpackage provides tools for support of all platforms. 2024-03-25T08:58:11.054 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-25T08:58:11.054 INFO:teuthology.task.kernel:Updating grub on smithi059 to boot 5.14.0-430.el9.x86_64 2024-03-25T08:58:11.054 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-25T08:58:11.158 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:11.158 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-5.14.0-430.el9.x86_64 1/4 2024-03-25T08:58:11.158 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:58:11.158 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-core-5.14.0-430.el9.x86_64 2024-03-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-5.14.0-430.el9.x86_64 2024-03-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-core-5.14.0-430.el9.x86_64 2024-03-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T08:58:11.684 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-03-25T08:58:11.920 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-03-25T08:58:12.016 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:12.017 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-25T08:58:12.017 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-430.el9.x86_64 2024-03-25T08:58:12.018 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-25T08:58:12.018 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-25T08:58:12.018 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-03-25T08:58:12.018 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2024-03-25T08:58:12.018 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-03-25T08:58:12.100 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:12.100 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-25T08:58:12.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2024-03-25T08:58:12.138 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2024-03-25T08:58:12.138 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.06 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 68.el9 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Group : Unspecified 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 8264254 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : builder@centos.org 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2024-03-25T08:58:12.139 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T08:58:12.140 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-25T08:58:12.140 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-25T08:58:12.140 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-25T08:58:12.140 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2024-03-25T08:58:12.140 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T08:58:12.140 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2024-03-25T08:58:12.141 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-25T08:58:12.141 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 5.14.0-430.el9.x86_64 2024-03-25T08:58:12.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-25T08:58:12.799 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-03-25T08:58:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-25T08:58:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-03-25T08:58:13.089 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-03-25T08:58:13.104 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.V4nr7nMl2u 2024-03-25T08:58:13.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.V4nr7nMl2u 2024-03-25T08:58:13.175 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.V4nr7nMl2u 2024-03-25T08:58:13.313 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.V4nr7nMl2u is 6KB 2024-03-25T08:58:13.362 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.V4nr7nMl2u 2024-03-25T08:58:13.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo /bin/ls /boot/loader/entries || true 2024-03-25T08:58:13.445 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-25T08:58:13.445 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-25T08:58:13.445 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-25T08:58:13.445 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64.conf 2024-03-25T08:58:13.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64 2024-03-25T08:58:13.587 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2024-03-25T08:58:14.238 INFO:teuthology.orchestra.run.smithi040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-25T08:58:14.273 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-03-25T08:58:14.275 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-03-25T08:58:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.HYqA2EhpYV 2024-03-25T08:58:14.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HYqA2EhpYV 2024-03-25T08:58:14.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.HYqA2EhpYV 2024-03-25T08:58:14.557 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.HYqA2EhpYV is 6KB 2024-03-25T08:58:14.577 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.HYqA2EhpYV 2024-03-25T08:58:14.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2024-03-25T08:58:14.659 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-25T08:58:14.660 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-25T08:58:14.660 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-25T08:58:14.660 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64.conf 2024-03-25T08:58:14.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64 2024-03-25T08:58:14.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-03-25T08:58:18.197 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:18.197 INFO:teuthology.orchestra.run.smithi129.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-25T08:58:18.198 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T08:58:18.241 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:18.608 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:18.608 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-5.14.0-430.el9.x86_64 1/4 2024-03-25T08:58:18.608 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:58:18.608 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:58:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T08:58:19.008 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T08:58:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-core-5.14.0-430.el9.x86_64 2024-03-25T08:58:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-5.14.0-430.el9.x86_64 2024-03-25T08:58:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-core-5.14.0-430.el9.x86_64 2024-03-25T08:58:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T08:58:19.009 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T08:58:19.368 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-03-25T08:58:19.465 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:19.466 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-25T08:58:19.466 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-430.el9.x86_64 2024-03-25T08:58:19.466 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-25T08:58:19.466 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-25T08:58:19.466 INFO:teuthology.task.kernel:Installing distro kernel on client.3... 2024-03-25T08:58:19.466 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi129.front.sepia.ceph.com, path=None, version=distro) 2024-03-25T08:58:19.467 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-03-25T08:58:19.546 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:19.546 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-25T08:58:19.546 DEBUG:teuthology.orchestra.run.smithi129:> sudo rpm -qi grub2-tools 2024-03-25T08:58:19.580 INFO:teuthology.orchestra.run.smithi129.stdout:Name : grub2-tools 2024-03-25T08:58:19.580 INFO:teuthology.orchestra.run.smithi129.stdout:Epoch : 1 2024-03-25T08:58:19.580 INFO:teuthology.orchestra.run.smithi129.stdout:Version : 2.06 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Release : 68.el9 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: x86_64 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Group : Unspecified 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Size : 8264254 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:License : GPLv3+ 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Packager : builder@centos.org 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:Vendor : CentOS 2024-03-25T08:58:19.581 INFO:teuthology.orchestra.run.smithi129.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-25T08:58:19.582 INFO:teuthology.orchestra.run.smithi129.stdout:Summary : Support tools for GRUB. 2024-03-25T08:58:19.582 INFO:teuthology.orchestra.run.smithi129.stdout:Description : 2024-03-25T08:58:19.582 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T08:58:19.582 INFO:teuthology.orchestra.run.smithi129.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-25T08:58:19.582 INFO:teuthology.orchestra.run.smithi129.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-25T08:58:19.582 INFO:teuthology.orchestra.run.smithi129.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-25T08:58:19.582 INFO:teuthology.orchestra.run.smithi129.stdout:hardware devices. 2024-03-25T08:58:19.582 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T08:58:19.582 INFO:teuthology.orchestra.run.smithi129.stdout:This subpackage provides tools for support of all platforms. 2024-03-25T08:58:19.583 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-25T08:58:19.583 INFO:teuthology.task.kernel:Updating grub on smithi129 to boot 5.14.0-430.el9.x86_64 2024-03-25T08:58:19.583 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-25T08:58:20.236 INFO:teuthology.orchestra.run.smithi129.stderr:Generating grub configuration file ... 2024-03-25T08:58:21.629 INFO:teuthology.orchestra.run.smithi129.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-25T08:58:21.660 INFO:teuthology.orchestra.run.smithi129.stderr:done 2024-03-25T08:58:21.662 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-03-25T08:58:21.677 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.duTpWenC48 2024-03-25T08:58:21.678 DEBUG:teuthology.orchestra.run.smithi129:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.duTpWenC48 2024-03-25T08:58:21.746 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.duTpWenC48 2024-03-25T08:58:21.887 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.duTpWenC48 is 6KB 2024-03-25T08:58:21.907 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.duTpWenC48 2024-03-25T08:58:21.921 DEBUG:teuthology.orchestra.run.smithi129:> sudo /bin/ls /boot/loader/entries || true 2024-03-25T08:58:21.986 INFO:teuthology.orchestra.run.smithi129.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-25T08:58:21.986 INFO:teuthology.orchestra.run.smithi129.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-25T08:58:21.986 INFO:teuthology.orchestra.run.smithi129.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-25T08:58:21.986 INFO:teuthology.orchestra.run.smithi129.stdout:15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64.conf 2024-03-25T08:58:21.987 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64 2024-03-25T08:58:22.147 DEBUG:teuthology.orchestra.run.smithi129:> sudo shutdown -r now 2024-03-25T08:58:25.409 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:25.409 INFO:teuthology.orchestra.run.smithi019.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-25T08:58:25.409 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T08:58:25.454 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:25.811 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:25.811 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-5.14.0-430.el9.x86_64 1/4 2024-03-25T08:58:25.811 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-25T08:58:25.811 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-25T08:58:26.251 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-25T08:58:26.251 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T08:58:26.251 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T08:58:26.251 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:26.251 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core-5.14.0-430.el9.x86_64 2024-03-25T08:58:26.251 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-5.14.0-430.el9.x86_64 2024-03-25T08:58:26.251 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core-5.14.0-430.el9.x86_64 2024-03-25T08:58:26.251 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T08:58:26.251 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T08:58:26.591 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-03-25T08:58:26.690 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:26.690 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-25T08:58:26.690 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-430.el9.x86_64 2024-03-25T08:58:26.690 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-25T08:58:26.690 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-25T08:58:26.690 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-03-25T08:58:26.691 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-03-25T08:58:26.691 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-03-25T08:58:26.773 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-25T08:58:26.773 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-25T08:58:26.773 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-03-25T08:58:26.811 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-03-25T08:58:26.811 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-03-25T08:58:26.811 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-03-25T08:58:26.811 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 68.el9 2024-03-25T08:58:26.811 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-03-25T08:58:26.811 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-25T08:58:26.811 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-03-25T08:58:26.811 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8264254 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-25T08:58:26.812 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-03-25T08:58:26.813 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T08:58:26.813 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-03-25T08:58:26.813 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-25T08:58:26.814 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 5.14.0-430.el9.x86_64 2024-03-25T08:58:26.814 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-25T08:58:27.468 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-03-25T08:58:28.948 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-25T08:58:28.987 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-03-25T08:58:28.990 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-03-25T08:58:29.005 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.l9LI2EK7Jz 2024-03-25T08:58:29.005 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.l9LI2EK7Jz 2024-03-25T08:58:29.077 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.l9LI2EK7Jz 2024-03-25T08:58:29.224 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.l9LI2EK7Jz is 6KB 2024-03-25T08:58:29.273 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.l9LI2EK7Jz 2024-03-25T08:58:29.287 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-03-25T08:58:29.355 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-25T08:58:29.355 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-25T08:58:29.355 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-25T08:58:29.355 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64.conf 2024-03-25T08:58:29.357 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64 2024-03-25T08:58:29.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-03-25T08:58:43.600 INFO:teuthology.task.kernel:Checking client host.c for new kernel version... 2024-03-25T08:58:43.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-25T08:58:43.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:58:44.805 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-03-25T08:58:44.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-03-25T08:58:44.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:58:52.157 INFO:teuthology.task.kernel:Checking client client.3 for new kernel version... 2024-03-25T08:58:52.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-25T08:58:52.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:58:59.514 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-03-25T08:58:59.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-25T08:58:59.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:59:02.046 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-25T08:59:03.326 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-03-25T08:59:10.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-03-25T08:59:11.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-25T08:59:11.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:59:12.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-03-25T08:59:12.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:59:17.922 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-03-25T08:59:19.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-25T08:59:19.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:59:22.558 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-03-25T08:59:26.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-25T08:59:26.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:59:34.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-25T08:59:34.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T08:59:52.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-03-25T09:00:08.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-25T09:00:08.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T09:00:08.334 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-03-25T09:00:08.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-25T09:00:08.770 INFO:teuthology.task.kernel:Checking kernel version of client.3, want "5.14.0-430.el9.x86_64"... 2024-03-25T09:00:08.771 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-03-25T09:00:08.784 INFO:teuthology.orchestra.run.smithi129.stdout:5.14.0-430.el9.x86_64 2024-03-25T09:00:08.785 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-430.el9.x86_64 vs 5.14.0-430.el9.x86_64 2024-03-25T09:00:08.785 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-25T09:00:08.785 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-25T09:00:09.786 INFO:teuthology.task.kernel:Enabling kdb on client.3... 2024-03-25T09:00:09.786 DEBUG:teuthology.orchestra.run.smithi129:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-25T09:00:09.863 INFO:teuthology.orchestra.run.smithi129.stdout:ttyS1 2024-03-25T09:00:09.907 DEBUG:teuthology.parallel:result is None 2024-03-25T09:00:11.050 DEBUG:teuthology.orchestra.remote:timed out 2024-03-25T09:00:12.331 DEBUG:teuthology.orchestra.remote:timed out 2024-03-25T09:00:23.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-25T09:00:23.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T09:00:23.317 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-03-25T09:00:23.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-25T09:00:23.692 INFO:teuthology.task.kernel:Checking kernel version of host.c, want "5.14.0-430.el9.x86_64"... 2024-03-25T09:00:23.692 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-03-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-430.el9.x86_64 2024-03-25T09:00:23.708 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-430.el9.x86_64 vs 5.14.0-430.el9.x86_64 2024-03-25T09:00:23.708 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-25T09:00:23.708 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-25T09:00:24.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-03-25T09:00:24.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T09:00:24.611 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-03-25T09:00:24.708 INFO:teuthology.task.kernel:Enabling kdb on host.c... 2024-03-25T09:00:24.708 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-25T09:00:24.762 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2024-03-25T09:00:24.796 DEBUG:teuthology.parallel:result is None 2024-03-25T09:00:24.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-03-25T09:00:24.980 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-430.el9.x86_64"... 2024-03-25T09:00:24.980 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-03-25T09:00:24.995 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-430.el9.x86_64 2024-03-25T09:00:24.995 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-430.el9.x86_64 vs 5.14.0-430.el9.x86_64 2024-03-25T09:00:24.995 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-25T09:00:24.995 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-25T09:00:25.996 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-03-25T09:00:25.996 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-25T09:00:26.070 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2024-03-25T09:00:26.107 DEBUG:teuthology.parallel:result is None 2024-03-25T09:00:26.930 DEBUG:teuthology.orchestra.remote:timed out 2024-03-25T09:00:38.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-25T09:00:38.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T09:00:39.318 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-03-25T09:00:39.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-25T09:00:39.676 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-430.el9.x86_64"... 2024-03-25T09:00:39.676 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-03-25T09:00:39.691 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-430.el9.x86_64 2024-03-25T09:00:39.691 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-430.el9.x86_64 vs 5.14.0-430.el9.x86_64 2024-03-25T09:00:39.691 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-25T09:00:39.691 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-25T09:00:40.692 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-03-25T09:00:40.692 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-25T09:00:40.759 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2024-03-25T09:00:40.795 DEBUG:teuthology.parallel:result is None 2024-03-25T09:00:40.795 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-25T09:00:40.802 INFO:teuthology.task.internal:Creating test directory... 2024-03-25T09:00:40.803 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-25T09:00:40.805 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-25T09:00:40.807 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-25T09:00:40.810 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-25T09:00:40.828 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-25T09:00:40.883 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-25T09:00:40.895 INFO:teuthology.task.internal:Creating archive directory... 2024-03-25T09:00:40.895 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-25T09:00:40.898 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-25T09:00:40.900 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-25T09:00:40.902 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-25T09:00:41.036 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-25T09:00:41.047 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-25T09:00:41.047 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-25T09:00:41.050 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-25T09:00:41.052 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-25T09:00:41.054 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-25T09:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T09:00:41.089 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T09:00:41.091 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T09:00:41.097 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T09:00:41.101 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T09:00:41.103 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T09:00:41.105 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T09:00:41.111 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T09:00:41.113 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-25T09:00:41.121 INFO:teuthology.task.internal:Configuring sudo... 2024-03-25T09:00:41.122 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-25T09:00:41.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-25T09:00:41.149 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-25T09:00:41.151 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-25T09:00:41.181 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-25T09:00:41.195 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-25T09:00:41.195 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-25T09:00:41.198 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-25T09:00:41.219 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-25T09:00:41.222 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-25T09:00:41.238 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T09:00:41.293 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T09:00:41.343 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T09:00:41.428 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T09:00:41.468 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:00:41.468 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-25T09:00:41.536 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T09:00:41.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T09:00:41.632 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T09:00:41.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T09:00:41.761 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:00:41.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-25T09:00:41.831 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T09:00:41.875 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T09:00:41.925 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T09:00:42.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T09:00:42.052 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:00:42.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-25T09:00:42.120 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T09:00:42.163 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T09:00:42.222 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T09:00:42.306 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T09:00:42.350 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:00:42.350 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-25T09:00:42.420 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-03-25T09:00:42.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-03-25T09:00:42.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-03-25T09:00:42.427 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2024-03-25T09:00:42.471 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T09:00:42.473 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T09:00:42.474 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T09:00:42.504 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T09:00:42.948 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-25T09:00:42.957 INFO:teuthology.task.internal:Starting timer... 2024-03-25T09:00:42.957 INFO:teuthology.run_tasks:Running task pcp... 2024-03-25T09:00:43.028 INFO:teuthology.run_tasks:Running task selinux... 2024-03-25T09:00:43.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-03-25T09:00:43.107 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-03-25T09:00:43.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2024-03-25T09:00:43.154 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2024-03-25T09:00:43.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2024-03-25T09:00:43.197 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2024-03-25T09:00:43.199 DEBUG:teuthology.orchestra.run.smithi129:> sudo service auditd rotate 2024-03-25T09:00:43.276 INFO:teuthology.orchestra.run.smithi129.stdout:Rotating logs: 2024-03-25T09:00:43.278 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-25T09:00:43.278 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-03-25T09:00:43.296 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-03-25T09:00:43.296 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2024-03-25T09:00:43.319 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2024-03-25T09:00:43.319 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2024-03-25T09:00:43.343 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2024-03-25T09:00:43.344 DEBUG:teuthology.orchestra.run.smithi129:> /usr/sbin/getenforce 2024-03-25T09:00:43.362 INFO:teuthology.orchestra.run.smithi129.stdout:Permissive 2024-03-25T09:00:43.362 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi129.front.sepia.ceph.com': 'permissive'} 2024-03-25T09:00:43.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T09:00:43.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:00:43.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T09:00:43.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:00:43.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T09:00:43.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:00:43.448 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T09:00:43.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:00:43.475 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-25T09:00:43.475 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-03-25T09:00:43.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2024-03-25T09:00:43.551 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2024-03-25T09:00:43.613 DEBUG:teuthology.orchestra.run.smithi129:> sudo /usr/sbin/setenforce permissive 2024-03-25T09:00:43.656 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-25T09:00:43.666 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-25T09:00:43.683 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-25T09:00:43.684 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi040.front.sepia.ceph.com,smithi059.front.sepia.ceph.com,smithi129.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-25T09:05:01.630 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com')] 2024-03-25T09:05:01.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-25T09:05:01.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T09:05:01.724 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-03-25T09:05:01.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-25T09:05:01.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-03-25T09:05:01.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T09:05:01.888 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-03-25T09:05:01.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-03-25T09:05:01.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-25T09:05:01.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T09:05:02.062 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-03-25T09:05:02.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-25T09:05:02.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-25T09:05:02.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T09:05:02.229 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-03-25T09:05:02.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-25T09:05:02.338 INFO:teuthology.run_tasks:Running task clock... 2024-03-25T09:05:02.348 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-25T09:05:02.348 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-25T09:05:02.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T09:05:02.351 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-25T09:05:02.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T09:05:02.354 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-25T09:05:02.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T09:05:02.357 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-25T09:05:02.357 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T09:05:02.384 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-25T09:05:02.386 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-25T09:05:02.389 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-25T09:05:02.390 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-25T09:05:02.402 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-25T09:05:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-25T09:05:02.406 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-25T09:05:02.408 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-25T09:05:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-03-25T09:05:02.434 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2024-03-25T09:05:02.436 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: ntpd: command not found 2024-03-25T09:05:02.438 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2024-03-25T09:05:02.448 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2024-03-25T09:05:02.448 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-03-25T09:05:02.450 INFO:teuthology.orchestra.run.smithi129.stdout:506 Cannot talk to daemon 2024-03-25T09:05:02.453 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2024-03-25T09:05:02.464 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-25T09:05:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-25T09:05:02.467 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-25T09:05:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-25T09:05:02.481 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-25T09:05:02.482 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-25T09:05:02.483 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-25T09:05:02.486 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-25T09:05:02.531 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-03-25T09:05:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-03-25T09:05:02.534 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T09:05:02.534 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-03-25T09:05:02.534 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.534 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.534 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.534 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.535 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2024-03-25T09:05:02.536 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T09:05:02.536 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-03-25T09:05:02.536 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.537 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.537 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.537 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.538 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T09:05:02.538 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-03-25T09:05:02.538 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.538 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.538 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.538 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.540 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-03-25T09:05:02.544 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T09:05:02.544 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-03-25T09:05:02.544 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.544 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.544 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.544 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:05:02.544 INFO:teuthology.run_tasks:Running task install... 2024-03-25T09:05:02.552 DEBUG:teuthology.task.install:project ceph 2024-03-25T09:05:02.552 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4'}} 2024-03-25T09:05:02.552 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4'} 2024-03-25T09:05:02.552 INFO:teuthology.task.install:Using flavor: default 2024-03-25T09:05:02.583 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-25T09:05:02.584 INFO:teuthology.task.install:extra packages: [] 2024-03-25T09:05:02.584 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4', 'tag': None, 'wait_for_package': False} 2024-03-25T09:05:02.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:05:02.587 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4', 'tag': None, 'wait_for_package': False} 2024-03-25T09:05:02.587 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:05:02.588 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4', 'tag': None, 'wait_for_package': False} 2024-03-25T09:05:02.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:05:02.589 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4', 'tag': None, 'wait_for_package': False} 2024-03-25T09:05:02.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:05:02.757 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/ 2024-03-25T09:05:02.758 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1997.g47ea673a 2024-03-25T09:05:02.761 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/ 2024-03-25T09:05:02.762 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1997.g47ea673a 2024-03-25T09:05:02.842 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/ 2024-03-25T09:05:02.842 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1997.g47ea673a 2024-03-25T09:05:02.846 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/ 2024-03-25T09:05:02.846 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1997.g47ea673a 2024-03-25T09:05:02.869 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-25T09:05:02.869 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:05:02.869 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-25T09:05:02.874 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-25T09:05:02.875 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:05:02.875 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-25T09:05:02.897 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-25T09:05:02.897 DEBUG:teuthology.orchestra.run.smithi129:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/47ea673ae9ebf51b2ebc505093bd7272422045e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-25T09:05:02.902 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-25T09:05:02.903 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/47ea673ae9ebf51b2ebc505093bd7272422045e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-25T09:05:02.965 DEBUG:teuthology.orchestra.run.smithi129:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-25T09:05:02.971 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-25T09:05:03.014 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-25T09:05:03.014 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:05:03.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-25T09:05:03.017 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-25T09:05:03.017 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:05:03.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-25T09:05:03.045 DEBUG:teuthology.orchestra.run.smithi129:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-25T09:05:03.047 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-25T09:05:03.047 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/47ea673ae9ebf51b2ebc505093bd7272422045e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-25T09:05:03.048 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-25T09:05:03.048 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/47ea673ae9ebf51b2ebc505093bd7272422045e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-25T09:05:03.051 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-25T09:05:03.111 INFO:teuthology.orchestra.run.smithi129.stdout:check_obsoletes = 1 2024-03-25T09:05:03.113 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum clean all 2024-03-25T09:05:03.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-25T09:05:03.117 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-03-25T09:05:03.118 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-25T09:05:03.119 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-03-25T09:05:03.198 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-25T09:05:03.199 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-25T09:05:03.266 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2024-03-25T09:05:03.266 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2024-03-25T09:05:03.267 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2024-03-25T09:05:03.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2024-03-25T09:05:03.345 INFO:teuthology.orchestra.run.smithi129.stdout:74 files removed 2024-03-25T09:05:03.358 INFO:teuthology.orchestra.run.smithi019.stdout:74 files removed 2024-03-25T09:05:03.371 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-radosgw 2024-03-25T09:05:03.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw 2024-03-25T09:05:03.511 INFO:teuthology.orchestra.run.smithi059.stdout:74 files removed 2024-03-25T09:05:03.526 INFO:teuthology.orchestra.run.smithi040.stdout:74 files removed 2024-03-25T09:05:03.537 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw 2024-03-25T09:05:03.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw 2024-03-25T09:05:04.029 INFO:teuthology.orchestra.run.smithi129.stdout:ceph packages for x86_64 228 kB/s | 83 kB 00:00 2024-03-25T09:05:04.077 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 212 kB/s | 83 kB 00:00 2024-03-25T09:05:04.192 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 237 kB/s | 83 kB 00:00 2024-03-25T09:05:04.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 220 kB/s | 83 kB 00:00 2024-03-25T09:05:04.419 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 34 kB/s | 10 kB 00:00 2024-03-25T09:05:04.480 INFO:teuthology.orchestra.run.smithi129.stdout:ceph noarch packages 25 kB/s | 10 kB 00:00 2024-03-25T09:05:04.550 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 33 kB/s | 10 kB 00:00 2024-03-25T09:05:04.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 32 kB/s | 10 kB 00:00 2024-03-25T09:05:04.856 INFO:teuthology.orchestra.run.smithi129.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-03-25T09:05:04.894 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-03-25T09:05:04.951 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2024-03-25T09:05:05.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-03-25T09:05:05.258 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-03-25T09:05:05.406 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-25T09:05:05.495 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-25T09:05:05.611 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-25T09:05:06.717 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2024-03-25T09:05:06.831 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-03-25T09:05:06.904 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-03-25T09:05:07.053 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2024-03-25T09:05:07.653 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.0 MB 00:00 2024-03-25T09:05:07.682 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-25T09:05:08.786 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.0 MB 00:01 2024-03-25T09:05:09.271 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 35 MB/s | 19 MB 00:00 2024-03-25T09:05:09.888 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.0 MB 00:02 2024-03-25T09:05:10.662 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-03-25T09:05:13.322 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 19 MB 00:02 2024-03-25T09:05:13.591 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.1 MB 00:00 2024-03-25T09:05:15.043 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.1 MB 00:00 2024-03-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 16 kB 00:00 2024-03-25T09:05:16.619 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-03-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-03-25T09:05:18.270 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-03-25T09:05:18.440 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.1 MB 00:01 2024-03-25T09:05:19.907 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-03-25T09:05:21.766 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-03-25T09:05:22.534 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 21 MB 00:02 2024-03-25T09:05:23.401 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-25T09:05:24.282 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:05:24.290 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:05:24.290 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-25T09:05:24.290 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:05:24.290 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:05:24.290 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 9.8 M 2024-03-25T09:05:24.290 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.4 M 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.1 M 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 5.4 M 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 20 M 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 25 k 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 745 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 501 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 5.2 M 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 45 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 131 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 162 k 2024-03-25T09:05:24.292 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 321 k 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 298 k 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 99 k 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:05:24.293 INFO:teuthology.orchestra.run.smithi059.stdout:Install 30 Packages 2024-03-25T09:05:24.294 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 2 Packages 2024-03-25T09:05:24.294 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:05:24.294 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 58 M 2024-03-25T09:05:24.294 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:05:25.801 INFO:teuthology.orchestra.run.smithi059.stdout:(1/32): ceph-base-19.0.0-1997.g47ea673a.el9.x86 6.1 MB/s | 5.4 MB 00:00 2024-03-25T09:05:25.876 INFO:teuthology.orchestra.run.smithi059.stdout:(2/32): ceph-selinux-19.0.0-1997.g47ea673a.el9. 336 kB/s | 25 kB 00:00 2024-03-25T09:05:25.924 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:05:25.940 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:05:25.941 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-03-25T09:05:25.941 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:05:25.941 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:05:25.941 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 9.8 M 2024-03-25T09:05:25.941 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-03-25T09:05:25.941 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.4 M 2024-03-25T09:05:25.942 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.1 M 2024-03-25T09:05:25.942 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-03-25T09:05:25.942 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options 2024-03-25T09:05:25.942 INFO:teuthology.orchestra.run.smithi040.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-25T09:05:25.942 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 5.4 M 2024-03-25T09:05:25.943 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 20 M 2024-03-25T09:05:25.943 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 25 k 2024-03-25T09:05:25.943 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-25T09:05:25.943 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-25T09:05:25.943 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-25T09:05:25.943 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 745 k 2024-03-25T09:05:25.944 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-25T09:05:25.944 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-25T09:05:25.944 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-25T09:05:25.944 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 501 k 2024-03-25T09:05:25.944 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-25T09:05:25.944 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 5.2 M 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 45 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 131 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 162 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 321 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 298 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 99 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-25T09:05:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-25T09:05:25.946 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-25T09:05:25.946 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-03-25T09:05:25.946 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-25T09:05:25.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:05:25.946 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:05:25.946 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:05:25.946 INFO:teuthology.orchestra.run.smithi040.stdout:Install 30 Packages 2024-03-25T09:05:25.946 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 2 Packages 2024-03-25T09:05:25.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:05:25.950 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 58 M 2024-03-25T09:05:25.950 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:05:26.009 INFO:teuthology.orchestra.run.smithi059.stdout:(3/32): libcephfs2-19.0.0-1997.g47ea673a.el9.x8 5.5 MB/s | 745 kB 00:00 2024-03-25T09:05:26.126 INFO:teuthology.orchestra.run.smithi059.stdout:(4/32): libradosstriper1-19.0.0-1997.g47ea673a. 4.2 MB/s | 501 kB 00:00 2024-03-25T09:05:26.235 INFO:teuthology.orchestra.run.smithi059.stdout:(5/32): ceph-radosgw-19.0.0-1997.g47ea673a.el9. 7.5 MB/s | 9.8 MB 00:01 2024-03-25T09:05:26.302 INFO:teuthology.orchestra.run.smithi059.stdout:(6/32): python3-ceph-argparse-19.0.0-1997.g47ea 679 kB/s | 45 kB 00:00 2024-03-25T09:05:26.369 INFO:teuthology.orchestra.run.smithi059.stdout:(7/32): python3-ceph-common-19.0.0-1997.g47ea67 1.9 MB/s | 131 kB 00:00 2024-03-25T09:05:26.435 INFO:teuthology.orchestra.run.smithi059.stdout:(8/32): python3-cephfs-19.0.0-1997.g47ea673a.el 2.4 MB/s | 162 kB 00:00 2024-03-25T09:05:26.527 INFO:teuthology.orchestra.run.smithi059.stdout:(9/32): python3-rados-19.0.0-1997.g47ea673a.el9 3.4 MB/s | 321 kB 00:00 2024-03-25T09:05:26.594 INFO:teuthology.orchestra.run.smithi059.stdout:(10/32): librgw2-19.0.0-1997.g47ea673a.el9.x86_ 11 MB/s | 5.2 MB 00:00 2024-03-25T09:05:26.620 INFO:teuthology.orchestra.run.smithi059.stdout:(11/32): python3-rbd-19.0.0-1997.g47ea673a.el9. 3.2 MB/s | 298 kB 00:00 2024-03-25T09:05:26.646 INFO:teuthology.orchestra.run.smithi059.stdout:(12/32): python3-rgw-19.0.0-1997.g47ea673a.el9. 1.9 MB/s | 99 kB 00:00 2024-03-25T09:05:26.770 INFO:teuthology.orchestra.run.smithi059.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2024-03-25T09:05:26.796 INFO:teuthology.orchestra.run.smithi059.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 603 kB/s | 106 kB 00:00 2024-03-25T09:05:26.812 INFO:teuthology.orchestra.run.smithi059.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-25T09:05:26.863 INFO:teuthology.orchestra.run.smithi059.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-03-25T09:05:26.888 INFO:teuthology.orchestra.run.smithi059.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-03-25T09:05:26.905 INFO:teuthology.orchestra.run.smithi059.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 992 kB/s | 41 kB 00:00 2024-03-25T09:05:26.980 INFO:teuthology.orchestra.run.smithi059.stdout:(19/32): qatlib-service-23.11.0-1.el9.x86_64.rp 466 kB/s | 35 kB 00:00 2024-03-25T09:05:27.031 INFO:teuthology.orchestra.run.smithi059.stdout:(20/32): qatzip-libs-1.1.2-2.el9.x86_64.rpm 894 kB/s | 44 kB 00:00 2024-03-25T09:05:27.064 INFO:teuthology.orchestra.run.smithi059.stdout:(21/32): qatlib-23.11.0-1.el9.x86_64.rpm 1.2 MB/s | 216 kB 00:00 2024-03-25T09:05:27.390 INFO:teuthology.orchestra.run.smithi059.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 860 kB/s | 309 kB 00:00 2024-03-25T09:05:27.448 INFO:teuthology.orchestra.run.smithi059.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 446 kB/s | 26 kB 00:00 2024-03-25T09:05:27.507 INFO:teuthology.orchestra.run.smithi059.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 831 kB/s | 49 kB 00:00 2024-03-25T09:05:27.582 INFO:teuthology.orchestra.run.smithi059.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 901 kB/s | 67 kB 00:00 2024-03-25T09:05:27.649 INFO:teuthology.orchestra.run.smithi059.stdout:(26/32): libarrow-9.0.0-10.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-03-25T09:05:27.701 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-03-25T09:05:27.908 INFO:teuthology.orchestra.run.smithi059.stdout:(27/32): ceph-common-19.0.0-1997.g47ea673a.el9. 6.7 MB/s | 20 MB 00:02 2024-03-25T09:05:27.933 INFO:teuthology.orchestra.run.smithi059.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 676 kB/s | 192 kB 00:00 2024-03-25T09:05:27.958 INFO:teuthology.orchestra.run.smithi059.stdout:(29/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.2 MB/s | 838 kB 00:00 2024-03-25T09:05:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:(1/32): ceph-base-19.0.0-1997.g47ea673a.el9.x86 2.7 MB/s | 5.4 MB 00:01 2024-03-25T09:05:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:(2/32): ceph-selinux-19.0.0-1997.g47ea673a.el9. 275 kB/s | 25 kB 00:00 2024-03-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi059.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 3.4 MB/s | 1.6 MB 00:00 2024-03-25T09:05:28.426 INFO:teuthology.orchestra.run.smithi059.stdout:(31/32): librbd1-19.0.0-1997.g47ea673a.el9.x86_ 6.7 MB/s | 3.1 MB 00:00 2024-03-25T09:05:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:(3/32): libcephfs2-19.0.0-1997.g47ea673a.el9.x8 2.8 MB/s | 745 kB 00:00 2024-03-25T09:05:28.634 INFO:teuthology.orchestra.run.smithi059.stdout:(32/32): librados2-19.0.0-1997.g47ea673a.el9.x8 4.8 MB/s | 3.4 MB 00:00 2024-03-25T09:05:28.637 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:05:28.637 INFO:teuthology.orchestra.run.smithi059.stdout:Total 13 MB/s | 58 MB 00:04 2024-03-25T09:05:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:(4/32): libradosstriper1-19.0.0-1997.g47ea673a. 2.8 MB/s | 501 kB 00:00 2024-03-25T09:05:28.672 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:05:28.714 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:05:28.714 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:05:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:(5/32): ceph-common-19.0.0-1997.g47ea673a.el9.x 7.4 MB/s | 20 MB 00:02 2024-03-25T09:05:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:(6/32): python3-ceph-argparse-19.0.0-1997.g47ea 1.1 MB/s | 45 kB 00:00 2024-03-25T09:05:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:(7/32): python3-ceph-common-19.0.0-1997.g47ea67 2.2 MB/s | 131 kB 00:00 2024-03-25T09:05:29.014 INFO:teuthology.orchestra.run.smithi040.stdout:(8/32): python3-cephfs-19.0.0-1997.g47ea673a.el 2.4 MB/s | 162 kB 00:00 2024-03-25T09:05:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:(9/32): ceph-radosgw-19.0.0-1997.g47ea673a.el9. 3.3 MB/s | 9.8 MB 00:02 2024-03-25T09:05:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:(10/32): python3-rados-19.0.0-1997.g47ea673a.el 2.3 MB/s | 321 kB 00:00 2024-03-25T09:05:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:(11/32): python3-rgw-19.0.0-1997.g47ea673a.el9. 1.9 MB/s | 99 kB 00:00 2024-03-25T09:05:29.212 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:05:29.212 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:05:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:(12/32): python3-rbd-19.0.0-1997.g47ea673a.el9. 2.9 MB/s | 298 kB 00:00 2024-03-25T09:05:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:(13/32): librgw2-19.0.0-1997.g47ea673a.el9.x86_ 7.3 MB/s | 5.2 MB 00:00 2024-03-25T09:05:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 551 kB/s | 106 kB 00:00 2024-03-25T09:05:29.390 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 932 kB/s | 19 MB 00:20 2024-03-25T09:05:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 44 kB 00:00 2024-03-25T09:05:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 801 kB/s | 159 kB 00:00 2024-03-25T09:05:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 661 kB 00:00 2024-03-25T09:05:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 282 kB 00:00 2024-03-25T09:05:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 353 kB/s | 41 kB 00:00 2024-03-25T09:05:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:(20/32): qatlib-service-23.11.0-1.el9.x86_64.rp 323 kB/s | 35 kB 00:00 2024-03-25T09:05:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:(21/32): qatzip-libs-1.1.2-2.el9.x86_64.rpm 334 kB/s | 44 kB 00:00 2024-03-25T09:05:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 772 kB/s | 309 kB 00:00 2024-03-25T09:05:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-03-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 728 kB/s | 49 kB 00:00 2024-03-25T09:05:30.267 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:05:30.273 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:05:30.273 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-25T09:05:30.273 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:05:30.273 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:05:30.273 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 9.8 M 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.4 M 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.1 M 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 5.4 M 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 20 M 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 25 k 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-25T09:05:30.274 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 745 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 501 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 5.2 M 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 45 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 131 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 162 k 2024-03-25T09:05:30.275 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 321 k 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 298 k 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 99 k 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:05:30.276 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:05:30.277 INFO:teuthology.orchestra.run.smithi019.stdout:Install 30 Packages 2024-03-25T09:05:30.277 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 2 Packages 2024-03-25T09:05:30.277 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:05:30.277 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 58 M 2024-03-25T09:05:30.277 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:05:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 899 kB/s | 67 kB 00:00 2024-03-25T09:05:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:(26/32): qatlib-23.11.0-1.el9.x86_64.rpm 273 kB/s | 216 kB 00:00 2024-03-25T09:05:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:(27/32): libarrow-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2024-03-25T09:05:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2024-03-25T09:05:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-03-25T09:05:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:(30/32): re2-20211101-3.el9.x86_64.rpm 488 kB/s | 192 kB 00:00 2024-03-25T09:05:30.735 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:05:30.818 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-03-25T09:05:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:(31/32): librbd1-19.0.0-1997.g47ea673a.el9.x86_ 9.9 MB/s | 3.1 MB 00:00 2024-03-25T09:05:30.855 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-03-25T09:05:30.884 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-03-25T09:05:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-25T09:05:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-25T09:05:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:(32/32): librados2-19.0.0-1997.g47ea673a.el9.x8 6.5 MB/s | 3.4 MB 00:00 2024-03-25T09:05:31.067 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:05:31.067 INFO:teuthology.orchestra.run.smithi040.stdout:Total 11 MB/s | 58 MB 00:05 2024-03-25T09:05:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:05:31.120 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-25T09:05:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:05:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:05:31.176 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-25T09:05:31.452 INFO:teuthology.orchestra.run.smithi019.stdout:(1/32): ceph-base-19.0.0-1997.g47ea673a.el9.x86 7.2 MB/s | 5.4 MB 00:00 2024-03-25T09:05:31.514 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-03-25T09:05:31.519 INFO:teuthology.orchestra.run.smithi019.stdout:(2/32): ceph-selinux-19.0.0-1997.g47ea673a.el9. 379 kB/s | 25 kB 00:00 2024-03-25T09:05:31.566 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:05:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout:(3/32): libcephfs2-19.0.0-1997.g47ea673a.el9.x8 5.8 MB/s | 745 kB 00:00 2024-03-25T09:05:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:31.736 INFO:teuthology.orchestra.run.smithi019.stdout:(4/32): libradosstriper1-19.0.0-1997.g47ea673a. 5.3 MB/s | 501 kB 00:00 2024-03-25T09:05:31.748 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 8/34 2024-03-25T09:05:31.775 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 9/34 2024-03-25T09:05:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 9/34 2024-03-25T09:05:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-03-25T09:05:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9. 11/34 2024-03-25T09:05:31.973 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 12/34 2024-03-25T09:05:32.003 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 13/34 2024-03-25T09:05:32.065 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 13/34 2024-03-25T09:05:32.093 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 14/34 2024-03-25T09:05:32.233 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-03-25T09:05:32.273 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-03-25T09:05:32.309 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-03-25T09:05:32.311 INFO:teuthology.orchestra.run.smithi019.stdout:(5/32): ceph-common-19.0.0-1997.g47ea673a.el9.x 12 MB/s | 20 MB 00:01 2024-03-25T09:05:32.342 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-03-25T09:05:32.371 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-03-25T09:05:32.387 INFO:teuthology.orchestra.run.smithi019.stdout:(6/32): librgw2-19.0.0-1997.g47ea673a.el9.x86_6 7.9 MB/s | 5.2 MB 00:00 2024-03-25T09:05:32.395 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-03-25T09:05:32.412 INFO:teuthology.orchestra.run.smithi019.stdout:(7/32): python3-ceph-argparse-19.0.0-1997.g47ea 450 kB/s | 45 kB 00:00 2024-03-25T09:05:32.438 INFO:teuthology.orchestra.run.smithi019.stdout:(8/32): python3-ceph-common-19.0.0-1997.g47ea67 2.5 MB/s | 131 kB 00:00 2024-03-25T09:05:32.463 INFO:teuthology.orchestra.run.smithi019.stdout:(9/32): python3-cephfs-19.0.0-1997.g47ea673a.el 3.2 MB/s | 162 kB 00:00 2024-03-25T09:05:32.488 INFO:teuthology.orchestra.run.smithi019.stdout:(10/32): python3-rados-19.0.0-1997.g47ea673a.el 6.3 MB/s | 321 kB 00:00 2024-03-25T09:05:32.513 INFO:teuthology.orchestra.run.smithi019.stdout:(11/32): python3-rbd-19.0.0-1997.g47ea673a.el9. 5.8 MB/s | 298 kB 00:00 2024-03-25T09:05:32.538 INFO:teuthology.orchestra.run.smithi019.stdout:(12/32): python3-rgw-19.0.0-1997.g47ea673a.el9. 1.9 MB/s | 99 kB 00:00 2024-03-25T09:05:32.655 INFO:teuthology.orchestra.run.smithi019.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 746 kB/s | 106 kB 00:00 2024-03-25T09:05:32.681 INFO:teuthology.orchestra.run.smithi019.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2024-03-25T09:05:32.706 INFO:teuthology.orchestra.run.smithi019.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 879 kB/s | 44 kB 00:00 2024-03-25T09:05:32.729 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-03-25T09:05:32.756 INFO:teuthology.orchestra.run.smithi019.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-25T09:05:32.758 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 22/34 2024-03-25T09:05:32.782 INFO:teuthology.orchestra.run.smithi019.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-03-25T09:05:32.807 INFO:teuthology.orchestra.run.smithi019.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 825 kB/s | 41 kB 00:00 2024-03-25T09:05:32.849 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 22/34 2024-03-25T09:05:32.880 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 23/34 2024-03-25T09:05:32.924 INFO:teuthology.orchestra.run.smithi019.stdout:(19/32): qatlib-service-23.11.0-1.el9.x86_64.rp 299 kB/s | 35 kB 00:00 2024-03-25T09:05:32.924 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-03-25T09:05:33.007 INFO:teuthology.orchestra.run.smithi019.stdout:(20/32): qatzip-libs-1.1.2-2.el9.x86_64.rpm 534 kB/s | 44 kB 00:00 2024-03-25T09:05:33.033 INFO:teuthology.orchestra.run.smithi019.stdout:(21/32): qatlib-23.11.0-1.el9.x86_64.rpm 863 kB/s | 216 kB 00:00 2024-03-25T09:05:33.141 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:05:33.218 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-03-25T09:05:33.256 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-03-25T09:05:33.285 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-03-25T09:05:33.291 INFO:teuthology.orchestra.run.smithi019.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-03-25T09:05:33.330 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-25T09:05:33.346 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-25T09:05:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-03-25T09:05:33.408 INFO:teuthology.orchestra.run.smithi019.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-03-25T09:05:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 26/34 2024-03-25T09:05:33.501 INFO:teuthology.orchestra.run.smithi019.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2024-03-25T09:05:33.515 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 26/34 2024-03-25T09:05:33.526 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-25T09:05:33.567 INFO:teuthology.orchestra.run.smithi019.stdout:(25/32): libarrow-9.0.0-10.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-03-25T09:05:33.578 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-25T09:05:33.585 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 27/34 2024-03-25T09:05:33.592 INFO:teuthology.orchestra.run.smithi019.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-03-25T09:05:33.613 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x8 28/34 2024-03-25T09:05:33.643 INFO:teuthology.orchestra.run.smithi019.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 11 MB/s | 838 kB 00:00 2024-03-25T09:05:33.668 INFO:teuthology.orchestra.run.smithi019.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-25T09:05:33.744 INFO:teuthology.orchestra.run.smithi019.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-03-25T09:05:33.983 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-03-25T09:05:34.026 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:34.061 INFO:teuthology.orchestra.run.smithi019.stdout:(30/32): librados2-19.0.0-1997.g47ea673a.el9.x8 8.7 MB/s | 3.4 MB 00:00 2024-03-25T09:05:34.082 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.1 MB 00:01 2024-03-25T09:05:34.102 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:34.119 INFO:teuthology.orchestra.run.smithi019.stdout:(31/32): librbd1-19.0.0-1997.g47ea673a.el9.x86_ 8.4 MB/s | 3.1 MB 00:00 2024-03-25T09:05:34.191 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 8/34 2024-03-25T09:05:34.219 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 9/34 2024-03-25T09:05:34.281 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 9/34 2024-03-25T09:05:34.310 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-03-25T09:05:34.355 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9. 11/34 2024-03-25T09:05:34.424 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 12/34 2024-03-25T09:05:34.444 INFO:teuthology.orchestra.run.smithi019.stdout:(32/32): ceph-radosgw-19.0.0-1997.g47ea673a.el9 2.6 MB/s | 9.8 MB 00:03 2024-03-25T09:05:34.446 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 13/34 2024-03-25T09:05:34.448 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:05:34.448 INFO:teuthology.orchestra.run.smithi019.stdout:Total 14 MB/s | 58 MB 00:04 2024-03-25T09:05:34.484 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:05:34.522 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 13/34 2024-03-25T09:05:34.524 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:05:34.525 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:05:34.553 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 14/34 2024-03-25T09:05:34.664 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-03-25T09:05:34.704 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-03-25T09:05:34.745 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-03-25T09:05:34.777 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-03-25T09:05:34.806 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-03-25T09:05:34.839 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-03-25T09:05:35.016 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:05:35.016 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:05:35.168 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-03-25T09:05:35.210 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 22/34 2024-03-25T09:05:35.301 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 22/34 2024-03-25T09:05:35.331 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 23/34 2024-03-25T09:05:35.376 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-03-25T09:05:35.860 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-03-25T09:05:35.878 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-03-25T09:05:35.888 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 26/34 2024-03-25T09:05:35.897 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:35.935 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:35.944 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 26/34 2024-03-25T09:05:36.014 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 27/34 2024-03-25T09:05:36.049 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x8 28/34 2024-03-25T09:05:36.537 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:36.572 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 30/34 2024-03-25T09:05:36.647 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 30/34 2024-03-25T09:05:36.647 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-25T09:05:36.647 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-25T09:05:36.647 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:05:36.672 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:05:36.681 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:05:36.755 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-03-25T09:05:36.761 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 27 MB/s | 21 MB 00:00 2024-03-25T09:05:36.790 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-03-25T09:05:36.816 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-03-25T09:05:36.847 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-25T09:05:36.864 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-25T09:05:37.072 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-25T09:05:37.129 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-25T09:05:37.526 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-03-25T09:05:37.559 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:37.635 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:37.725 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 8/34 2024-03-25T09:05:37.753 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 9/34 2024-03-25T09:05:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 9/34 2024-03-25T09:05:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-03-25T09:05:37.880 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9. 11/34 2024-03-25T09:05:37.950 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 12/34 2024-03-25T09:05:37.972 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 13/34 2024-03-25T09:05:38.034 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 13/34 2024-03-25T09:05:38.062 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 14/34 2024-03-25T09:05:38.174 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-03-25T09:05:38.214 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-03-25T09:05:38.254 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-03-25T09:05:38.286 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-03-25T09:05:38.315 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-03-25T09:05:38.323 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:38.348 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-03-25T09:05:38.412 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:38.684 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-03-25T09:05:38.711 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 22/34 2024-03-25T09:05:38.802 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 22/34 2024-03-25T09:05:38.832 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 23/34 2024-03-25T09:05:38.875 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-03-25T09:05:39.017 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:39.049 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 30/34 2024-03-25T09:05:39.139 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 30/34 2024-03-25T09:05:39.139 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-25T09:05:39.139 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-25T09:05:39.139 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:05:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:05:39.362 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-03-25T09:05:39.389 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 26/34 2024-03-25T09:05:39.443 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 26/34 2024-03-25T09:05:39.514 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 27/34 2024-03-25T09:05:39.541 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x8 28/34 2024-03-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-03-25T09:05:41.797 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:41.838 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:42.434 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:42.466 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 30/34 2024-03-25T09:05:42.556 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 30/34 2024-03-25T09:05:42.556 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-25T09:05:42.556 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-25T09:05:42.557 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:05:42.610 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:05:44.114 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:05:44.128 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:05:44.128 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:05:44.128 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:05:44.128 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:05:44.128 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 9.8 M 2024-03-25T09:05:44.128 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2024-03-25T09:05:44.128 INFO:teuthology.orchestra.run.smithi129.stdout: librados2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.4 M 2024-03-25T09:05:44.128 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.1 M 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: boost-program-options 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 5.4 M 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 20 M 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 25 k 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 745 k 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-25T09:05:44.129 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 501 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2 x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 5.2 M 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 45 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 131 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 162 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 321 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 298 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 99 k 2024-03-25T09:05:44.130 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout:Installing weak dependencies: 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout:Install 30 Packages 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 2 Packages 2024-03-25T09:05:44.131 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:05:44.132 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 58 M 2024-03-25T09:05:44.132 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:05:46.096 INFO:teuthology.orchestra.run.smithi129.stdout:(1/32): ceph-radosgw-19.0.0-1997.g47ea673a.el9. 7.4 MB/s | 9.8 MB 00:01 2024-03-25T09:05:46.129 INFO:teuthology.orchestra.run.smithi129.stdout:(2/32): ceph-selinux-19.0.0-1997.g47ea673a.el9. 760 kB/s | 25 kB 00:00 2024-03-25T09:05:46.263 INFO:teuthology.orchestra.run.smithi129.stdout:(3/32): ceph-base-19.0.0-1997.g47ea673a.el9.x86 3.6 MB/s | 5.4 MB 00:01 2024-03-25T09:05:46.297 INFO:teuthology.orchestra.run.smithi129.stdout:(4/32): libcephfs2-19.0.0-1997.g47ea673a.el9.x8 4.4 MB/s | 745 kB 00:00 2024-03-25T09:05:46.455 INFO:teuthology.orchestra.run.smithi129.stdout:(5/32): libradosstriper1-19.0.0-1997.g47ea673a. 2.5 MB/s | 501 kB 00:00 2024-03-25T09:05:46.689 INFO:teuthology.orchestra.run.smithi129.stdout:(6/32): ceph-common-19.0.0-1997.g47ea673a.el9.x 10 MB/s | 20 MB 00:01 2024-03-25T09:05:46.714 INFO:teuthology.orchestra.run.smithi129.stdout:(7/32): python3-ceph-argparse-19.0.0-1997.g47ea 174 kB/s | 45 kB 00:00 2024-03-25T09:05:46.740 INFO:teuthology.orchestra.run.smithi129.stdout:(8/32): python3-ceph-common-19.0.0-1997.g47ea67 2.6 MB/s | 131 kB 00:00 2024-03-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2024-03-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2024-03-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2024-03-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2024-03-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2024-03-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /root 2024-03-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2024-03-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:05:46.840 INFO:teuthology.orchestra.run.smithi129.stdout:(9/32): librgw2-19.0.0-1997.g47ea673a.el9.x86_6 9.5 MB/s | 5.2 MB 00:00 2024-03-25T09:05:46.865 INFO:teuthology.orchestra.run.smithi129.stdout:(10/32): python3-cephfs-19.0.0-1997.g47ea673a.e 1.1 MB/s | 162 kB 00:00 2024-03-25T09:05:46.890 INFO:teuthology.orchestra.run.smithi129.stdout:(11/32): python3-rados-19.0.0-1997.g47ea673a.el 2.1 MB/s | 321 kB 00:00 2024-03-25T09:05:46.915 INFO:teuthology.orchestra.run.smithi129.stdout:(12/32): python3-rbd-19.0.0-1997.g47ea673a.el9. 3.9 MB/s | 298 kB 00:00 2024-03-25T09:05:46.932 INFO:teuthology.orchestra.run.smithi129.stdout:(13/32): python3-rgw-19.0.0-1997.g47ea673a.el9. 1.4 MB/s | 99 kB 00:00 2024-03-25T09:05:47.058 INFO:teuthology.orchestra.run.smithi129.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 633 kB/s | 106 kB 00:00 2024-03-25T09:05:47.083 INFO:teuthology.orchestra.run.smithi129.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 953 kB/s | 159 kB 00:00 2024-03-25T09:05:47.108 INFO:teuthology.orchestra.run.smithi129.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 349 kB/s | 44 kB 00:00 2024-03-25T09:05:47.225 INFO:teuthology.orchestra.run.smithi129.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 661 kB 00:00 2024-03-25T09:05:47.251 INFO:teuthology.orchestra.run.smithi129.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 290 kB/s | 41 kB 00:00 2024-03-25T09:05:47.276 INFO:teuthology.orchestra.run.smithi129.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 282 kB 00:00 2024-03-25T09:05:47.342 INFO:teuthology.orchestra.run.smithi129.stdout:(20/32): qatlib-service-23.11.0-1.el9.x86_64.rp 381 kB/s | 35 kB 00:00 2024-03-25T09:05:47.385 INFO:teuthology.orchestra.run.smithi129.stdout:(21/32): qatzip-libs-1.1.2-2.el9.x86_64.rpm 410 kB/s | 44 kB 00:00 2024-03-25T09:05:47.427 INFO:teuthology.orchestra.run.smithi129.stdout:(22/32): qatlib-23.11.0-1.el9.x86_64.rpm 1.1 MB/s | 216 kB 00:00 2024-03-25T09:05:47.702 INFO:teuthology.orchestra.run.smithi129.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 94 kB/s | 26 kB 00:00 2024-03-25T09:05:47.750 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 32/34 2024-03-25T09:05:47.774 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 32/34 2024-03-25T09:05:47.774 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:05:47.774 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-25T09:05:47.774 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T09:05:47.774 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T09:05:47.774 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:05:47.776 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-25T09:05:47.860 INFO:teuthology.orchestra.run.smithi129.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 597 kB/s | 309 kB 00:00 2024-03-25T09:05:47.869 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-25T09:05:47.870 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:05:48.044 INFO:teuthology.orchestra.run.smithi129.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 142 kB/s | 49 kB 00:00 2024-03-25T09:05:48.244 INFO:teuthology.orchestra.run.smithi129.stdout:(26/32): libarrow-9.0.0-10.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-03-25T09:05:48.269 INFO:teuthology.orchestra.run.smithi129.stdout:(27/32): libunwind-1.6.2-1.el9.x86_64.rpm 165 kB/s | 67 kB 00:00 2024-03-25T09:05:48.720 INFO:teuthology.orchestra.run.smithi129.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-03-25T09:05:48.753 INFO:teuthology.orchestra.run.smithi129.stdout:(29/32): re2-20211101-3.el9.x86_64.rpm 377 kB/s | 192 kB 00:00 2024-03-25T09:05:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:05:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 1/34 2024-03-25T09:05:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 3/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 4/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 5/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 6/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9. 8/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x8 9/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 10/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 11/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 12/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 13/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-03-25T09:05:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 20/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 21/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 22/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-03-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-03-25T09:05:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:05:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-03-25T09:05:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 33/34 2024-03-25T09:05:49.062 INFO:teuthology.orchestra.run.smithi129.stdout:(30/32): librbd1-19.0.0-1997.g47ea673a.el9.x86_ 10 MB/s | 3.1 MB 00:00 2024-03-25T09:05:49.095 INFO:teuthology.orchestra.run.smithi129.stdout:(31/32): thrift-0.15.0-2.el9.x86_64.rpm 1.9 MB/s | 1.6 MB 00:00 2024-03-25T09:05:49.259 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:05:49.259 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2024-03-25T09:05:49.260 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2024-03-25T09:05:49.260 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2024-03-25T09:05:49.260 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2024-03-25T09:05:49.260 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2024-03-25T09:05:49.260 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /root 2024-03-25T09:05:49.260 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2024-03-25T09:05:49.260 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:05:49.337 INFO:teuthology.orchestra.run.smithi129.stdout:(32/32): librados2-19.0.0-1997.g47ea673a.el9.x8 5.5 MB/s | 3.4 MB 00:00 2024-03-25T09:05:49.342 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi129.stdout:Total 11 MB/s | 58 MB 00:05 2024-03-25T09:05:49.374 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:05:49.412 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:05:49.412 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:05:49.886 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:05:49.886 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:05:50.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:05:50.122 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:05:50.122 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2024-03-25T09:05:50.122 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.122 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.122 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-25T09:05:50.123 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-25T09:05:50.124 INFO:teuthology.orchestra.run.smithi059.stdout: re2-1:20211101-3.el9.x86_64 2024-03-25T09:05:50.125 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-25T09:05:50.125 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:05:50.125 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:05:50.192 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 32/34 2024-03-25T09:05:50.216 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 32/34 2024-03-25T09:05:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:05:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-25T09:05:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T09:05:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T09:05:50.216 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:05:50.218 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-25T09:05:50.286 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-25T09:05:50.286 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:05:50.364 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-test 2024-03-25T09:05:50.949 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:29 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:05:51.111 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:05:51.112 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:05:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-25T09:05:51.112 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:05:51.112 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:05:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 48 M 2024-03-25T09:05:51.112 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-25T09:05:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-25T09:05:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 163 k 2024-03-25T09:05:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-25T09:05:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-25T09:05:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-25T09:05:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:05:51.113 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:05:51.113 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:05:51.113 INFO:teuthology.orchestra.run.smithi059.stdout:Install 6 Packages 2024-03-25T09:05:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:05:51.113 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 48 M 2024-03-25T09:05:51.114 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 205 M 2024-03-25T09:05:51.114 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:05:51.378 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:05:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:05:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 1/34 2024-03-25T09:05:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2/34 2024-03-25T09:05:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 3/34 2024-03-25T09:05:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 4/34 2024-03-25T09:05:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 5/34 2024-03-25T09:05:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 6/34 2024-03-25T09:05:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9. 8/34 2024-03-25T09:05:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x8 9/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 10/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 11/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 12/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 13/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 20/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 21/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 22/34 2024-03-25T09:05:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-03-25T09:05:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-03-25T09:05:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-03-25T09:05:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-03-25T09:05:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-03-25T09:05:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-03-25T09:05:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-03-25T09:05:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-03-25T09:05:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:05:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-03-25T09:05:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 33/34 2024-03-25T09:05:51.390 INFO:teuthology.orchestra.run.smithi059.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 217 kB 00:00 2024-03-25T09:05:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-03-25T09:05:51.466 INFO:teuthology.orchestra.run.smithi059.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-03-25T09:05:51.470 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-03-25T09:05:51.508 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-03-25T09:05:51.534 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-03-25T09:05:51.556 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-25T09:05:51.572 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-25T09:05:51.607 INFO:teuthology.orchestra.run.smithi059.stdout:(4/6): libcephsqlite-19.0.0-1997.g47ea673a.el9. 435 kB/s | 163 kB 00:00 2024-03-25T09:05:51.658 INFO:teuthology.orchestra.run.smithi059.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 975 kB/s | 187 kB 00:00 2024-03-25T09:05:51.774 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-25T09:05:51.829 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-25T09:05:52.205 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-03-25T09:05:52.235 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:52.344 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:05:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-25T09:05:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-25T09:05:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-25T09:05:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-25T09:05:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-25T09:05:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: re2-1:20211101-3.el9.x86_64 2024-03-25T09:05:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-25T09:05:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:05:52.387 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:05:52.433 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 8/34 2024-03-25T09:05:52.462 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 9/34 2024-03-25T09:05:52.508 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 9/34 2024-03-25T09:05:52.537 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-03-25T09:05:52.591 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9. 11/34 2024-03-25T09:05:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 12/34 2024-03-25T09:05:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 13/34 2024-03-25T09:05:52.695 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:05:52.696 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-03-25T09:05:52.696 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-03-25T09:05:52.696 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-03-25T09:05:52.696 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-03-25T09:05:52.696 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-03-25T09:05:52.696 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-03-25T09:05:52.696 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-03-25T09:05:52.696 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:05:52.713 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-test 2024-03-25T09:05:52.752 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 13/34 2024-03-25T09:05:52.779 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 14/34 2024-03-25T09:05:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-03-25T09:05:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-03-25T09:05:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-03-25T09:05:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-03-25T09:05:53.041 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-03-25T09:05:53.073 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-03-25T09:05:53.279 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:30 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:05:53.397 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-03-25T09:05:53.429 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 22/34 2024-03-25T09:05:53.433 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:05:53.434 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:05:53.434 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-03-25T09:05:53.434 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:05:53.434 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:05:53.434 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 48 M 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 163 k 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout:Install 6 Packages 2024-03-25T09:05:53.435 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:05:53.436 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 48 M 2024-03-25T09:05:53.436 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 205 M 2024-03-25T09:05:53.436 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:05:53.501 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 22/34 2024-03-25T09:05:53.533 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 23/34 2024-03-25T09:05:53.571 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-03-25T09:05:53.653 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 32/34 2024-03-25T09:05:53.677 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 32/34 2024-03-25T09:05:53.677 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:05:53.677 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-25T09:05:53.677 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T09:05:53.677 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T09:05:53.677 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:05:53.679 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-25T09:05:53.683 INFO:teuthology.orchestra.run.smithi040.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.2 MB/s | 217 kB 00:00 2024-03-25T09:05:53.725 INFO:teuthology.orchestra.run.smithi040.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2024-03-25T09:05:53.750 INFO:teuthology.orchestra.run.smithi040.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 63 kB 00:00 2024-03-25T09:05:53.764 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-25T09:05:53.764 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:05:53.892 INFO:teuthology.orchestra.run.smithi040.stdout:(4/6): libcephsqlite-19.0.0-1997.g47ea673a.el9. 417 kB/s | 163 kB 00:00 2024-03-25T09:05:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-03-25T09:05:54.047 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 26/34 2024-03-25T09:05:54.050 INFO:teuthology.orchestra.run.smithi040.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 623 kB/s | 187 kB 00:00 2024-03-25T09:05:54.118 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 26/34 2024-03-25T09:05:54.186 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 27/34 2024-03-25T09:05:54.225 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x8 28/34 2024-03-25T09:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 1/34 2024-03-25T09:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2/34 2024-03-25T09:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 3/34 2024-03-25T09:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 4/34 2024-03-25T09:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 5/34 2024-03-25T09:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 6/34 2024-03-25T09:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9. 8/34 2024-03-25T09:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x8 9/34 2024-03-25T09:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 10/34 2024-03-25T09:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 11/34 2024-03-25T09:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 12/34 2024-03-25T09:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 13/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 20/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 21/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 22/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-03-25T09:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-03-25T09:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-03-25T09:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-03-25T09:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-03-25T09:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-03-25T09:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-03-25T09:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-03-25T09:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-03-25T09:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 33/34 2024-03-25T09:05:55.308 INFO:teuthology.orchestra.run.smithi059.stdout:(6/6): ceph-test-19.0.0-1997.g47ea673a.el9.x86_ 12 MB/s | 48 MB 00:04 2024-03-25T09:05:55.310 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:05:55.311 INFO:teuthology.orchestra.run.smithi059.stdout:Total 12 MB/s | 48 MB 00:04 2024-03-25T09:05:55.325 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:05:55.347 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:05:55.348 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:05:55.753 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:05:55.753 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:05:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:05:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:05:55.758 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-03-25T09:05:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.758 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:05:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-25T09:05:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-25T09:05:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-3.el9.x86_64 2024-03-25T09:05:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-25T09:05:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:05:55.761 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:05:56.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-test 2024-03-25T09:05:56.340 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:05:56.379 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:56.409 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-25T09:05:56.421 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-25T09:05:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-25T09:05:56.542 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-25T09:05:56.569 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 5/6 2024-03-25T09:05:56.673 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:29 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:05:56.838 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:05:56.839 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:05:56.839 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-25T09:05:56.839 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:05:56.839 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:05:56.839 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 48 M 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 163 k 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout:Install 6 Packages 2024-03-25T09:05:56.840 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:05:56.841 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 48 M 2024-03-25T09:05:56.841 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 205 M 2024-03-25T09:05:56.841 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:05:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 29/34 2024-03-25T09:05:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 30/34 2024-03-25T09:05:57.121 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 30/34 2024-03-25T09:05:57.122 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-25T09:05:57.122 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-25T09:05:57.122 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:05:57.168 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:05:57.225 INFO:teuthology.orchestra.run.smithi040.stdout:(6/6): ceph-test-19.0.0-1997.g47ea673a.el9.x86_ 13 MB/s | 48 MB 00:03 2024-03-25T09:05:57.228 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:05:57.229 INFO:teuthology.orchestra.run.smithi040.stdout:Total 13 MB/s | 48 MB 00:03 2024-03-25T09:05:57.243 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:05:57.266 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:05:57.266 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:05:57.286 INFO:teuthology.orchestra.run.smithi019.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.2 MB/s | 217 kB 00:00 2024-03-25T09:05:57.336 INFO:teuthology.orchestra.run.smithi019.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-03-25T09:05:57.362 INFO:teuthology.orchestra.run.smithi019.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 63 kB 00:00 2024-03-25T09:05:57.512 INFO:teuthology.orchestra.run.smithi019.stdout:(4/6): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-03-25T09:05:57.537 INFO:teuthology.orchestra.run.smithi019.stdout:(5/6): libcephsqlite-19.0.0-1997.g47ea673a.el9. 385 kB/s | 163 kB 00:00 2024-03-25T09:05:57.662 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:05:57.662 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:05:58.272 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:05:58.352 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-25T09:05:58.390 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-25T09:05:58.431 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-25T09:05:58.469 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-25T09:05:58.495 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 5/6 2024-03-25T09:05:59.437 INFO:teuthology.orchestra.run.smithi019.stdout:(6/6): ceph-test-19.0.0-1997.g47ea673a.el9.x86_ 20 MB/s | 48 MB 00:02 2024-03-25T09:05:59.440 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:05:59.441 INFO:teuthology.orchestra.run.smithi019.stdout:Total 19 MB/s | 48 MB 00:02 2024-03-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:05:59.479 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:05:59.479 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:05:59.879 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:05:59.879 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:06:00.470 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:06:00.530 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-25T09:06:00.569 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-25T09:06:00.600 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-25T09:06:00.645 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-25T09:06:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 5/6 2024-03-25T09:06:01.286 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 5/6 2024-03-25T09:06:01.371 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 6/6 2024-03-25T09:06:03.214 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 5/6 2024-03-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 6/6 2024-03-25T09:06:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 6/6 2024-03-25T09:06:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 1/6 2024-03-25T09:06:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 2/6 2024-03-25T09:06:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-25T09:06:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-25T09:06:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-25T09:06:04.169 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-25T09:06:04.169 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:04.169 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:06:04.169 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:04.170 INFO:teuthology.orchestra.run.smithi059.stdout: jq-1.6-16.el9.x86_64 2024-03-25T09:06:04.170 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:04.170 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-25T09:06:04.170 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-25T09:06:04.170 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-25T09:06:04.170 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:04.170 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:06:04.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph 2024-03-25T09:06:05.027 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:44 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:06:05.188 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout:========================================================================================= 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout:========================================================================================= 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 6.6 k 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 2.1 M 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 1.5 M 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 248 k 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 4.7 M 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 17 M 2024-03-25T09:06:05.191 INFO:teuthology.orchestra.run.smithi059.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-25T09:06:05.192 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-25T09:06:05.193 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:05.194 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:06:05.194 INFO:teuthology.orchestra.run.smithi059.stdout:========================================================================================= 2024-03-25T09:06:05.194 INFO:teuthology.orchestra.run.smithi059.stdout:Install 36 Packages 2024-03-25T09:06:05.194 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:05.194 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 30 M 2024-03-25T09:06:05.194 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 107 M 2024-03-25T09:06:05.195 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:06:05.439 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 5/6 2024-03-25T09:06:05.517 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 6/6 2024-03-25T09:06:05.718 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 6/6 2024-03-25T09:06:05.718 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 1/6 2024-03-25T09:06:05.718 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 2/6 2024-03-25T09:06:05.718 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-25T09:06:05.718 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-25T09:06:05.718 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-25T09:06:05.881 INFO:teuthology.orchestra.run.smithi059.stdout:(1/36): ceph-19.0.0-1997.g47ea673a.el9.x86_64.r 35 kB/s | 6.6 kB 00:00 2024-03-25T09:06:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-25T09:06:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:06.073 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:06:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: jq-1.6-16.el9.x86_64 2024-03-25T09:06:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:06.074 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-25T09:06:06.074 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-25T09:06:06.074 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-25T09:06:06.074 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:06.074 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:06.104 INFO:teuthology.orchestra.run.smithi059.stdout:(2/36): ceph-mds-19.0.0-1997.g47ea673a.el9.x86_ 5.1 MB/s | 2.1 MB 00:00 2024-03-25T09:06:06.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph 2024-03-25T09:06:06.379 INFO:teuthology.orchestra.run.smithi059.stdout:(3/36): ceph-mgr-19.0.0-1997.g47ea673a.el9.x86_ 2.2 MB/s | 1.5 MB 00:00 2024-03-25T09:06:06.529 INFO:teuthology.orchestra.run.smithi059.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1997.g47ea 1.6 MB/s | 248 kB 00:00 2024-03-25T09:06:06.663 INFO:teuthology.orchestra.run.smithi059.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2024-03-25T09:06:06.705 INFO:teuthology.orchestra.run.smithi059.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-03-25T09:06:06.738 INFO:teuthology.orchestra.run.smithi059.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 949 kB/s | 32 kB 00:00 2024-03-25T09:06:06.763 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:06:06.764 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /sys 2024-03-25T09:06:06.764 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /proc 2024-03-25T09:06:06.764 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /mnt 2024-03-25T09:06:06.764 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /var/tmp 2024-03-25T09:06:06.764 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /home 2024-03-25T09:06:06.764 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /root 2024-03-25T09:06:06.764 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /tmp 2024-03-25T09:06:06.764 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:06.772 INFO:teuthology.orchestra.run.smithi059.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-03-25T09:06:06.806 INFO:teuthology.orchestra.run.smithi059.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-03-25T09:06:06.856 INFO:teuthology.orchestra.run.smithi059.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-25T09:06:06.948 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:43 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:07.023 INFO:teuthology.orchestra.run.smithi059.stdout:(11/36): ceph-osd-19.0.0-1997.g47ea673a.el9.x86 18 MB/s | 17 MB 00:00 2024-03-25T09:06:07.056 INFO:teuthology.orchestra.run.smithi059.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 5.7 MB/s | 1.1 MB 00:00 2024-03-25T09:06:07.082 INFO:teuthology.orchestra.run.smithi059.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-25T09:06:07.107 INFO:teuthology.orchestra.run.smithi059.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-03-25T09:06:07.115 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:07.117 INFO:teuthology.orchestra.run.smithi040.stdout:========================================================================================= 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout:========================================================================================= 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 6.6 k 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 2.1 M 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 1.5 M 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 248 k 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 4.7 M 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 17 M 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-25T09:06:07.118 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-25T09:06:07.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-25T09:06:07.120 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-25T09:06:07.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:07.121 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:06:07.121 INFO:teuthology.orchestra.run.smithi040.stdout:========================================================================================= 2024-03-25T09:06:07.121 INFO:teuthology.orchestra.run.smithi040.stdout:Install 36 Packages 2024-03-25T09:06:07.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:07.122 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 30 M 2024-03-25T09:06:07.122 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 107 M 2024-03-25T09:06:07.122 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:06:07.132 INFO:teuthology.orchestra.run.smithi059.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2024-03-25T09:06:07.208 INFO:teuthology.orchestra.run.smithi059.stdout:(16/36): ceph-mon-19.0.0-1997.g47ea673a.el9.x86 3.6 MB/s | 4.7 MB 00:01 2024-03-25T09:06:07.316 INFO:teuthology.orchestra.run.smithi059.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 121 kB/s | 22 kB 00:00 2024-03-25T09:06:07.416 INFO:teuthology.orchestra.run.smithi059.stdout:(18/36): python3-requests-2.25.1-8.el9.noarch.r 404 kB/s | 125 kB 00:00 2024-03-25T09:06:07.500 INFO:teuthology.orchestra.run.smithi059.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 517 kB/s | 151 kB 00:00 2024-03-25T09:06:07.525 INFO:teuthology.orchestra.run.smithi059.stdout:(20/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 208 kB/s | 43 kB 00:00 2024-03-25T09:06:07.592 INFO:teuthology.orchestra.run.smithi059.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 160 kB/s | 11 kB 00:00 2024-03-25T09:06:07.597 INFO:teuthology.orchestra.run.smithi040.stdout:(1/36): ceph-19.0.0-1997.g47ea673a.el9.x86_64.r 34 kB/s | 6.6 kB 00:00 2024-03-25T09:06:07.617 INFO:teuthology.orchestra.run.smithi059.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 3.0 MB/s | 358 kB 00:00 2024-03-25T09:06:07.654 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 32/34 2024-03-25T09:06:07.668 INFO:teuthology.orchestra.run.smithi059.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2024-03-25T09:06:07.678 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 32/34 2024-03-25T09:06:07.678 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:07.678 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-25T09:06:07.678 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T09:06:07.678 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T09:06:07.678 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:07.680 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-25T09:06:07.693 INFO:teuthology.orchestra.run.smithi059.stdout:(24/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 622 kB/s | 172 kB 00:00 2024-03-25T09:06:07.702 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 6/6 2024-03-25T09:06:07.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 1/6 2024-03-25T09:06:07.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 2/6 2024-03-25T09:06:07.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-25T09:06:07.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-25T09:06:07.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-25T09:06:07.735 INFO:teuthology.orchestra.run.smithi059.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 290 kB/s | 19 kB 00:00 2024-03-25T09:06:07.756 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-25T09:06:07.757 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:06:07.761 INFO:teuthology.orchestra.run.smithi059.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 293 kB/s | 20 kB 00:00 2024-03-25T09:06:07.786 INFO:teuthology.orchestra.run.smithi059.stdout:(27/36): python3-jaraco-collections-3.0.0-8.el9 138 kB/s | 23 kB 00:00 2024-03-25T09:06:07.797 INFO:teuthology.orchestra.run.smithi040.stdout:(2/36): ceph-mds-19.0.0-1997.g47ea673a.el9.x86_ 5.4 MB/s | 2.1 MB 00:00 2024-03-25T09:06:07.811 INFO:teuthology.orchestra.run.smithi059.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 610 kB/s | 46 kB 00:00 2024-03-25T09:06:07.831 INFO:teuthology.orchestra.run.smithi040.stdout:(3/36): ceph-mgr-19.0.0-1997.g47ea673a.el9.x86_ 3.5 MB/s | 1.5 MB 00:00 2024-03-25T09:06:07.836 INFO:teuthology.orchestra.run.smithi059.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-03-25T09:06:07.861 INFO:teuthology.orchestra.run.smithi059.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-25T09:06:07.887 INFO:teuthology.orchestra.run.smithi059.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 218 kB/s | 16 kB 00:00 2024-03-25T09:06:07.904 INFO:teuthology.orchestra.run.smithi059.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-03-25T09:06:07.914 INFO:teuthology.orchestra.run.smithi040.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1997.g47ea 2.9 MB/s | 248 kB 00:00 2024-03-25T09:06:07.937 INFO:teuthology.orchestra.run.smithi059.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2024-03-25T09:06:08.004 INFO:teuthology.orchestra.run.smithi059.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 300 kB/s | 20 kB 00:00 2024-03-25T09:06:08.023 INFO:teuthology.orchestra.run.smithi040.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2024-03-25T09:06:08.029 INFO:teuthology.orchestra.run.smithi059.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-03-25T09:06:08.048 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-25T09:06:08.048 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:08.048 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:06:08.048 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:08.048 INFO:teuthology.orchestra.run.smithi019.stdout: jq-1.6-16.el9.x86_64 2024-03-25T09:06:08.048 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:08.048 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-25T09:06:08.048 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-25T09:06:08.048 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-25T09:06:08.048 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:08.049 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:08.054 INFO:teuthology.orchestra.run.smithi059.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-03-25T09:06:08.057 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:08.057 INFO:teuthology.orchestra.run.smithi059.stdout:Total 10 MB/s | 30 MB 00:02 2024-03-25T09:06:08.065 INFO:teuthology.orchestra.run.smithi040.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-03-25T09:06:08.082 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:06:08.099 INFO:teuthology.orchestra.run.smithi040.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 944 kB/s | 32 kB 00:00 2024-03-25T09:06:08.128 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:06:08.129 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:06:08.132 INFO:teuthology.orchestra.run.smithi040.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-03-25T09:06:08.166 INFO:teuthology.orchestra.run.smithi040.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-03-25T09:06:08.208 INFO:teuthology.orchestra.run.smithi040.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2024-03-25T09:06:08.275 INFO:teuthology.orchestra.run.smithi040.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 17 MB/s | 1.1 MB 00:00 2024-03-25T09:06:08.308 INFO:teuthology.orchestra.run.smithi040.stdout:(12/36): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-03-25T09:06:08.342 INFO:teuthology.orchestra.run.smithi040.stdout:(13/36): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2024-03-25T09:06:08.384 INFO:teuthology.orchestra.run.smithi040.stdout:(14/36): python3-urllib3-1.26.5-5.el9.noarch.rp 4.4 MB/s | 187 kB 00:00 2024-03-25T09:06:08.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph 2024-03-25T09:06:08.526 INFO:teuthology.orchestra.run.smithi040.stdout:(15/36): python3-requests-2.25.1-8.el9.noarch.r 879 kB/s | 125 kB 00:00 2024-03-25T09:06:08.568 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:06:08.568 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:06:08.702 INFO:teuthology.orchestra.run.smithi040.stdout:(16/36): ceph-osd-19.0.0-1997.g47ea673a.el9.x86 19 MB/s | 17 MB 00:00 2024-03-25T09:06:08.785 INFO:teuthology.orchestra.run.smithi040.stdout:(17/36): ceph-mon-19.0.0-1997.g47ea673a.el9.x86 4.0 MB/s | 4.7 MB 00:01 2024-03-25T09:06:08.885 INFO:teuthology.orchestra.run.smithi040.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 62 kB/s | 22 kB 00:00 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 1/34 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2/34 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 3/34 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 4/34 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 5/34 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_6 6/34 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 7/34 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9. 8/34 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x8 9/34 2024-03-25T09:06:08.894 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 10/34 2024-03-25T09:06:08.895 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 11/34 2024-03-25T09:06:08.895 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 12/34 2024-03-25T09:06:08.895 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 13/34 2024-03-25T09:06:08.895 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-03-25T09:06:08.895 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-03-25T09:06:08.895 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-03-25T09:06:08.895 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-03-25T09:06:08.895 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-03-25T09:06:08.895 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 20/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 21/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 22/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 31/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-03-25T09:06:08.896 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 33/34 2024-03-25T09:06:08.927 INFO:teuthology.orchestra.run.smithi040.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 307 kB/s | 43 kB 00:00 2024-03-25T09:06:08.967 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:41 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:08.969 INFO:teuthology.orchestra.run.smithi040.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 565 kB/s | 151 kB 00:00 2024-03-25T09:06:09.020 INFO:teuthology.orchestra.run.smithi040.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-03-25T09:06:09.086 INFO:teuthology.orchestra.run.smithi040.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 265 kB/s | 18 kB 00:00 2024-03-25T09:06:09.121 INFO:teuthology.orchestra.run.smithi040.stdout:(23/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.9 MB/s | 358 kB 00:00 2024-03-25T09:06:09.129 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:06:09.132 INFO:teuthology.orchestra.run.smithi019.stdout:========================================================================================= 2024-03-25T09:06:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-25T09:06:09.132 INFO:teuthology.orchestra.run.smithi019.stdout:========================================================================================= 2024-03-25T09:06:09.132 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:06:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 6.6 k 2024-03-25T09:06:09.132 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-25T09:06:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 2.1 M 2024-03-25T09:06:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 1.5 M 2024-03-25T09:06:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 248 k 2024-03-25T09:06:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 4.7 M 2024-03-25T09:06:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 17 M 2024-03-25T09:06:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-25T09:06:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-25T09:06:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-25T09:06:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-25T09:06:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-25T09:06:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-25T09:06:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-25T09:06:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-25T09:06:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-25T09:06:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-25T09:06:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-25T09:06:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-25T09:06:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-25T09:06:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-25T09:06:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-25T09:06:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-25T09:06:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-25T09:06:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-25T09:06:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-25T09:06:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-25T09:06:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-25T09:06:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-25T09:06:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-25T09:06:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-25T09:06:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-25T09:06:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-25T09:06:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-25T09:06:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-25T09:06:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-25T09:06:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-25T09:06:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:09.137 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:06:09.138 INFO:teuthology.orchestra.run.smithi019.stdout:========================================================================================= 2024-03-25T09:06:09.138 INFO:teuthology.orchestra.run.smithi019.stdout:Install 36 Packages 2024-03-25T09:06:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:09.139 INFO:teuthology.orchestra.run.smithi040.stdout:(24/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 683 kB/s | 172 kB 00:00 2024-03-25T09:06:09.140 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 30 M 2024-03-25T09:06:09.140 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 107 M 2024-03-25T09:06:09.140 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:06:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 345 kB/s | 23 kB 00:00 2024-03-25T09:06:09.171 INFO:teuthology.orchestra.run.smithi040.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 331 kB/s | 19 kB 00:00 2024-03-25T09:06:09.187 INFO:teuthology.orchestra.run.smithi040.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-03-25T09:06:09.204 INFO:teuthology.orchestra.run.smithi040.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-03-25T09:06:09.238 INFO:teuthology.orchestra.run.smithi040.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-03-25T09:06:09.255 INFO:teuthology.orchestra.run.smithi040.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-03-25T09:06:09.298 INFO:teuthology.orchestra.run.smithi040.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-03-25T09:06:09.314 INFO:teuthology.orchestra.run.smithi040.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 609 kB/s | 36 kB 00:00 2024-03-25T09:06:09.340 INFO:teuthology.orchestra.run.smithi040.stdout:(33/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-03-25T09:06:09.373 INFO:teuthology.orchestra.run.smithi040.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-25T09:06:09.398 INFO:teuthology.orchestra.run.smithi040.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 340 kB/s | 20 kB 00:00 2024-03-25T09:06:09.457 INFO:teuthology.orchestra.run.smithi040.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.9 MB/s | 427 kB 00:00 2024-03-25T09:06:09.459 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:09.459 INFO:teuthology.orchestra.run.smithi040.stdout:Total 13 MB/s | 30 MB 00:02 2024-03-25T09:06:09.485 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:06:09.531 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:06:09.531 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:06:09.862 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout: librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-25T09:06:09.863 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.864 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: re2-1:20211101-3.el9.x86_64 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:09.865 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:06:09.937 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:06:09.974 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:06:09.975 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:06:09.990 INFO:teuthology.orchestra.run.smithi019.stdout:(1/36): ceph-19.0.0-1997.g47ea673a.el9.x86_64.r 31 kB/s | 6.6 kB 00:00 2024-03-25T09:06:09.990 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-03-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-03-25T09:06:10.059 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-03-25T09:06:10.099 INFO:teuthology.orchestra.run.smithi019.stdout:(2/36): ceph-mgr-19.0.0-1997.g47ea673a.el9.x86_ 4.6 MB/s | 1.5 MB 00:00 2024-03-25T09:06:10.133 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-03-25T09:06:10.167 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-03-25T09:06:10.200 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-03-25T09:06:10.225 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-test 2024-03-25T09:06:10.296 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-03-25T09:06:10.382 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-03-25T09:06:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-03-25T09:06:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-03-25T09:06:10.549 INFO:teuthology.orchestra.run.smithi019.stdout:(3/36): ceph-mds-19.0.0-1997.g47ea673a.el9.x86_ 2.8 MB/s | 2.1 MB 00:00 2024-03-25T09:06:10.554 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-03-25T09:06:10.591 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-03-25T09:06:10.641 INFO:teuthology.orchestra.run.smithi019.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1997.g47ea 2.6 MB/s | 248 kB 00:00 2024-03-25T09:06:10.680 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-03-25T09:06:10.750 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-03-25T09:06:10.758 INFO:teuthology.orchestra.run.smithi019.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2024-03-25T09:06:10.789 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:29 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:06:10.800 INFO:teuthology.orchestra.run.smithi019.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-03-25T09:06:10.825 INFO:teuthology.orchestra.run.smithi019.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2024-03-25T09:06:10.949 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:06:10.949 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 48 M 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 163 k 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:10.950 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:06:10.951 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:06:10.951 INFO:teuthology.orchestra.run.smithi129.stdout:Install 6 Packages 2024-03-25T09:06:10.951 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-03-25T09:06:10.952 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 48 M 2024-03-25T09:06:10.952 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 205 M 2024-03-25T09:06:10.952 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:06:10.992 INFO:teuthology.orchestra.run.smithi019.stdout:(8/36): ceph-osd-19.0.0-1997.g47ea673a.el9.x86_ 19 MB/s | 17 MB 00:00 2024-03-25T09:06:11.004 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-03-25T09:06:11.009 INFO:teuthology.orchestra.run.smithi019.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 257 kB/s | 47 kB 00:00 2024-03-25T09:06:11.026 INFO:teuthology.orchestra.run.smithi019.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-03-25T09:06:11.042 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-03-25T09:06:11.051 INFO:teuthology.orchestra.run.smithi019.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2024-03-25T09:06:11.077 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-03-25T09:06:11.106 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-03-25T09:06:11.110 INFO:teuthology.orchestra.run.smithi019.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 14 MB/s | 1.1 MB 00:00 2024-03-25T09:06:11.135 INFO:teuthology.orchestra.run.smithi019.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-25T09:06:11.159 INFO:teuthology.orchestra.run.smithi129.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 217 kB 00:00 2024-03-25T09:06:11.160 INFO:teuthology.orchestra.run.smithi019.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-03-25T09:06:11.186 INFO:teuthology.orchestra.run.smithi019.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-03-25T09:06:11.186 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-03-25T09:06:11.217 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-25T09:06:11.250 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-03-25T09:06:11.251 INFO:teuthology.orchestra.run.smithi129.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 300 kB 00:00 2024-03-25T09:06:11.276 INFO:teuthology.orchestra.run.smithi129.stdout:(3/6): libcephsqlite-19.0.0-1997.g47ea673a.el9. 578 kB/s | 163 kB 00:00 2024-03-25T09:06:11.291 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-03-25T09:06:11.293 INFO:teuthology.orchestra.run.smithi129.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-03-25T09:06:11.302 INFO:teuthology.orchestra.run.smithi019.stdout:(16/36): python3-requests-2.25.1-8.el9.noarch.r 881 kB/s | 125 kB 00:00 2024-03-25T09:06:11.320 INFO:teuthology.orchestra.run.smithi019.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-03-25T09:06:11.334 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-03-25T09:06:11.368 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-03-25T09:06:11.455 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:06:11.462 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-03-25T09:06:11.494 INFO:teuthology.orchestra.run.smithi129.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 863 kB/s | 187 kB 00:00 2024-03-25T09:06:11.499 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-03-25T09:06:11.509 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-03-25T09:06:11.542 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-03-25T09:06:11.570 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-03-25T09:06:11.575 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-03-25T09:06:11.636 INFO:teuthology.orchestra.run.smithi019.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 137 kB/s | 43 kB 00:00 2024-03-25T09:06:11.643 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-03-25T09:06:11.686 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-03-25T09:06:11.710 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-03-25T09:06:11.716 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-03-25T09:06:11.729 INFO:teuthology.orchestra.run.smithi019.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-03-25T09:06:11.804 INFO:teuthology.orchestra.run.smithi019.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-03-25T09:06:11.805 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-03-25T09:06:11.849 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-25T09:06:11.879 INFO:teuthology.orchestra.run.smithi019.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.3 MB/s | 358 kB 00:00 2024-03-25T09:06:11.882 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-03-25T09:06:11.896 INFO:teuthology.orchestra.run.smithi019.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 116 kB/s | 11 kB 00:00 2024-03-25T09:06:11.930 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-03-25T09:06:11.963 INFO:teuthology.orchestra.run.smithi019.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 211 kB/s | 18 kB 00:00 2024-03-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi019.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 252 kB/s | 23 kB 00:00 2024-03-25T09:06:12.015 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9. 31/36 2024-03-25T09:06:12.028 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-03-25T09:06:12.045 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 32/36 2024-03-25T09:06:12.047 INFO:teuthology.orchestra.run.smithi019.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 233 kB/s | 19 kB 00:00 2024-03-25T09:06:12.070 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 32/36 2024-03-25T09:06:12.070 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:12.070 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-25T09:06:12.070 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T09:06:12.071 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T09:06:12.071 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:12.072 INFO:teuthology.orchestra.run.smithi019.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 235 kB/s | 20 kB 00:00 2024-03-25T09:06:12.081 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-03-25T09:06:12.127 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-03-25T09:06:12.131 INFO:teuthology.orchestra.run.smithi019.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 556 kB/s | 46 kB 00:00 2024-03-25T09:06:12.164 INFO:teuthology.orchestra.run.smithi019.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 857 kB/s | 79 kB 00:00 2024-03-25T09:06:12.185 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-03-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-03-25T09:06:12.265 INFO:teuthology.orchestra.run.smithi019.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-03-25T09:06:12.290 INFO:teuthology.orchestra.run.smithi019.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 131 kB/s | 16 kB 00:00 2024-03-25T09:06:12.374 INFO:teuthology.orchestra.run.smithi019.stdout:(31/36): ceph-mon-19.0.0-1997.g47ea673a.el9.x86 2.0 MB/s | 4.7 MB 00:02 2024-03-25T09:06:12.399 INFO:teuthology.orchestra.run.smithi019.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 672 kB/s | 90 kB 00:00 2024-03-25T09:06:12.432 INFO:teuthology.orchestra.run.smithi019.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 252 kB/s | 36 kB 00:00 2024-03-25T09:06:12.440 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-03-25T09:06:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-03-25T09:06:12.498 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-03-25T09:06:12.537 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-03-25T09:06:12.572 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-03-25T09:06:12.599 INFO:teuthology.orchestra.run.smithi019.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.5 MB/s | 427 kB 00:00 2024-03-25T09:06:12.601 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-03-25T09:06:12.625 INFO:teuthology.orchestra.run.smithi019.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 104 kB/s | 20 kB 00:00 2024-03-25T09:06:12.630 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:12.630 INFO:teuthology.orchestra.run.smithi019.stdout:Total 8.5 MB/s | 30 MB 00:03 2024-03-25T09:06:12.654 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:06:12.680 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-03-25T09:06:12.701 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:06:12.701 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:06:12.712 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-25T09:06:12.745 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-03-25T09:06:12.786 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-03-25T09:06:12.822 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-03-25T09:06:12.847 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-03-25T09:06:12.941 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-03-25T09:06:12.986 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-03-25T09:06:13.062 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-03-25T09:06:13.140 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:06:13.140 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:06:13.201 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-03-25T09:06:13.325 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-25T09:06:13.494 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9. 31/36 2024-03-25T09:06:13.516 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 32/36 2024-03-25T09:06:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 32/36 2024-03-25T09:06:13.540 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:13.541 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-25T09:06:13.541 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T09:06:13.541 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T09:06:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:13.544 INFO:teuthology.orchestra.run.smithi129.stdout:(6/6): ceph-test-19.0.0-1997.g47ea673a.el9.x86_ 19 MB/s | 48 MB 00:02 2024-03-25T09:06:13.548 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:13.548 INFO:teuthology.orchestra.run.smithi129.stdout:Total 19 MB/s | 48 MB 00:02 2024-03-25T09:06:13.563 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:06:13.584 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:06:13.584 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:06:13.587 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 33/36 2024-03-25T09:06:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 33/36 2024-03-25T09:06:13.614 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:13.614 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-25T09:06:13.614 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T09:06:13.614 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T09:06:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:13.966 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:06:13.967 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:06:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 34/36 2024-03-25T09:06:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 34/36 2024-03-25T09:06:14.112 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:14.112 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-25T09:06:14.112 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T09:06:14.112 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T09:06:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 35/36 2024-03-25T09:06:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 35/36 2024-03-25T09:06:14.354 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:14.354 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-25T09:06:14.354 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T09:06:14.354 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T09:06:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 36/36 2024-03-25T09:06:14.480 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:06:14.536 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-03-25T09:06:14.543 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:06:14.561 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-03-25T09:06:14.580 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-03-25T09:06:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-25T09:06:14.647 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-03-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-25T09:06:14.679 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-03-25T09:06:14.701 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-25T09:06:14.703 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-03-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-25T09:06:14.780 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 5/6 2024-03-25T09:06:14.791 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-03-25T09:06:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-03-25T09:06:14.916 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-03-25T09:06:14.991 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-03-25T09:06:15.042 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-03-25T09:06:15.078 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-03-25T09:06:15.083 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 33/36 2024-03-25T09:06:15.109 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 33/36 2024-03-25T09:06:15.109 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:15.109 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-25T09:06:15.110 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T09:06:15.110 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T09:06:15.110 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:15.136 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-03-25T09:06:15.196 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-03-25T09:06:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-03-25T09:06:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-03-25T09:06:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-03-25T09:06:15.514 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-03-25T09:06:15.544 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-03-25T09:06:15.575 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 34/36 2024-03-25T09:06:15.599 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 34/36 2024-03-25T09:06:15.599 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:15.599 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-25T09:06:15.599 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T09:06:15.599 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T09:06:15.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-03-25T09:06:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-25T09:06:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-03-25T09:06:15.729 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-03-25T09:06:15.772 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-03-25T09:06:15.806 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-03-25T09:06:15.818 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 35/36 2024-03-25T09:06:15.841 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 35/36 2024-03-25T09:06:15.841 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:15.841 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-25T09:06:15.842 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T09:06:15.842 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T09:06:15.842 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:15.893 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-03-25T09:06:15.909 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 36/36 2024-03-25T09:06:15.937 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-03-25T09:06:16.013 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-03-25T09:06:16.147 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 36/36 2024-03-25T09:06:16.147 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 1/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 2/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 3/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 4/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 5/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9. 6/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-03-25T09:06:16.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-03-25T09:06:16.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-03-25T09:06:16.150 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-03-25T09:06:16.150 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-25T09:06:16.150 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-03-25T09:06:16.150 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-03-25T09:06:16.150 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-03-25T09:06:16.150 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-03-25T09:06:16.150 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-03-25T09:06:16.156 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-03-25T09:06:16.290 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-25T09:06:16.453 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9. 31/36 2024-03-25T09:06:16.475 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 32/36 2024-03-25T09:06:16.500 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 32/36 2024-03-25T09:06:16.500 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:16.500 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-25T09:06:16.500 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T09:06:16.501 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T09:06:16.501 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout: lua-5.4.4-4.el9.x86_64 2024-03-25T09:06:17.391 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-25T09:06:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply-3.11-14.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-25T09:06:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-25T09:06:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-25T09:06:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-25T09:06:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:17.394 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:06:17.723 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 36/36 2024-03-25T09:06:17.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 1/36 2024-03-25T09:06:17.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 2/36 2024-03-25T09:06:17.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 3/36 2024-03-25T09:06:17.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 4/36 2024-03-25T09:06:17.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 5/36 2024-03-25T09:06:17.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9. 6/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-03-25T09:06:17.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-25T09:06:17.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-03-25T09:06:17.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-03-25T09:06:17.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-03-25T09:06:17.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-03-25T09:06:17.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-03-25T09:06:17.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-03-25T09:06:17.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-03-25T09:06:17.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-03-25T09:06:17.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-25T09:06:17.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-03-25T09:06:17.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-03-25T09:06:17.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-03-25T09:06:17.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-03-25T09:06:17.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-03-25T09:06:17.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-base 2024-03-25T09:06:18.034 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 33/36 2024-03-25T09:06:18.060 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 33/36 2024-03-25T09:06:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-25T09:06:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T09:06:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T09:06:18.061 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:18.309 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:57 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:06:18.408 INFO:teuthology.orchestra.run.smithi059.stdout:Package ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:06:18.463 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:06:18.464 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-03-25T09:06:18.464 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:06:18.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install cephadm 2024-03-25T09:06:18.527 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 34/36 2024-03-25T09:06:18.549 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 34/36 2024-03-25T09:06:18.549 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:18.549 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-25T09:06:18.549 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T09:06:18.549 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T09:06:18.550 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:18.603 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: lua-5.4.4-4.el9.x86_64 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-25T09:06:18.604 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-25T09:06:18.605 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-25T09:06:18.605 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-25T09:06:18.605 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-25T09:06:18.605 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-25T09:06:18.605 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-25T09:06:18.605 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-25T09:06:18.605 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply-3.11-14.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-25T09:06:18.606 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-25T09:06:18.607 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-25T09:06:18.607 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-25T09:06:18.607 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-25T09:06:18.607 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-25T09:06:18.607 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-25T09:06:18.607 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-25T09:06:18.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:18.607 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:18.769 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 35/36 2024-03-25T09:06:18.792 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 35/36 2024-03-25T09:06:18.792 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:18.792 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-25T09:06:18.792 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T09:06:18.792 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T09:06:18.792 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:18.860 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 36/36 2024-03-25T09:06:18.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-base 2024-03-25T09:06:19.099 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:58 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:06:19.253 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:06:19.253 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:06:19.253 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 748 k 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 748 k 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 755 k 2024-03-25T09:06:19.254 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:06:19.283 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 5/6 2024-03-25T09:06:19.355 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 6/6 2024-03-25T09:06:19.524 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:56 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:19.623 INFO:teuthology.orchestra.run.smithi040.stdout:Package ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:06:19.679 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:19.680 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-03-25T09:06:19.680 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:19.701 INFO:teuthology.orchestra.run.smithi059.stdout:cephadm-19.0.0-1997.g47ea673a.el9.noarch.rpm 1.6 MB/s | 748 kB 00:00 2024-03-25T09:06:19.701 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:19.702 INFO:teuthology.orchestra.run.smithi059.stdout:Total 1.6 MB/s | 748 kB 00:00 2024-03-25T09:06:19.702 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:06:19.707 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:06:19.707 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:06:19.713 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:06:19.714 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:06:19.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install cephadm 2024-03-25T09:06:19.787 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:06:20.260 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:20.315 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:57 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:20.349 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:20.467 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:20.468 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:20.468 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-03-25T09:06:20.468 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:20.468 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:06:20.468 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 748 k 2024-03-25T09:06:20.468 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:20.468 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:06:20.469 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:20.469 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-03-25T09:06:20.469 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:20.469 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 748 k 2024-03-25T09:06:20.469 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 755 k 2024-03-25T09:06:20.469 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:06:20.624 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 36/36 2024-03-25T09:06:20.624 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 1/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 2/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 3/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 4/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 5/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9. 6/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-03-25T09:06:20.625 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-03-25T09:06:20.626 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-03-25T09:06:20.626 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-03-25T09:06:20.626 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-03-25T09:06:20.626 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-03-25T09:06:20.626 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-25T09:06:20.627 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-03-25T09:06:20.628 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-03-25T09:06:20.628 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-03-25T09:06:20.628 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-03-25T09:06:20.628 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-03-25T09:06:20.721 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:20.891 INFO:teuthology.orchestra.run.smithi040.stdout:cephadm-19.0.0-1997.g47ea673a.el9.noarch.rpm 1.7 MB/s | 748 kB 00:00 2024-03-25T09:06:20.892 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:20.892 INFO:teuthology.orchestra.run.smithi040.stdout:Total 1.7 MB/s | 748 kB 00:00 2024-03-25T09:06:20.892 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:06:20.897 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:06:20.897 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:06:20.903 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:06:20.904 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:06:20.964 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:20.964 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:20.964 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:06:20.964 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:20.965 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:20.965 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:06:20.980 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:06:21.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-immutable-object-cache 2024-03-25T09:06:21.392 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:21.483 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:21.605 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-03-25T09:06:21.605 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:21.605 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:06:21.605 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:21.605 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:21.605 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:21.605 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:21.605 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:21.605 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-25T09:06:21.606 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-25T09:06:21.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-25T09:06:21.608 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-25T09:06:21.608 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-25T09:06:21.608 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-25T09:06:21.608 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:21.608 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:21.731 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:01:00 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:06:21.802 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 6/6 2024-03-25T09:06:21.802 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 1/6 2024-03-25T09:06:21.802 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 2/6 2024-03-25T09:06:21.802 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-25T09:06:21.802 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-25T09:06:21.802 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-25T09:06:21.888 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:06:21.889 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:06:21.889 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2024-03-25T09:06:21.889 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:06:21.889 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:06:21.889 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 146 k 2024-03-25T09:06:21.889 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:21.890 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:06:21.890 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:06:21.890 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-03-25T09:06:21.890 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:21.890 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 146 k 2024-03-25T09:06:21.890 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 436 k 2024-03-25T09:06:21.890 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:06:21.908 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:21.973 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-base 2024-03-25T09:06:22.195 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-25T09:06:22.195 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:22.195 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:06:22.195 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:22.195 INFO:teuthology.orchestra.run.smithi129.stdout: jq-1.6-16.el9.x86_64 2024-03-25T09:06:22.195 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:22.195 INFO:teuthology.orchestra.run.smithi129.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-25T09:06:22.195 INFO:teuthology.orchestra.run.smithi129.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-25T09:06:22.196 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-25T09:06:22.196 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:22.196 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:06:22.206 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-immutable-object-cache-19.0.0-1997.g47ea67 460 kB/s | 146 kB 00:00 2024-03-25T09:06:22.207 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:22.207 INFO:teuthology.orchestra.run.smithi059.stdout:Total 458 kB/s | 146 kB 00:00 2024-03-25T09:06:22.207 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:06:22.210 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:22.210 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:22.210 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:06:22.210 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:22.210 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:22.210 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:22.218 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:06:22.218 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:06:22.269 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:06:22.269 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:06:22.412 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:06:22.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-immutable-object-cache 2024-03-25T09:06:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:22.508 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph 2024-03-25T09:06:22.515 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:22.515 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:22.515 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-25T09:06:22.515 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:22.551 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:55 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:22.651 INFO:teuthology.orchestra.run.smithi019.stdout:Package ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:06:22.708 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:06:22.709 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2024-03-25T09:06:22.709 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:22.785 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install cephadm 2024-03-25T09:06:23.007 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:00 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:23.082 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:42 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:06:23.162 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:23.163 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:23.163 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repo Size 2024-03-25T09:06:23.163 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:23.163 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:06:23.163 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 146 k 2024-03-25T09:06:23.163 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:23.164 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:06:23.164 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:23.164 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-03-25T09:06:23.164 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:23.164 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 146 k 2024-03-25T09:06:23.164 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 436 k 2024-03-25T09:06:23.164 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:06:23.251 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:06:23.253 INFO:teuthology.orchestra.run.smithi129.stdout:========================================================================================= 2024-03-25T09:06:23.253 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout:========================================================================================= 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout: ceph x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 6.6 k 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 2.1 M 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 1.5 M 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 248 k 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 4.7 M 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 17 M 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-25T09:06:23.254 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:23.256 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:06:23.257 INFO:teuthology.orchestra.run.smithi129.stdout:========================================================================================= 2024-03-25T09:06:23.257 INFO:teuthology.orchestra.run.smithi129.stdout:Install 36 Packages 2024-03-25T09:06:23.257 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:23.257 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 30 M 2024-03-25T09:06:23.257 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 107 M 2024-03-25T09:06:23.258 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:06:23.353 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:56 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:23.454 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:23.455 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:23.455 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:06:23.455 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:23.455 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:23.455 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:06:23.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-immutable-object-cache-19.0.0-1997.g47ea67 424 kB/s | 146 kB 00:00 2024-03-25T09:06:23.507 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:23.508 INFO:teuthology.orchestra.run.smithi040.stdout:Total 423 kB/s | 146 kB 00:00 2024-03-25T09:06:23.508 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:06:23.508 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:06:23.509 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:06:23.509 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-25T09:06:23.509 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:06:23.509 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:06:23.509 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 748 k 2024-03-25T09:06:23.509 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:23.510 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:06:23.510 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:06:23.510 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2024-03-25T09:06:23.510 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:23.510 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 748 k 2024-03-25T09:06:23.510 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 755 k 2024-03-25T09:06:23.510 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:06:23.516 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:06:23.516 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:06:23.570 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:06:23.570 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:06:23.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr 2024-03-25T09:06:23.713 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:06:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:23.799 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:23.799 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:23.799 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-25T09:06:23.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:23.805 INFO:teuthology.orchestra.run.smithi129.stdout:(1/36): ceph-19.0.0-1997.g47ea673a.el9.x86_64.r 28 kB/s | 6.6 kB 00:00 2024-03-25T09:06:23.947 INFO:teuthology.orchestra.run.smithi129.stdout:(2/36): ceph-mgr-19.0.0-1997.g47ea673a.el9.x86_ 4.0 MB/s | 1.5 MB 00:00 2024-03-25T09:06:23.960 INFO:teuthology.orchestra.run.smithi019.stdout:cephadm-19.0.0-1997.g47ea673a.el9.noarch.rpm 1.6 MB/s | 748 kB 00:00 2024-03-25T09:06:23.960 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:23.961 INFO:teuthology.orchestra.run.smithi019.stdout:Total 1.6 MB/s | 748 kB 00:00 2024-03-25T09:06:23.961 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:06:23.966 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:06:23.966 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:06:23.973 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:06:23.973 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:06:24.014 INFO:teuthology.orchestra.run.smithi129.stdout:(3/36): ceph-mds-19.0.0-1997.g47ea673a.el9.x86_ 4.8 MB/s | 2.1 MB 00:00 2024-03-25T09:06:24.055 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:06:24.072 INFO:teuthology.orchestra.run.smithi129.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1997.g47ea 4.2 MB/s | 248 kB 00:00 2024-03-25T09:06:24.189 INFO:teuthology.orchestra.run.smithi129.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2024-03-25T09:06:24.240 INFO:teuthology.orchestra.run.smithi129.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-25T09:06:24.257 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:01:03 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:06:24.274 INFO:teuthology.orchestra.run.smithi129.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 953 kB/s | 32 kB 00:00 2024-03-25T09:06:24.307 INFO:teuthology.orchestra.run.smithi129.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-03-25T09:06:24.340 INFO:teuthology.orchestra.run.smithi129.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-03-25T09:06:24.356 INFO:teuthology.orchestra.run.smithi059.stdout:Package ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:06:24.399 INFO:teuthology.orchestra.run.smithi129.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-03-25T09:06:24.410 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:06:24.412 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-03-25T09:06:24.412 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:06:24.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-dashboard 2024-03-25T09:06:24.503 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:24.591 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:24.592 INFO:teuthology.orchestra.run.smithi129.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 6.0 MB/s | 1.1 MB 00:00 2024-03-25T09:06:24.659 INFO:teuthology.orchestra.run.smithi129.stdout:(12/36): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-03-25T09:06:24.725 INFO:teuthology.orchestra.run.smithi129.stdout:(13/36): python3-pycparser-2.20-6.el9.noarch.rp 1.8 MB/s | 124 kB 00:00 2024-03-25T09:06:24.742 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:24.742 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:24.742 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:06:24.743 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:24.743 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:24.743 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:24.925 INFO:teuthology.orchestra.run.smithi129.stdout:(14/36): ceph-osd-19.0.0-1997.g47ea673a.el9.x86 17 MB/s | 17 MB 00:00 2024-03-25T09:06:24.951 INFO:teuthology.orchestra.run.smithi129.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 831 kB/s | 187 kB 00:00 2024-03-25T09:06:25.004 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:25.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-mgr 2024-03-25T09:06:25.046 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:01:04 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:06:25.201 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:06:25.202 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2024-03-25T09:06:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 1.8 M 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 34 k 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 16 k 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-25T09:06:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-25T09:06:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-25T09:06:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-25T09:06:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:25.204 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:06:25.204 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2024-03-25T09:06:25.204 INFO:teuthology.orchestra.run.smithi059.stdout:Install 12 Packages 2024-03-25T09:06:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:25.204 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 6.9 M 2024-03-25T09:06:25.205 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 26 M 2024-03-25T09:06:25.205 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:06:25.272 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:25.272 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:25.292 INFO:teuthology.orchestra.run.smithi129.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 65 kB/s | 22 kB 00:00 2024-03-25T09:06:25.334 INFO:teuthology.orchestra.run.smithi129.stdout:(17/36): python3-requests-2.25.1-8.el9.noarch.r 306 kB/s | 125 kB 00:00 2024-03-25T09:06:25.490 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-immutable-object-cache 2024-03-25T09:06:25.590 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:02 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:25.668 INFO:teuthology.orchestra.run.smithi129.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 130 kB/s | 43 kB 00:00 2024-03-25T09:06:25.688 INFO:teuthology.orchestra.run.smithi040.stdout:Package ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:06:25.710 INFO:teuthology.orchestra.run.smithi129.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 362 kB/s | 151 kB 00:00 2024-03-25T09:06:25.743 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:25.744 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-03-25T09:06:25.744 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:25.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-mgr-dashboard 2024-03-25T09:06:25.885 INFO:teuthology.orchestra.run.smithi129.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.0 MB/s | 358 kB 00:00 2024-03-25T09:06:25.913 INFO:teuthology.orchestra.run.smithi129.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 709 kB/s | 172 kB 00:00 2024-03-25T09:06:25.969 INFO:teuthology.orchestra.run.smithi129.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-03-25T09:06:26.005 INFO:teuthology.orchestra.run.smithi129.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 188 kB/s | 18 kB 00:00 2024-03-25T09:06:26.061 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:59 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:26.063 INFO:teuthology.orchestra.run.smithi129.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 246 kB/s | 23 kB 00:00 2024-03-25T09:06:26.097 INFO:teuthology.orchestra.run.smithi129.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 212 kB/s | 19 kB 00:00 2024-03-25T09:06:26.143 INFO:teuthology.orchestra.run.smithi059.stdout:(1/12): ceph-mgr-dashboard-19.0.0-1997.g47ea673 4.5 MB/s | 1.8 MB 00:00 2024-03-25T09:06:26.156 INFO:teuthology.orchestra.run.smithi129.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 214 kB/s | 20 kB 00:00 2024-03-25T09:06:26.168 INFO:teuthology.orchestra.run.smithi059.stdout:(2/12): ceph-grafana-dashboards-19.0.0-1997.g47 80 kB/s | 34 kB 00:00 2024-03-25T09:06:26.189 INFO:teuthology.orchestra.run.smithi129.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 503 kB/s | 46 kB 00:00 2024-03-25T09:06:26.194 INFO:teuthology.orchestra.run.smithi059.stdout:(3/12): ceph-prometheus-alerts-19.0.0-1997.g47e 37 kB/s | 16 kB 00:00 2024-03-25T09:06:26.216 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:06:26.217 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:06:26.217 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repo Size 2024-03-25T09:06:26.217 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:06:26.217 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:06:26.217 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 146 k 2024-03-25T09:06:26.217 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:26.218 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:06:26.218 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:06:26.218 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2024-03-25T09:06:26.218 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:26.218 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 146 k 2024-03-25T09:06:26.218 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 436 k 2024-03-25T09:06:26.218 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:06:26.256 INFO:teuthology.orchestra.run.smithi129.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 787 kB/s | 79 kB 00:00 2024-03-25T09:06:26.336 INFO:teuthology.orchestra.run.smithi059.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 238 kB 00:00 2024-03-25T09:06:26.348 INFO:teuthology.orchestra.run.smithi129.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 179 kB/s | 16 kB 00:00 2024-03-25T09:06:26.378 INFO:teuthology.orchestra.run.smithi059.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-03-25T09:06:26.392 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:03 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:26.423 INFO:teuthology.orchestra.run.smithi129.stdout:(30/36): ceph-mon-19.0.0-1997.g47ea673a.el9.x86 1.8 MB/s | 4.7 MB 00:02 2024-03-25T09:06:26.440 INFO:teuthology.orchestra.run.smithi129.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 978 kB/s | 90 kB 00:00 2024-03-25T09:06:26.449 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-immutable-object-cache-19.0.0-1997.g47ea67 629 kB/s | 146 kB 00:00 2024-03-25T09:06:26.451 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:26.451 INFO:teuthology.orchestra.run.smithi019.stdout:Total 626 kB/s | 146 kB 00:00 2024-03-25T09:06:26.451 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:06:26.459 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:06:26.459 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:06:26.461 INFO:teuthology.orchestra.run.smithi059.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-03-25T09:06:26.466 INFO:teuthology.orchestra.run.smithi129.stdout:(32/36): python3-pecan-1.4.2-3.el9.noarch.rpm 986 kB/s | 272 kB 00:00 2024-03-25T09:06:26.486 INFO:teuthology.orchestra.run.smithi059.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.5 MB/s | 863 kB 00:00 2024-03-25T09:06:26.513 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:06:26.513 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:06:26.541 INFO:teuthology.orchestra.run.smithi129.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-03-25T09:06:26.548 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:26.549 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================== 2024-03-25T09:06:26.549 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-03-25T09:06:26.549 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================== 2024-03-25T09:06:26.550 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:06:26.550 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 1.8 M 2024-03-25T09:06:26.550 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-03-25T09:06:26.550 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-25T09:06:26.550 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 34 k 2024-03-25T09:06:26.550 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 16 k 2024-03-25T09:06:26.550 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-25T09:06:26.550 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-25T09:06:26.550 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-25T09:06:26.550 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-25T09:06:26.551 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-25T09:06:26.551 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-25T09:06:26.551 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-25T09:06:26.551 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-25T09:06:26.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:26.551 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:06:26.551 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================== 2024-03-25T09:06:26.551 INFO:teuthology.orchestra.run.smithi040.stdout:Install 12 Packages 2024-03-25T09:06:26.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:26.552 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 6.9 M 2024-03-25T09:06:26.552 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 26 M 2024-03-25T09:06:26.552 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:06:26.620 INFO:teuthology.orchestra.run.smithi059.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.1 MB/s | 144 kB 00:00 2024-03-25T09:06:26.625 INFO:teuthology.orchestra.run.smithi129.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 239 kB/s | 20 kB 00:00 2024-03-25T09:06:26.645 INFO:teuthology.orchestra.run.smithi059.stdout:(9/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.7 MB/s | 548 kB 00:00 2024-03-25T09:06:26.650 INFO:teuthology.orchestra.run.smithi129.stdout:(35/36): python3-tempora-5.0.0-2.el9.noarch.rpm 158 kB/s | 36 kB 00:00 2024-03-25T09:06:26.654 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:06:26.670 INFO:teuthology.orchestra.run.smithi059.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 610 kB/s | 31 kB 00:00 2024-03-25T09:06:26.717 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:26.720 INFO:teuthology.orchestra.run.smithi059.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 7.9 MB/s | 2.0 MB 00:00 2024-03-25T09:06:26.741 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:26.742 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:26.742 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-25T09:06:26.742 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:26.746 INFO:teuthology.orchestra.run.smithi059.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.8 MB/s | 188 kB 00:00 2024-03-25T09:06:26.749 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:26.749 INFO:teuthology.orchestra.run.smithi059.stdout:Total 4.4 MB/s | 6.9 MB 00:01 2024-03-25T09:06:26.767 INFO:teuthology.orchestra.run.smithi129.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.4 MB/s | 427 kB 00:00 2024-03-25T09:06:26.768 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:06:26.770 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:26.771 INFO:teuthology.orchestra.run.smithi129.stdout:Total 8.5 MB/s | 30 MB 00:03 2024-03-25T09:06:26.785 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:06:26.786 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:06:26.795 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:06:26.837 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:06:26.837 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:06:26.970 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:06:26.971 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:06:27.061 INFO:teuthology.orchestra.run.smithi040.stdout:(1/12): ceph-prometheus-alerts-19.0.0-1997.g47e 64 kB/s | 16 kB 00:00 2024-03-25T09:06:27.078 INFO:teuthology.orchestra.run.smithi040.stdout:(2/12): ceph-grafana-dashboards-19.0.0-1997.g47 125 kB/s | 34 kB 00:00 2024-03-25T09:06:27.178 INFO:teuthology.orchestra.run.smithi040.stdout:(3/12): ceph-mgr-dashboard-19.0.0-1997.g47ea673 4.8 MB/s | 1.8 MB 00:00 2024-03-25T09:06:27.262 INFO:teuthology.orchestra.run.smithi040.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.3 MB/s | 238 kB 00:00 2024-03-25T09:06:27.274 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:06:27.274 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:06:27.295 INFO:teuthology.orchestra.run.smithi040.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-03-25T09:06:27.493 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:06:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.6 MB/s | 863 kB 00:00 2024-03-25T09:06:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-03-25T09:06:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-03-25T09:06:27.663 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-03-25T09:06:27.692 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-03-25T09:06:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 48 kB/s | 19 kB 00:00 2024-03-25T09:06:27.738 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:27.738 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:27.738 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:06:27.738 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:27.738 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:27.738 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:27.803 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-03-25T09:06:27.933 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-03-25T09:06:27.984 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-mgr 2024-03-25T09:06:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 458 kB/s | 144 kB 00:00 2024-03-25T09:06:28.031 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-03-25T09:06:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:(9/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 685 kB/s | 548 kB 00:00 2024-03-25T09:06:28.080 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-03-25T09:06:28.108 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-03-25T09:06:28.132 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9 10/12 2024-03-25T09:06:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 263 kB/s | 31 kB 00:00 2024-03-25T09:06:28.188 INFO:teuthology.orchestra.run.smithi040.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.5 MB/s | 188 kB 00:00 2024-03-25T09:06:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el 11/12 2024-03-25T09:06:28.414 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 12/12 2024-03-25T09:06:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.2 MB/s | 2.0 MB 00:00 2024-03-25T09:06:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:Total 3.6 MB/s | 6.9 MB 00:01 2024-03-25T09:06:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:06:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:06:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:06:28.564 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:01 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:28.625 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:06:28.663 INFO:teuthology.orchestra.run.smithi019.stdout:Package ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:06:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:06:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:06:28.678 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-03-25T09:06:28.710 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-03-25T09:06:28.717 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:06:28.718 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2024-03-25T09:06:28.719 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:28.739 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-03-25T09:06:28.794 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-mgr-dashboard 2024-03-25T09:06:28.808 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-03-25T09:06:28.846 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-03-25T09:06:28.879 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-03-25T09:06:28.970 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-03-25T09:06:29.041 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-03-25T09:06:29.085 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-03-25T09:06:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-03-25T09:06:29.209 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 12/12 2024-03-25T09:06:29.209 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el 1/12 2024-03-25T09:06:29.209 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 2/12 2024-03-25T09:06:29.209 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9 3/12 2024-03-25T09:06:29.209 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-03-25T09:06:29.209 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-03-25T09:06:29.210 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-03-25T09:06:29.210 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-03-25T09:06:29.210 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-03-25T09:06:29.210 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-03-25T09:06:29.210 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-03-25T09:06:29.210 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-03-25T09:06:29.210 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-03-25T09:06:29.246 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-03-25T09:06:29.294 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-03-25T09:06:29.302 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:06:29.359 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-03-25T09:06:29.361 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:02 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:29.381 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-03-25T09:06:29.425 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-03-25T09:06:29.473 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-03-25T09:06:29.510 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-03-25T09:06:29.517 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:06:29.518 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-03-25T09:06:29.518 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-25T09:06:29.518 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-03-25T09:06:29.518 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 1.8 M 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 34 k 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 16 k 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-25T09:06:29.519 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-25T09:06:29.520 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-25T09:06:29.520 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-25T09:06:29.520 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:29.520 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:06:29.520 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-03-25T09:06:29.520 INFO:teuthology.orchestra.run.smithi019.stdout:Install 12 Packages 2024-03-25T09:06:29.520 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:29.521 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 6.9 M 2024-03-25T09:06:29.521 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 26 M 2024-03-25T09:06:29.521 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:06:29.539 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-03-25T09:06:29.564 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-03-25T09:06:29.564 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:29.564 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:06:29.564 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-25T09:06:29.564 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:29.564 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:29.564 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:29.564 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-25T09:06:29.565 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-25T09:06:29.565 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-25T09:06:29.565 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-25T09:06:29.565 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-25T09:06:29.565 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-25T09:06:29.565 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-25T09:06:29.565 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-25T09:06:29.565 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:29.565 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:06:29.592 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-03-25T09:06:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-03-25T09:06:29.638 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-03-25T09:06:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-03-25T09:06:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-03-25T09:06:29.765 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-03-25T09:06:29.779 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-03-25T09:06:29.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-25T09:06:29.814 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-25T09:06:29.847 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-03-25T09:06:29.866 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-03-25T09:06:29.887 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-03-25T09:06:29.911 INFO:teuthology.orchestra.run.smithi019.stdout:(1/12): ceph-grafana-dashboards-19.0.0-1997.g47 135 kB/s | 34 kB 00:00 2024-03-25T09:06:29.915 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-03-25T09:06:29.924 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-03-25T09:06:29.937 INFO:teuthology.orchestra.run.smithi019.stdout:(2/12): ceph-prometheus-alerts-19.0.0-1997.g47e 59 kB/s | 16 kB 00:00 2024-03-25T09:06:29.940 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-03-25T09:06:29.943 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-03-25T09:06:29.976 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9 10/12 2024-03-25T09:06:30.029 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-03-25T09:06:30.063 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-03-25T09:06:30.078 INFO:teuthology.orchestra.run.smithi019.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 238 kB 00:00 2024-03-25T09:06:30.121 INFO:teuthology.orchestra.run.smithi019.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-03-25T09:06:30.135 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-03-25T09:06:30.196 INFO:teuthology.orchestra.run.smithi019.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1997.g47ea673 3.3 MB/s | 1.8 MB 00:00 2024-03-25T09:06:30.235 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el 11/12 2024-03-25T09:06:30.266 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 12/12 2024-03-25T09:06:30.270 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-03-25T09:06:30.377 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:01:09 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:06:30.392 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-25T09:06:30.438 INFO:teuthology.orchestra.run.smithi019.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 89 kB/s | 19 kB 00:00 2024-03-25T09:06:30.463 INFO:teuthology.orchestra.run.smithi019.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.2 MB/s | 863 kB 00:00 2024-03-25T09:06:30.535 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:06:30.535 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================ 2024-03-25T09:06:30.535 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-25T09:06:30.535 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================ 2024-03-25T09:06:30.535 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:06:30.535 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 7.4 M 2024-03-25T09:06:30.535 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-25T09:06:30.537 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-25T09:06:30.537 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:30.537 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:06:30.537 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================ 2024-03-25T09:06:30.537 INFO:teuthology.orchestra.run.smithi059.stdout:Install 12 Packages 2024-03-25T09:06:30.537 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:30.538 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 37 M 2024-03-25T09:06:30.538 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 209 M 2024-03-25T09:06:30.538 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:06:30.546 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9. 31/36 2024-03-25T09:06:30.577 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 32/36 2024-03-25T09:06:30.588 INFO:teuthology.orchestra.run.smithi019.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.1 MB/s | 548 kB 00:00 2024-03-25T09:06:30.602 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 32/36 2024-03-25T09:06:30.602 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:30.602 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-25T09:06:30.602 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T09:06:30.603 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T09:06:30.603 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:30.655 INFO:teuthology.orchestra.run.smithi019.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 468 kB/s | 31 kB 00:00 2024-03-25T09:06:30.731 INFO:teuthology.orchestra.run.smithi019.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-03-25T09:06:30.781 INFO:teuthology.orchestra.run.smithi019.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.9 MB/s | 2.0 MB 00:00 2024-03-25T09:06:30.815 INFO:teuthology.orchestra.run.smithi019.stdout:(12/12): python3-grpcio-tools-1.46.7-10.el9.x86 411 kB/s | 144 kB 00:00 2024-03-25T09:06:30.820 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:30.820 INFO:teuthology.orchestra.run.smithi019.stdout:Total 5.3 MB/s | 6.9 MB 00:01 2024-03-25T09:06:30.838 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:06:30.843 INFO:teuthology.orchestra.run.smithi059.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 213 kB/s | 32 kB 00:00 2024-03-25T09:06:30.857 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:06:30.857 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:06:30.876 INFO:teuthology.orchestra.run.smithi059.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 523 kB/s | 17 kB 00:00 2024-03-25T09:06:30.952 INFO:teuthology.orchestra.run.smithi059.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-03-25T09:06:30.977 INFO:teuthology.orchestra.run.smithi059.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 347 kB/s | 34 kB 00:00 2024-03-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 12/12 2024-03-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el 1/12 2024-03-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 2/12 2024-03-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9 3/12 2024-03-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-03-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-03-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-03-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-03-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-03-25T09:06:31.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-03-25T09:06:31.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-03-25T09:06:31.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-03-25T09:06:31.034 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:06:31.035 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:06:31.152 INFO:teuthology.orchestra.run.smithi059.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2024-03-25T09:06:31.211 INFO:teuthology.orchestra.run.smithi059.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-03-25T09:06:31.236 INFO:teuthology.orchestra.run.smithi059.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.6 MB/s | 217 kB 00:00 2024-03-25T09:06:31.345 INFO:teuthology.orchestra.run.smithi059.stdout:(8/12): ceph-mgr-diskprediction-local-19.0.0-19 11 MB/s | 7.4 MB 00:00 2024-03-25T09:06:31.402 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-25T09:06:31.403 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-25T09:06:31.404 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-25T09:06:31.404 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-25T09:06:31.404 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:06:31.595 INFO:teuthology.orchestra.run.smithi059.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-03-25T09:06:31.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-25T09:06:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-03-25T09:06:31.700 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-03-25T09:06:31.748 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-03-25T09:06:31.777 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-03-25T09:06:31.837 INFO:teuthology.orchestra.run.smithi059.stdout:(10/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.0 MB/s | 245 kB 00:00 2024-03-25T09:06:31.873 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-03-25T09:06:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-03-25T09:06:32.012 INFO:teuthology.orchestra.run.smithi059.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 294 kB/s | 195 kB 00:00 2024-03-25T09:06:32.045 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 33/36 2024-03-25T09:06:32.046 INFO:teuthology.orchestra.run.smithi059.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 995 kB/s | 803 kB 00:00 2024-03-25T09:06:32.048 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:32.048 INFO:teuthology.orchestra.run.smithi059.stdout:Total 25 MB/s | 37 MB 00:01 2024-03-25T09:06:32.071 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 33/36 2024-03-25T09:06:32.071 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:32.071 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-25T09:06:32.071 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T09:06:32.071 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T09:06:32.071 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:32.090 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:06:32.092 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-03-25T09:06:32.115 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:06:32.115 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:06:32.141 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-03-25T09:06:32.169 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-03-25T09:06:32.202 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9 10/12 2024-03-25T09:06:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:09 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================================ 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================================ 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 7.4 M 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-25T09:06:32.374 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================================ 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:Install 12 Packages 2024-03-25T09:06:32.375 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 37 M 2024-03-25T09:06:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 209 M 2024-03-25T09:06:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:06:32.462 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el 11/12 2024-03-25T09:06:32.492 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 12/12 2024-03-25T09:06:32.496 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:06:32.497 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:06:32.528 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 34/36 2024-03-25T09:06:32.552 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 34/36 2024-03-25T09:06:32.552 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:32.552 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-25T09:06:32.552 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T09:06:32.552 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T09:06:32.552 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 219 kB/s | 32 kB 00:00 2024-03-25T09:06:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 535 kB/s | 17 kB 00:00 2024-03-25T09:06:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 841 kB/s | 34 kB 00:00 2024-03-25T09:06:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 35/36 2024-03-25T09:06:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 35/36 2024-03-25T09:06:32.777 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:32.778 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-25T09:06:32.778 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T09:06:32.778 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T09:06:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-03-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 36/36 2024-03-25T09:06:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 22 MB/s | 4.7 MB 00:00 2024-03-25T09:06:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-03-25T09:06:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2024-03-25T09:06:33.226 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:06:33.265 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 12/12 2024-03-25T09:06:33.265 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el 1/12 2024-03-25T09:06:33.265 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 2/12 2024-03-25T09:06:33.265 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9 3/12 2024-03-25T09:06:33.265 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-03-25T09:06:33.266 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-03-25T09:06:33.266 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-03-25T09:06:33.266 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-03-25T09:06:33.266 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-03-25T09:06:33.266 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-03-25T09:06:33.266 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-03-25T09:06:33.266 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-03-25T09:06:33.312 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-25T09:06:33.342 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-25T09:06:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:(8/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2024-03-25T09:06:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-25T09:06:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-25T09:06:33.606 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-03-25T09:06:33.606 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:33.606 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:06:33.606 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:33.607 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:33.663 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-25T09:06:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-25T09:06:33.773 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-25T09:06:33.842 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-25T09:06:33.997 INFO:teuthology.orchestra.run.smithi040.stdout:(9/12): ceph-mgr-diskprediction-local-19.0.0-19 5.0 MB/s | 7.4 MB 00:01 2024-03-25T09:06:34.131 INFO:teuthology.orchestra.run.smithi040.stdout:(10/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-03-25T09:06:34.248 INFO:teuthology.orchestra.run.smithi040.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 217 kB/s | 195 kB 00:00 2024-03-25T09:06:34.416 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:07 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:34.473 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-25T09:06:34.573 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:06:34.575 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2024-03-25T09:06:34.575 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-25T09:06:34.575 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2024-03-25T09:06:34.575 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:06:34.575 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 7.4 M 2024-03-25T09:06:34.575 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-25T09:06:34.576 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-25T09:06:34.576 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-25T09:06:34.576 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-25T09:06:34.576 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-25T09:06:34.576 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-25T09:06:34.576 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-25T09:06:34.576 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-25T09:06:34.577 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-25T09:06:34.577 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-25T09:06:34.577 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-25T09:06:34.577 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-25T09:06:34.577 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:34.577 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:06:34.577 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2024-03-25T09:06:34.577 INFO:teuthology.orchestra.run.smithi019.stdout:Install 12 Packages 2024-03-25T09:06:34.578 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-25T09:06:34.579 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 37 M 2024-03-25T09:06:34.579 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 209 M 2024-03-25T09:06:34.580 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:06:34.691 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 36/36 2024-03-25T09:06:34.691 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 1/36 2024-03-25T09:06:34.691 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 2/36 2024-03-25T09:06:34.691 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 3/36 2024-03-25T09:06:34.691 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 4/36 2024-03-25T09:06:34.691 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 5/36 2024-03-25T09:06:34.692 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9. 6/36 2024-03-25T09:06:34.692 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-03-25T09:06:34.692 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-03-25T09:06:34.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-03-25T09:06:34.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-03-25T09:06:34.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-03-25T09:06:34.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-03-25T09:06:34.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-03-25T09:06:34.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-03-25T09:06:34.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-03-25T09:06:34.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-03-25T09:06:34.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-03-25T09:06:34.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-03-25T09:06:34.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-03-25T09:06:34.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-03-25T09:06:34.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-25T09:06:34.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-03-25T09:06:34.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-03-25T09:06:34.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-03-25T09:06:34.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-03-25T09:06:34.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-03-25T09:06:34.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-03-25T09:06:34.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-03-25T09:06:34.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-03-25T09:06:34.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-25T09:06:34.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-03-25T09:06:34.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-03-25T09:06:34.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-03-25T09:06:34.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-03-25T09:06:34.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-03-25T09:06:34.829 INFO:teuthology.orchestra.run.smithi019.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 218 kB/s | 32 kB 00:00 2024-03-25T09:06:34.863 INFO:teuthology.orchestra.run.smithi019.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 553 kB/s | 17 kB 00:00 2024-03-25T09:06:34.913 INFO:teuthology.orchestra.run.smithi019.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-03-25T09:06:34.930 INFO:teuthology.orchestra.run.smithi019.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 519 kB/s | 34 kB 00:00 2024-03-25T09:06:35.122 INFO:teuthology.orchestra.run.smithi019.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 23 MB/s | 4.7 MB 00:00 2024-03-25T09:06:35.189 INFO:teuthology.orchestra.run.smithi019.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 4.8 MB 00:00 2024-03-25T09:06:35.214 INFO:teuthology.orchestra.run.smithi019.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.3 MB/s | 217 kB 00:00 2024-03-25T09:06:35.515 INFO:teuthology.orchestra.run.smithi019.stdout:(8/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout: lua-5.4.4-4.el9.x86_64 2024-03-25T09:06:35.772 INFO:teuthology.orchestra.run.smithi129.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-25T09:06:35.773 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply-3.11-14.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-25T09:06:35.774 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:35.775 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:06:35.906 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-25T09:06:35.974 INFO:teuthology.orchestra.run.smithi019.stdout:(9/12): ceph-mgr-diskprediction-local-19.0.0-19 5.7 MB/s | 7.4 MB 00:01 2024-03-25T09:06:36.108 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-base 2024-03-25T09:06:36.190 INFO:teuthology.orchestra.run.smithi019.stdout:(10/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-03-25T09:06:36.440 INFO:teuthology.orchestra.run.smithi019.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 211 kB/s | 195 kB 00:00 2024-03-25T09:06:36.598 INFO:teuthology.orchestra.run.smithi040.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 226 kB/s | 803 kB 00:03 2024-03-25T09:06:36.600 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:36.600 INFO:teuthology.orchestra.run.smithi040.stdout:Total 8.8 MB/s | 37 MB 00:04 2024-03-25T09:06:36.644 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:06:36.670 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:06:36.670 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:06:36.693 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:55 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:06:36.789 INFO:teuthology.orchestra.run.smithi129.stdout:Package ceph-base-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:06:36.840 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:06:36.841 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-25T09:06:36.841 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:06:36.901 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install cephadm 2024-03-25T09:06:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-25T09:06:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 12/12 2024-03-25T09:06:37.048 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:06:37.048 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:06:37.464 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:56 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:06:37.613 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:06:37.614 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:06:37.614 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:06:37.614 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:06:37.614 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:06:37.614 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 748 k 2024-03-25T09:06:37.615 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:37.615 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:06:37.615 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:06:37.615 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-25T09:06:37.615 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:37.615 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 748 k 2024-03-25T09:06:37.615 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 755 k 2024-03-25T09:06:37.615 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:06:37.783 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:06:37.854 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-25T09:06:37.885 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-25T09:06:37.902 INFO:teuthology.orchestra.run.smithi129.stdout:cephadm-19.0.0-1997.g47ea673a.el9.noarch.rpm 2.5 MB/s | 748 kB 00:00 2024-03-25T09:06:37.903 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:37.903 INFO:teuthology.orchestra.run.smithi129.stdout:Total 2.5 MB/s | 748 kB 00:00 2024-03-25T09:06:37.903 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:06:37.909 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:06:37.909 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:06:37.913 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:06:37.914 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:06:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-25T09:06:37.988 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:06:38.022 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-25T09:06:38.208 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-25T09:06:38.238 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-25T09:06:38.307 INFO:teuthology.orchestra.run.smithi019.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 260 kB/s | 803 kB 00:03 2024-03-25T09:06:38.311 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:38.311 INFO:teuthology.orchestra.run.smithi019.stdout:Total 9.9 MB/s | 37 MB 00:03 2024-03-25T09:06:38.317 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-25T09:06:38.354 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:06:38.381 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:06:38.381 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:06:38.427 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:38.525 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:38.763 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:06:38.763 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:06:38.926 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:39.004 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-25T09:06:39.112 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-25T09:06:39.218 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/1 2024-03-25T09:06:39.218 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:39.218 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:06:39.218 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:39.218 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:39.218 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:06:39.409 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-immutable-object-cache 2024-03-25T09:06:39.493 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:06:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 12/12 2024-03-25T09:06:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 1/12 2024-03-25T09:06:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-25T09:06:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-25T09:06:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-25T09:06:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-25T09:06:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-25T09:06:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-25T09:06:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-25T09:06:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-25T09:06:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-25T09:06:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-25T09:06:39.556 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-25T09:06:39.595 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-25T09:06:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-25T09:06:39.748 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-25T09:06:39.934 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-25T09:06:39.955 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-25T09:06:39.956 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-25T09:06:39.956 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-25T09:06:39.956 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-25T09:06:39.956 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-25T09:06:39.956 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:39.956 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:06:39.964 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-25T09:06:39.982 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:58 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:06:40.043 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-25T09:06:40.133 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:06:40.196 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:06:40.196 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 146 k 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 146 k 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 436 k 2024-03-25T09:06:40.197 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:06:40.359 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-immutable-object-cache-19.0.0-1997.g47ea67 650 kB/s | 146 kB 00:00 2024-03-25T09:06:40.360 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:40.360 INFO:teuthology.orchestra.run.smithi129.stdout:Total 647 kB/s | 146 kB 00:00 2024-03-25T09:06:40.360 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:06:40.368 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:06:40.369 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:06:40.419 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:06:40.420 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:06:40.423 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-25T09:06:40.474 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-rook 2024-03-25T09:06:40.562 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:06:40.635 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:40.660 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:40.660 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:40.660 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-25T09:06:40.660 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:40.731 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-25T09:06:40.839 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-25T09:06:41.054 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:01:20 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:06:41.211 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:06:41.212 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================== 2024-03-25T09:06:41.212 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-25T09:06:41.212 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================== 2024-03-25T09:06:41.212 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:06:41.212 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 49 k 2024-03-25T09:06:41.212 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-25T09:06:41.212 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-25T09:06:41.212 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================== 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout:Install 13 Packages 2024-03-25T09:06:41.213 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:06:41.214 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 2.0 M 2024-03-25T09:06:41.214 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 26 M 2024-03-25T09:06:41.214 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:06:41.417 INFO:teuthology.orchestra.run.smithi059.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 198 kB/s | 24 kB 00:00 2024-03-25T09:06:41.442 INFO:teuthology.orchestra.run.smithi059.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 122 kB/s | 18 kB 00:00 2024-03-25T09:06:41.484 INFO:teuthology.orchestra.run.smithi059.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2024-03-25T09:06:41.488 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-25T09:06:41.509 INFO:teuthology.orchestra.run.smithi059.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-03-25T09:06:41.520 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 12/12 2024-03-25T09:06:41.534 INFO:teuthology.orchestra.run.smithi059.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-03-25T09:06:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 856 kB/s | 43 kB 00:00 2024-03-25T09:06:41.601 INFO:teuthology.orchestra.run.smithi059.stdout:(7/13): ceph-mgr-rook-19.0.0-1997.g47ea673a.el9 160 kB/s | 49 kB 00:00 2024-03-25T09:06:41.650 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a. 1/1 2024-03-25T09:06:41.650 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:41.650 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:06:41.650 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:06:41.650 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:41.650 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:06:41.710 INFO:teuthology.orchestra.run.smithi059.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 100 kB/s | 15 kB 00:00 2024-03-25T09:06:41.916 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr 2024-03-25T09:06:41.944 INFO:teuthology.orchestra.run.smithi059.stdout:(9/13): python3-kubernetes-26.1.0-2.el9.noarch. 4.4 MB/s | 1.0 MB 00:00 2024-03-25T09:06:42.019 INFO:teuthology.orchestra.run.smithi059.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 790 kB/s | 59 kB 00:00 2024-03-25T09:06:42.094 INFO:teuthology.orchestra.run.smithi059.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-03-25T09:06:42.148 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-25T09:06:42.497 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:01 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:06:42.597 INFO:teuthology.orchestra.run.smithi129.stdout:Package ceph-mgr-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:06:42.649 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:06:42.650 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-25T09:06:42.650 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:06:42.718 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-dashboard 2024-03-25T09:06:43.239 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-25T09:06:43.263 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 12/12 2024-03-25T09:06:43.277 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:02 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:06:43.426 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:06:43.427 INFO:teuthology.orchestra.run.smithi129.stdout:====================================================================================== 2024-03-25T09:06:43.427 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:06:43.427 INFO:teuthology.orchestra.run.smithi129.stdout:====================================================================================== 2024-03-25T09:06:43.427 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:06:43.427 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 1.8 M 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 34 k 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 16 k 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:06:43.428 INFO:teuthology.orchestra.run.smithi129.stdout:====================================================================================== 2024-03-25T09:06:43.429 INFO:teuthology.orchestra.run.smithi129.stdout:Install 12 Packages 2024-03-25T09:06:43.429 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:43.429 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 6.9 M 2024-03-25T09:06:43.429 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 26 M 2024-03-25T09:06:43.429 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:06:43.706 INFO:teuthology.orchestra.run.smithi129.stdout:(1/12): ceph-prometheus-alerts-19.0.0-1997.g47e 86 kB/s | 16 kB 00:00 2024-03-25T09:06:43.764 INFO:teuthology.orchestra.run.smithi129.stdout:(2/12): ceph-grafana-dashboards-19.0.0-1997.g47 136 kB/s | 34 kB 00:00 2024-03-25T09:06:43.856 INFO:teuthology.orchestra.run.smithi129.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.6 MB/s | 238 kB 00:00 2024-03-25T09:06:43.890 INFO:teuthology.orchestra.run.smithi129.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-03-25T09:06:44.040 INFO:teuthology.orchestra.run.smithi129.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1997.g47ea673 3.4 MB/s | 1.8 MB 00:00 2024-03-25T09:06:44.115 INFO:teuthology.orchestra.run.smithi129.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.4 MB/s | 548 kB 00:00 2024-03-25T09:06:44.141 INFO:teuthology.orchestra.run.smithi129.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.0 MB/s | 863 kB 00:00 2024-03-25T09:06:44.158 INFO:teuthology.orchestra.run.smithi129.stdout:(8/12): grpc-data-1.46.7-10.el9.noarch.rpm 166 kB/s | 19 kB 00:00 2024-03-25T09:06:44.253 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 12/12 2024-03-25T09:06:44.253 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 1/12 2024-03-25T09:06:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-25T09:06:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-25T09:06:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-25T09:06:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-25T09:06:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-25T09:06:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-25T09:06:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-25T09:06:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-25T09:06:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-25T09:06:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-25T09:06:44.266 INFO:teuthology.orchestra.run.smithi129.stdout:(9/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-03-25T09:06:44.292 INFO:teuthology.orchestra.run.smithi129.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 230 kB/s | 31 kB 00:00 2024-03-25T09:06:44.317 INFO:teuthology.orchestra.run.smithi129.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 909 kB/s | 144 kB 00:00 2024-03-25T09:06:44.342 INFO:teuthology.orchestra.run.smithi129.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-03-25T09:06:44.345 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:44.345 INFO:teuthology.orchestra.run.smithi129.stdout:Total 7.5 MB/s | 6.9 MB 00:00 2024-03-25T09:06:44.362 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:06:44.378 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:06:44.378 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:06:44.535 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:06:44.535 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:06:44.671 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-25T09:06:44.671 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:44.671 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:06:44.671 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:44.671 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-25T09:06:44.671 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:44.672 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:06:45.058 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-mgr-rook 2024-03-25T09:06:45.142 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-03-25T09:06:45.186 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-03-25T09:06:45.234 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-03-25T09:06:45.272 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-03-25T09:06:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-03-25T09:06:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-03-25T09:06:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-03-25T09:06:45.630 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:22 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:45.651 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-03-25T09:06:45.680 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-03-25T09:06:45.713 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9 10/12 2024-03-25T09:06:45.787 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:45.788 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================== 2024-03-25T09:06:45.788 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-03-25T09:06:45.788 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================== 2024-03-25T09:06:45.788 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:06:45.788 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 49 k 2024-03-25T09:06:45.788 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:45.789 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:06:45.790 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================== 2024-03-25T09:06:45.790 INFO:teuthology.orchestra.run.smithi040.stdout:Install 13 Packages 2024-03-25T09:06:45.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:45.790 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 2.0 M 2024-03-25T09:06:45.790 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 26 M 2024-03-25T09:06:45.791 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:06:45.876 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 12/12 2024-03-25T09:06:45.876 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 1/12 2024-03-25T09:06:45.876 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-25T09:06:45.876 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-25T09:06:45.876 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-25T09:06:45.876 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-25T09:06:45.876 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-25T09:06:45.876 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-25T09:06:45.876 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-25T09:06:45.877 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-25T09:06:45.877 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-25T09:06:45.877 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-25T09:06:45.958 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el 11/12 2024-03-25T09:06:45.987 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 12/12 2024-03-25T09:06:46.280 INFO:teuthology.orchestra.run.smithi040.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 191 kB/s | 24 kB 00:00 2024-03-25T09:06:46.297 INFO:teuthology.orchestra.run.smithi040.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 125 kB/s | 18 kB 00:00 2024-03-25T09:06:46.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-25T09:06:46.341 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:46.341 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-25T09:06:46.342 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:46.343 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:46.347 INFO:teuthology.orchestra.run.smithi040.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2024-03-25T09:06:46.364 INFO:teuthology.orchestra.run.smithi040.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-03-25T09:06:46.389 INFO:teuthology.orchestra.run.smithi040.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.9 MB/s | 211 kB 00:00 2024-03-25T09:06:46.414 INFO:teuthology.orchestra.run.smithi040.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 858 kB/s | 43 kB 00:00 2024-03-25T09:06:46.440 INFO:teuthology.orchestra.run.smithi040.stdout:(7/13): ceph-mgr-rook-19.0.0-1997.g47ea673a.el9 171 kB/s | 49 kB 00:00 2024-03-25T09:06:46.657 INFO:teuthology.orchestra.run.smithi040.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 120 kB/s | 32 kB 00:00 2024-03-25T09:06:46.682 INFO:teuthology.orchestra.run.smithi040.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 56 kB/s | 15 kB 00:00 2024-03-25T09:06:46.702 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-mgr-rook 2024-03-25T09:06:46.774 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 12/12 2024-03-25T09:06:46.774 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el 1/12 2024-03-25T09:06:46.774 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noa 2/12 2024-03-25T09:06:46.774 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9 3/12 2024-03-25T09:06:46.775 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-03-25T09:06:46.775 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-03-25T09:06:46.775 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-03-25T09:06:46.775 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-03-25T09:06:46.775 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-03-25T09:06:46.775 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-03-25T09:06:46.775 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-03-25T09:06:46.775 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-03-25T09:06:46.874 INFO:teuthology.orchestra.run.smithi040.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 467 kB/s | 203 kB 00:00 2024-03-25T09:06:46.949 INFO:teuthology.orchestra.run.smithi040.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 221 kB/s | 59 kB 00:00 2024-03-25T09:06:47.083 INFO:teuthology.orchestra.run.smithi040.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 2.4 MB/s | 1.0 MB 00:00 2024-03-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi040.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 384 kB/s | 90 kB 00:00 2024-03-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi040.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2024-03-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:06:47.124 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-03-25T09:06:47.124 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:47.124 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:47.125 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:06:47.129 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:06:47.129 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:06:47.230 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:06:47.231 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:06:47.277 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:20 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:47.395 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-25T09:06:47.435 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2024-03-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2024-03-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 49 k 2024-03-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:47.437 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:06:47.438 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2024-03-25T09:06:47.438 INFO:teuthology.orchestra.run.smithi019.stdout:Install 13 Packages 2024-03-25T09:06:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:47.438 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 2.0 M 2024-03-25T09:06:47.438 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 26 M 2024-03-25T09:06:47.438 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:06:47.717 INFO:teuthology.orchestra.run.smithi019.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 196 kB/s | 24 kB 00:00 2024-03-25T09:06:47.742 INFO:teuthology.orchestra.run.smithi019.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 121 kB/s | 18 kB 00:00 2024-03-25T09:06:47.776 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:06:47.792 INFO:teuthology.orchestra.run.smithi019.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-03-25T09:06:47.818 INFO:teuthology.orchestra.run.smithi019.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-25T09:06:47.843 INFO:teuthology.orchestra.run.smithi019.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-03-25T09:06:47.868 INFO:teuthology.orchestra.run.smithi019.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 855 kB/s | 43 kB 00:00 2024-03-25T09:06:47.894 INFO:teuthology.orchestra.run.smithi019.stdout:(7/13): ceph-mgr-rook-19.0.0-1997.g47ea673a.el9 164 kB/s | 49 kB 00:00 2024-03-25T09:06:47.952 INFO:teuthology.orchestra.run.smithi019.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 179 kB/s | 15 kB 00:00 2024-03-25T09:06:47.954 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:06 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:06:47.954 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-25T09:06:47.977 INFO:teuthology.orchestra.run.smithi019.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 240 kB/s | 32 kB 00:00 2024-03-25T09:06:48.010 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-25T09:06:48.044 INFO:teuthology.orchestra.run.smithi019.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 1.3 MB/s | 203 kB 00:00 2024-03-25T09:06:48.070 INFO:teuthology.orchestra.run.smithi019.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 643 kB/s | 59 kB 00:00 2024-03-25T09:06:48.074 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-25T09:06:48.103 INFO:teuthology.orchestra.run.smithi019.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-03-25T09:06:48.104 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================================ 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================================ 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 7.4 M 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-25T09:06:48.106 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================================ 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout:Install 12 Packages 2024-03-25T09:06:48.107 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:48.108 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 37 M 2024-03-25T09:06:48.108 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 209 M 2024-03-25T09:06:48.108 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:06:48.136 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-25T09:06:48.177 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-25T09:06:48.178 INFO:teuthology.orchestra.run.smithi019.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.5 MB/s | 1.0 MB 00:00 2024-03-25T09:06:48.180 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:48.181 INFO:teuthology.orchestra.run.smithi019.stdout:Total 2.8 MB/s | 2.0 MB 00:00 2024-03-25T09:06:48.181 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:06:48.196 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:06:48.196 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:06:48.275 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-25T09:06:48.293 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:06:48.293 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:06:48.383 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-25T09:06:48.417 INFO:teuthology.orchestra.run.smithi129.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 220 kB/s | 32 kB 00:00 2024-03-25T09:06:48.442 INFO:teuthology.orchestra.run.smithi129.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 718 kB/s | 17 kB 00:00 2024-03-25T09:06:48.445 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-25T09:06:48.476 INFO:teuthology.orchestra.run.smithi129.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-03-25T09:06:48.534 INFO:teuthology.orchestra.run.smithi129.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-03-25T09:06:48.710 INFO:teuthology.orchestra.run.smithi129.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-03-25T09:06:48.777 INFO:teuthology.orchestra.run.smithi129.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-03-25T09:06:48.802 INFO:teuthology.orchestra.run.smithi129.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-03-25T09:06:48.821 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:06:48.969 INFO:teuthology.orchestra.run.smithi129.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.8 MB/s | 803 kB 00:00 2024-03-25T09:06:48.985 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-25T09:06:49.039 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-25T09:06:49.095 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-25T09:06:49.128 INFO:teuthology.orchestra.run.smithi129.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-03-25T09:06:49.131 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-25T09:06:49.153 INFO:teuthology.orchestra.run.smithi129.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-03-25T09:06:49.173 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-25T09:06:49.212 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-25T09:06:49.236 INFO:teuthology.orchestra.run.smithi129.stdout:(11/12): ceph-mgr-diskprediction-local-19.0.0-1 7.7 MB/s | 7.4 MB 00:00 2024-03-25T09:06:49.270 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-25T09:06:49.276 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-25T09:06:49.318 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-25T09:06:49.320 INFO:teuthology.orchestra.run.smithi129.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-03-25T09:06:49.322 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:49.323 INFO:teuthology.orchestra.run.smithi129.stdout:Total 30 MB/s | 37 MB 00:01 2024-03-25T09:06:49.364 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:06:49.366 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-25T09:06:49.379 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:06:49.395 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 13/13 2024-03-25T09:06:49.440 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-25T09:06:49.751 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:06:49.751 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:06:50.182 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 13/13 2024-03-25T09:06:50.182 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 1/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-25T09:06:50.183 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-25T09:06:50.210 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-25T09:06:50.254 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-25T09:06:50.287 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-25T09:06:50.337 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-25T09:06:50.365 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 13/13 2024-03-25T09:06:50.449 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:06:50.526 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-25T09:06:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-25T09:06:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:50.541 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:06:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-25T09:06:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-25T09:06:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-25T09:06:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-25T09:06:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-25T09:06:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-25T09:06:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-25T09:06:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-25T09:06:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-25T09:06:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-25T09:06:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-25T09:06:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-25T09:06:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:50.542 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:50.558 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-25T09:06:50.651 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-25T09:06:50.686 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-25T09:06:50.780 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-mgr-cephadm 2024-03-25T09:06:50.864 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-25T09:06:50.893 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-25T09:06:50.970 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-25T09:06:51.131 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 13/13 2024-03-25T09:06:51.131 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 1/13 2024-03-25T09:06:51.131 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-25T09:06:51.131 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-25T09:06:51.131 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-25T09:06:51.131 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-25T09:06:51.131 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-25T09:06:51.131 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-25T09:06:51.131 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-25T09:06:51.132 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-25T09:06:51.132 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-25T09:06:51.132 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-25T09:06:51.132 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-25T09:06:51.355 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:28 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:51.497 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-25T09:06:51.497 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:51.497 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:06:51.497 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:51.497 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-25T09:06:51.498 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:51.499 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:51.514 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:51.514 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================== 2024-03-25T09:06:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-03-25T09:06:51.514 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================== 2024-03-25T09:06:51.514 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:06:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 139 k 2024-03-25T09:06:51.514 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-03-25T09:06:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-25T09:06:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================== 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout:Install 6 Packages 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 6.8 M 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 33 M 2024-03-25T09:06:51.515 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:06:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-25T09:06:51.774 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-25T09:06:51.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-mgr-cephadm 2024-03-25T09:06:51.818 INFO:teuthology.orchestra.run.smithi040.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-03-25T09:06:51.918 INFO:teuthology.orchestra.run.smithi040.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-03-25T09:06:51.952 INFO:teuthology.orchestra.run.smithi040.stdout:(3/6): ceph-mgr-cephadm-19.0.0-1997.g47ea673a.e 434 kB/s | 139 kB 00:00 2024-03-25T09:06:52.358 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:25 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:52.502 INFO:teuthology.orchestra.run.smithi040.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 99 kB/s | 58 kB 00:00 2024-03-25T09:06:52.513 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:06:52.514 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2024-03-25T09:06:52.514 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-25T09:06:52.514 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2024-03-25T09:06:52.515 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:06:52.515 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 139 k 2024-03-25T09:06:52.515 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-25T09:06:52.515 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-25T09:06:52.515 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-25T09:06:52.515 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-25T09:06:52.515 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-25T09:06:52.515 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-25T09:06:52.515 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:52.515 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:06:52.516 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2024-03-25T09:06:52.516 INFO:teuthology.orchestra.run.smithi019.stdout:Install 6 Packages 2024-03-25T09:06:52.516 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:52.516 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 6.8 M 2024-03-25T09:06:52.517 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 33 M 2024-03-25T09:06:52.517 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:06:52.519 INFO:teuthology.orchestra.run.smithi040.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 90 kB/s | 51 kB 00:00 2024-03-25T09:06:52.694 INFO:teuthology.orchestra.run.smithi040.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 627 kB/s | 548 kB 00:00 2024-03-25T09:06:52.696 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:52.697 INFO:teuthology.orchestra.run.smithi040.stdout:Total 5.7 MB/s | 6.8 MB 00:01 2024-03-25T09:06:52.710 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:06:52.721 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:06:52.722 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:06:52.815 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:06:52.815 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:06:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-25T09:06:53.114 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:06:53.213 INFO:teuthology.orchestra.run.smithi019.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2024-03-25T09:06:53.238 INFO:teuthology.orchestra.run.smithi019.stdout:(2/6): ceph-mgr-cephadm-19.0.0-1997.g47ea673a.e 472 kB/s | 139 kB 00:00 2024-03-25T09:06:53.264 INFO:teuthology.orchestra.run.smithi019.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 776 kB/s | 248 kB 00:00 2024-03-25T09:06:53.298 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-25T09:06:53.348 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-25T09:06:53.581 INFO:teuthology.orchestra.run.smithi019.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 169 kB/s | 58 kB 00:00 2024-03-25T09:06:53.606 INFO:teuthology.orchestra.run.smithi019.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 149 kB/s | 51 kB 00:00 2024-03-25T09:06:53.781 INFO:teuthology.orchestra.run.smithi019.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 966 kB/s | 548 kB 00:00 2024-03-25T09:06:53.782 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:53.783 INFO:teuthology.orchestra.run.smithi019.stdout:Total 5.4 MB/s | 6.8 MB 00:01 2024-03-25T09:06:53.797 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:06:53.809 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:06:53.809 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:06:53.904 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:06:53.904 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:06:53.924 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-25T09:06:54.011 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-25T09:06:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-25T09:06:54.069 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 12/12 2024-03-25T09:06:54.080 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-25T09:06:54.108 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 6/6 2024-03-25T09:06:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:06:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-25T09:06:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-25T09:06:54.932 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 6/6 2024-03-25T09:06:54.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/6 2024-03-25T09:06:54.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-25T09:06:54.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-25T09:06:54.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-25T09:06:54.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-25T09:06:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-25T09:06:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-25T09:06:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-25T09:06:55.222 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-25T09:06:55.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:55.222 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:06:55.222 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:55.222 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-25T09:06:55.222 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-25T09:06:55.222 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-25T09:06:55.222 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-25T09:06:55.222 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-25T09:06:55.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:55.223 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 6/6 2024-03-25T09:06:55.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-fuse 2024-03-25T09:06:55.999 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 6/6 2024-03-25T09:06:55.999 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/6 2024-03-25T09:06:55.999 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-25T09:06:55.999 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-25T09:06:55.999 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-25T09:06:55.999 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-25T09:06:56.064 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:33 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:56.221 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 888 k 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout:Install 2 Packages 2024-03-25T09:06:56.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:56.223 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 966 k 2024-03-25T09:06:56.223 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 2.8 M 2024-03-25T09:06:56.223 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:06:56.292 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-25T09:06:56.292 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:56.292 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:06:56.292 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:56.293 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-25T09:06:56.293 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-25T09:06:56.293 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-25T09:06:56.293 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-25T09:06:56.293 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-25T09:06:56.293 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:56.293 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:56.446 INFO:teuthology.orchestra.run.smithi040.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 353 kB/s | 79 kB 00:00 2024-03-25T09:06:56.529 INFO:teuthology.orchestra.run.smithi040.stdout:(2/2): ceph-fuse-19.0.0-1997.g47ea673a.el9.x86_ 2.8 MB/s | 888 kB 00:00 2024-03-25T09:06:56.531 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:56.531 INFO:teuthology.orchestra.run.smithi040.stdout:Total 3.1 MB/s | 966 kB 00:00 2024-03-25T09:06:56.531 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 12/12 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea6 1/12 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-25T09:06:56.538 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-25T09:06:56.538 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-fuse 2024-03-25T09:06:56.553 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:06:56.553 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:06:56.629 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:06:56.630 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:06:56.819 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:06:56.960 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-25T09:06:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-25T09:06:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:57.002 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:06:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:57.003 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:06:57.042 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2/2 2024-03-25T09:06:57.116 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:30 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:57.272 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:06:57.272 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:06:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-25T09:06:57.273 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:06:57.273 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:06:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 888 k 2024-03-25T09:06:57.273 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-25T09:06:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-25T09:06:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:57.273 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:06:57.273 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:06:57.273 INFO:teuthology.orchestra.run.smithi019.stdout:Install 2 Packages 2024-03-25T09:06:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:57.274 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 966 k 2024-03-25T09:06:57.274 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 2.8 M 2024-03-25T09:06:57.274 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:06:57.378 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-rook 2024-03-25T09:06:57.391 INFO:teuthology.orchestra.run.smithi019.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 671 kB/s | 79 kB 00:00 2024-03-25T09:06:57.583 INFO:teuthology.orchestra.run.smithi019.stdout:(2/2): ceph-fuse-19.0.0-1997.g47ea673a.el9.x86_ 2.8 MB/s | 888 kB 00:00 2024-03-25T09:06:57.584 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:57.585 INFO:teuthology.orchestra.run.smithi019.stdout:Total 3.0 MB/s | 966 kB 00:00 2024-03-25T09:06:57.585 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:06:57.607 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:06:57.607 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:06:57.685 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:06:57.686 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:06:57.762 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2/2 2024-03-25T09:06:57.762 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/2 2024-03-25T09:06:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:06:57.950 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:16 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:06:58.022 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-25T09:06:58.038 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-25T09:06:58.038 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:58.039 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:06:58.039 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-25T09:06:58.039 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:58.039 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:06:58.094 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2/2 2024-03-25T09:06:58.101 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:06:58.102 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================== 2024-03-25T09:06:58.102 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:06:58.102 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================== 2024-03-25T09:06:58.102 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:06:58.102 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 49 k 2024-03-25T09:06:58.102 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================== 2024-03-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi129.stdout:Install 13 Packages 2024-03-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 2.0 M 2024-03-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 26 M 2024-03-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:06:58.272 INFO:teuthology.orchestra.run.smithi129.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 196 kB/s | 24 kB 00:00 2024-03-25T09:06:58.297 INFO:teuthology.orchestra.run.smithi129.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 121 kB/s | 18 kB 00:00 2024-03-25T09:06:58.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-volume 2024-03-25T09:06:58.340 INFO:teuthology.orchestra.run.smithi129.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2024-03-25T09:06:58.365 INFO:teuthology.orchestra.run.smithi129.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-03-25T09:06:58.390 INFO:teuthology.orchestra.run.smithi129.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-03-25T09:06:58.416 INFO:teuthology.orchestra.run.smithi129.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 854 kB/s | 43 kB 00:00 2024-03-25T09:06:58.441 INFO:teuthology.orchestra.run.smithi129.stdout:(7/13): ceph-mgr-rook-19.0.0-1997.g47ea673a.el9 168 kB/s | 49 kB 00:00 2024-03-25T09:06:58.533 INFO:teuthology.orchestra.run.smithi129.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 128 kB/s | 15 kB 00:00 2024-03-25T09:06:58.558 INFO:teuthology.orchestra.run.smithi129.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 192 kB/s | 32 kB 00:00 2024-03-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi129.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 546 kB/s | 59 kB 00:00 2024-03-25T09:06:58.692 INFO:teuthology.orchestra.run.smithi129.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 808 kB/s | 203 kB 00:00 2024-03-25T09:06:58.751 INFO:teuthology.orchestra.run.smithi129.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2024-03-25T09:06:58.776 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2/2 2024-03-25T09:06:58.776 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/2 2024-03-25T09:06:58.809 INFO:teuthology.orchestra.run.smithi129.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.7 MB/s | 1.0 MB 00:00 2024-03-25T09:06:58.811 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:58.811 INFO:teuthology.orchestra.run.smithi129.stdout:Total 2.9 MB/s | 2.0 MB 00:00 2024-03-25T09:06:58.812 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:06:58.825 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:06:58.825 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:35 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:06:58.915 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:06:58.915 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:06:59.032 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 264 k 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout:Install 2 Packages 2024-03-25T09:06:59.033 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:59.034 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 332 k 2024-03-25T09:06:59.034 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 1.5 M 2024-03-25T09:06:59.034 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:06:59.059 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-25T09:06:59.059 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:59.060 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:06:59.060 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-25T09:06:59.060 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:06:59.060 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:06:59.168 INFO:teuthology.orchestra.run.smithi040.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 515 kB/s | 69 kB 00:00 2024-03-25T09:06:59.335 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-volume 2024-03-25T09:06:59.423 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:06:59.426 INFO:teuthology.orchestra.run.smithi040.stdout:(2/2): ceph-volume-19.0.0-1997.g47ea673a.el9.no 673 kB/s | 264 kB 00:00 2024-03-25T09:06:59.427 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:06:59.428 INFO:teuthology.orchestra.run.smithi040.stdout:Total 843 kB/s | 332 kB 00:00 2024-03-25T09:06:59.428 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:06:59.438 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:06:59.471 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:06:59.472 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:06:59.597 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-25T09:06:59.619 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:06:59.660 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-25T09:06:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-25T09:06:59.745 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-25T09:06:59.786 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-25T09:06:59.798 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-25T09:06:59.829 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2/2 2024-03-25T09:06:59.845 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2/2 2024-03-25T09:06:59.845 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:06:59.845 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-25T09:06:59.845 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:06:59.880 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-25T09:06:59.913 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:32 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:06:59.988 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-25T09:07:00.046 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-25T09:07:00.072 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:00.073 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:00.073 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-25T09:07:00.073 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:00.073 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:07:00.073 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 264 k 2024-03-25T09:07:00.073 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-25T09:07:00.074 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-25T09:07:00.074 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:00.074 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:07:00.074 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:00.074 INFO:teuthology.orchestra.run.smithi019.stdout:Install 2 Packages 2024-03-25T09:07:00.074 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:00.075 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 332 k 2024-03-25T09:07:00.075 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 1.5 M 2024-03-25T09:07:00.075 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:07:00.196 INFO:teuthology.orchestra.run.smithi019.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 565 kB/s | 69 kB 00:00 2024-03-25T09:07:00.346 INFO:teuthology.orchestra.run.smithi019.stdout:(2/2): ceph-volume-19.0.0-1997.g47ea673a.el9.no 971 kB/s | 264 kB 00:00 2024-03-25T09:07:00.347 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:00.348 INFO:teuthology.orchestra.run.smithi019.stdout:Total 1.2 MB/s | 332 kB 00:00 2024-03-25T09:07:00.348 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:07:00.357 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:07:00.357 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:07:00.393 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:07:00.393 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:07:00.545 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:07:00.586 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 1/2 2024-03-25T09:07:00.735 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-25T09:07:00.764 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-25T09:07:00.774 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2/2 2024-03-25T09:07:00.790 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2/2 2024-03-25T09:07:00.790 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:07:00.790 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-25T09:07:00.790 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:00.811 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-25T09:07:00.844 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-25T09:07:00.892 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-25T09:07:00.913 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-25T09:07:00.913 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:00.913 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:07:00.913 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:07:00.913 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-25T09:07:00.913 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:00.914 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:00.914 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 13/13 2024-03-25T09:07:01.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install librados-devel 2024-03-25T09:07:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 1/2 2024-03-25T09:07:01.703 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 13/13 2024-03-25T09:07:01.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 1/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-25T09:07:01.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-25T09:07:01.834 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:38 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-25T09:07:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:01.858 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:07:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:07:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-25T09:07:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:01.859 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:01.989 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:01.990 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:01.990 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repo Size 2024-03-25T09:07:01.990 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:01.991 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:07:01.991 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 127 k 2024-03-25T09:07:01.991 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:01.991 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:07:01.991 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:01.991 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-03-25T09:07:01.991 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:01.991 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 127 k 2024-03-25T09:07:01.991 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 456 k 2024-03-25T09:07:01.991 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:07:02.064 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-25T09:07:02.064 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:02.064 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:07:02.064 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:07:02.064 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-25T09:07:02.064 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-25T09:07:02.064 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-25T09:07:02.064 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-25T09:07:02.064 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-25T09:07:02.065 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-25T09:07:02.065 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-25T09:07:02.065 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-25T09:07:02.065 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-25T09:07:02.065 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-25T09:07:02.065 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-25T09:07:02.065 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-25T09:07:02.065 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:02.065 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:02.195 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install librados-devel 2024-03-25T09:07:02.232 INFO:teuthology.orchestra.run.smithi040.stdout:librados-devel-19.0.0-1997.g47ea673a.el9.x86_64 528 kB/s | 127 kB 00:00 2024-03-25T09:07:02.232 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:02.233 INFO:teuthology.orchestra.run.smithi040.stdout:Total 524 kB/s | 127 kB 00:00 2024-03-25T09:07:02.233 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:07:02.239 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:07:02.239 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:07:02.297 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:07:02.297 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:07:02.308 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-cephadm 2024-03-25T09:07:02.442 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:07:02.560 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:02.782 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:35 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:02.875 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:21 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:02.939 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:02.940 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:02.940 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repo Size 2024-03-25T09:07:02.940 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:02.940 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:07:02.941 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 127 k 2024-03-25T09:07:02.941 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:02.941 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:07:02.941 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:02.941 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2024-03-25T09:07:02.941 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:02.941 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 127 k 2024-03-25T09:07:02.941 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 456 k 2024-03-25T09:07:02.941 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:07:03.018 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:03.025 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================== 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================== 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 139 k 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-25T09:07:03.026 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:03.027 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:07:03.027 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================== 2024-03-25T09:07:03.027 INFO:teuthology.orchestra.run.smithi129.stdout:Install 6 Packages 2024-03-25T09:07:03.027 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:03.027 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 6.8 M 2024-03-25T09:07:03.027 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 33 M 2024-03-25T09:07:03.027 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:07:03.294 INFO:teuthology.orchestra.run.smithi019.stdout:librados-devel-19.0.0-1997.g47ea673a.el9.x86_64 360 kB/s | 127 kB 00:00 2024-03-25T09:07:03.295 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:03.295 INFO:teuthology.orchestra.run.smithi019.stdout:Total 358 kB/s | 127 kB 00:00 2024-03-25T09:07:03.295 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:07:03.301 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:07:03.301 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:07:03.320 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:03.321 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:07:03.321 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:03.321 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:03.360 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:07:03.360 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:07:03.511 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:07:03.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install libcephfs2 2024-03-25T09:07:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:03.797 INFO:teuthology.orchestra.run.smithi129.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2024-03-25T09:07:03.821 INFO:teuthology.orchestra.run.smithi129.stdout:(2/6): ceph-mgr-cephadm-19.0.0-1997.g47ea673a.e 510 kB/s | 139 kB 00:00 2024-03-25T09:07:03.846 INFO:teuthology.orchestra.run.smithi129.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 834 kB/s | 248 kB 00:00 2024-03-25T09:07:04.072 INFO:teuthology.orchestra.run.smithi129.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 231 kB/s | 58 kB 00:00 2024-03-25T09:07:04.097 INFO:teuthology.orchestra.run.smithi129.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 204 kB/s | 51 kB 00:00 2024-03-25T09:07:04.133 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:04.165 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:41 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:04.197 INFO:teuthology.orchestra.run.smithi129.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.3 MB/s | 548 kB 00:00 2024-03-25T09:07:04.200 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:04.200 INFO:teuthology.orchestra.run.smithi129.stdout:Total 5.8 MB/s | 6.8 MB 00:01 2024-03-25T09:07:04.213 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:07:04.224 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:07:04.224 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:07:04.266 INFO:teuthology.orchestra.run.smithi040.stdout:Package libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:04.313 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:07:04.314 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:07:04.322 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:04.324 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-03-25T09:07:04.324 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:04.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install libcephfs-devel 2024-03-25T09:07:04.418 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:04.418 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:04.418 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:07:04.418 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:04.418 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:04.418 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:04.611 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:07:04.673 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install libcephfs2 2024-03-25T09:07:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-25T09:07:04.841 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-25T09:07:04.964 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:41 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:05.119 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:05.120 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repo Size 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 31 k 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 31 k 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 140 k 2024-03-25T09:07:05.121 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:07:05.251 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:38 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:libcephfs-devel-19.0.0-1997.g47ea673a.el9.x86_6 188 kB/s | 31 kB 00:00 2024-03-25T09:07:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:Total 186 kB/s | 31 kB 00:00 2024-03-25T09:07:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:07:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:07:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:07:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:07:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:07:05.352 INFO:teuthology.orchestra.run.smithi019.stdout:Package libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:05.376 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-25T09:07:05.408 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:05.413 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2024-03-25T09:07:05.413 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:05.452 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:07:05.461 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-25T09:07:05.488 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install libcephfs-devel 2024-03-25T09:07:05.522 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-25T09:07:05.545 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 6/6 2024-03-25T09:07:05.555 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:05.928 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:06.065 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:39 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:06.195 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:06.195 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:06.195 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:07:06.195 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:06.195 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:06.195 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:06.222 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:06.222 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:06.222 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repo Size 2024-03-25T09:07:06.222 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:06.223 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:07:06.223 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 31 k 2024-03-25T09:07:06.223 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:06.223 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:07:06.223 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:06.223 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2024-03-25T09:07:06.223 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:06.223 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 31 k 2024-03-25T09:07:06.223 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 140 k 2024-03-25T09:07:06.223 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:07:06.343 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install librados2 2024-03-25T09:07:06.355 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 6/6 2024-03-25T09:07:06.355 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/6 2024-03-25T09:07:06.355 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-25T09:07:06.356 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-25T09:07:06.356 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-25T09:07:06.356 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-25T09:07:06.465 INFO:teuthology.orchestra.run.smithi019.stdout:libcephfs-devel-19.0.0-1997.g47ea673a.el9.x86_6 129 kB/s | 31 kB 00:00 2024-03-25T09:07:06.465 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:06.465 INFO:teuthology.orchestra.run.smithi019.stdout:Total 129 kB/s | 31 kB 00:00 2024-03-25T09:07:06.465 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:07:06.469 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:07:06.469 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:07:06.498 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:07:06.499 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:07:06.629 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:07:06.655 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-25T09:07:06.655 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:06.655 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:07:06.655 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:07:06.655 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-25T09:07:06.655 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-25T09:07:06.655 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-25T09:07:06.655 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-25T09:07:06.655 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-25T09:07:06.655 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:06.656 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:06.724 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:06.895 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-fuse 2024-03-25T09:07:06.916 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:43 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:07.016 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:07.071 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:07.072 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-03-25T09:07:07.072 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:07.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install librbd1 2024-03-25T09:07:07.135 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:07.394 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:07:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:07.394 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:07.459 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:26 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:07.575 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install librados2 2024-03-25T09:07:07.610 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:07.610 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:07.610 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:07:07.610 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:07.610 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:07:07.610 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 888 k 2024-03-25T09:07:07.610 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-25T09:07:07.610 INFO:teuthology.orchestra.run.smithi129.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-25T09:07:07.611 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:07.611 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:07:07.611 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:07.611 INFO:teuthology.orchestra.run.smithi129.stdout:Install 2 Packages 2024-03-25T09:07:07.611 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:07.611 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 966 k 2024-03-25T09:07:07.611 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 2.8 M 2024-03-25T09:07:07.612 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:07:07.692 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:44 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:07.750 INFO:teuthology.orchestra.run.smithi129.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 569 kB/s | 79 kB 00:00 2024-03-25T09:07:07.792 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:07.846 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:07.847 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-03-25T09:07:07.847 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:07.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install python3-rados 2024-03-25T09:07:08.067 INFO:teuthology.orchestra.run.smithi129.stdout:(2/2): ceph-fuse-19.0.0-1997.g47ea673a.el9.x86_ 1.9 MB/s | 888 kB 00:00 2024-03-25T09:07:08.067 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:08.068 INFO:teuthology.orchestra.run.smithi129.stdout:Total 2.1 MB/s | 966 kB 00:00 2024-03-25T09:07:08.068 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:07:08.090 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:07:08.090 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:07:08.151 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:41 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:08.161 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:07:08.161 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:07:08.251 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:08.305 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:08.306 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2024-03-25T09:07:08.306 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:08.348 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:07:08.359 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install librbd1 2024-03-25T09:07:08.468 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:45 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:08.502 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-25T09:07:08.567 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2/2 2024-03-25T09:07:08.567 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:08.622 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:08.623 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-03-25T09:07:08.623 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:08.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install python3-rgw 2024-03-25T09:07:08.938 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:41 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:09.036 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:09.091 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:09.092 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2024-03-25T09:07:09.092 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:09.142 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install python3-rados 2024-03-25T09:07:09.243 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:46 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:09.262 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2/2 2024-03-25T09:07:09.262 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/2 2024-03-25T09:07:09.342 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:09.396 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:09.397 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-03-25T09:07:09.397 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:09.442 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install python3-cephfs 2024-03-25T09:07:09.557 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-25T09:07:09.557 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:09.557 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:07:09.557 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-25T09:07:09.557 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:09.557 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:09.714 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:42 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:09.813 INFO:teuthology.orchestra.run.smithi019.stdout:Package python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:09.850 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-volume 2024-03-25T09:07:09.867 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:09.868 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2024-03-25T09:07:09.868 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:09.917 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install python3-rgw 2024-03-25T09:07:10.018 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:47 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:10.119 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:10.173 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:10.174 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-03-25T09:07:10.174 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:10.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install python3-rbd 2024-03-25T09:07:10.422 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:29 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:10.489 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:43 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:10.573 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:10.574 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:10.574 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:07:10.574 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:10.574 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:07:10.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 264 k 2024-03-25T09:07:10.574 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-25T09:07:10.574 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-25T09:07:10.574 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:10.574 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:07:10.575 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:10.575 INFO:teuthology.orchestra.run.smithi129.stdout:Install 2 Packages 2024-03-25T09:07:10.575 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:10.575 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 332 k 2024-03-25T09:07:10.575 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 1.5 M 2024-03-25T09:07:10.575 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:07:10.588 INFO:teuthology.orchestra.run.smithi019.stdout:Package python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:10.642 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:10.644 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2024-03-25T09:07:10.644 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:10.696 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install python3-cephfs 2024-03-25T09:07:10.699 INFO:teuthology.orchestra.run.smithi129.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 563 kB/s | 69 kB 00:00 2024-03-25T09:07:10.796 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:47 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:10.896 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:10.948 INFO:teuthology.orchestra.run.smithi129.stdout:(2/2): ceph-volume-19.0.0-1997.g47ea673a.el9.no 708 kB/s | 264 kB 00:00 2024-03-25T09:07:10.949 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:10.949 INFO:teuthology.orchestra.run.smithi129.stdout:Total 888 kB/s | 332 kB 00:00 2024-03-25T09:07:10.949 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:07:10.950 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:10.951 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-03-25T09:07:10.951 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:10.958 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:07:10.958 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:07:10.994 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:07:10.994 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:07:10.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install rbd-fuse 2024-03-25T09:07:11.144 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:07:11.288 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:44 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:11.331 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-25T09:07:11.372 INFO:teuthology.orchestra.run.smithi019.stdout:Package python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:11.376 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2/2 2024-03-25T09:07:11.392 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2/2 2024-03-25T09:07:11.392 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:07:11.392 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-25T09:07:11.392 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:11.427 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:11.428 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2024-03-25T09:07:11.428 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:11.484 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install python3-rbd 2024-03-25T09:07:11.583 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:48 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:11.740 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:11.741 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 85 k 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 85 k 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 231 k 2024-03-25T09:07:11.742 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:07:11.966 INFO:teuthology.orchestra.run.smithi040.stdout:rbd-fuse-19.0.0-1997.g47ea673a.el9.x86_64.rpm 382 kB/s | 85 kB 00:00 2024-03-25T09:07:11.966 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:11.967 INFO:teuthology.orchestra.run.smithi040.stdout:Total 379 kB/s | 85 kB 00:00 2024-03-25T09:07:11.967 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:07:11.978 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:07:11.979 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:07:12.032 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:07:12.033 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:07:12.057 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:45 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:12.132 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 1/2 2024-03-25T09:07:12.157 INFO:teuthology.orchestra.run.smithi019.stdout:Package python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:12.172 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:07:12.211 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:12.212 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2024-03-25T09:07:12.212 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:12.262 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install rbd-fuse 2024-03-25T09:07:12.275 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:12.463 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-25T09:07:12.463 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:12.463 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:07:12.463 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:07:12.463 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-25T09:07:12.463 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:12.463 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:12.680 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:12.797 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librados-devel 2024-03-25T09:07:12.840 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:45 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:12.994 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:12.995 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:12.995 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-03-25T09:07:12.995 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:12.995 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:07:12.995 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 85 k 2024-03-25T09:07:12.995 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:12.995 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:07:12.995 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:12.995 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2024-03-25T09:07:12.995 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:12.996 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 85 k 2024-03-25T09:07:12.996 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 231 k 2024-03-25T09:07:12.996 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:07:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:12.996 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:07:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:12.996 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:13.259 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install rbd-mirror 2024-03-25T09:07:13.378 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:32 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:13.384 INFO:teuthology.orchestra.run.smithi019.stdout:rbd-fuse-19.0.0-1997.g47ea673a.el9.x86_64.rpm 220 kB/s | 85 kB 00:00 2024-03-25T09:07:13.384 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:13.385 INFO:teuthology.orchestra.run.smithi019.stdout:Total 219 kB/s | 85 kB 00:00 2024-03-25T09:07:13.385 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:07:13.392 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:07:13.392 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:07:13.451 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:07:13.451 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:07:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:13.532 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:13.532 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 127 k 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 127 k 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 456 k 2024-03-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:07:13.592 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:07:13.702 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:13.746 INFO:teuthology.orchestra.run.smithi129.stdout:librados-devel-19.0.0-1997.g47ea673a.el9.x86_64 594 kB/s | 127 kB 00:00 2024-03-25T09:07:13.747 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:13.747 INFO:teuthology.orchestra.run.smithi129.stdout:Total 590 kB/s | 127 kB 00:00 2024-03-25T09:07:13.747 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:07:13.753 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:07:13.753 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:07:13.809 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:07:13.810 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:07:13.836 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:50 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:13.957 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:07:13.992 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repo Size 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.1 M 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 3.1 M 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 13 M 2024-03-25T09:07:13.993 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:07:14.070 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:14.071 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:14.350 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:14.350 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:14.350 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:07:14.350 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:14.350 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:14.351 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:14.402 INFO:teuthology.orchestra.run.smithi040.stdout:rbd-mirror-19.0.0-1997.g47ea673a.el9.x86_64.rpm 7.6 MB/s | 3.1 MB 00:00 2024-03-25T09:07:14.403 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:14.403 INFO:teuthology.orchestra.run.smithi040.stdout:Total 7.5 MB/s | 3.1 MB 00:00 2024-03-25T09:07:14.403 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:07:14.413 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:07:14.413 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:07:14.489 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:07:14.489 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:07:14.547 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:14.598 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install rbd-mirror 2024-03-25T09:07:14.830 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:14.830 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:14.830 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:07:14.830 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:14.830 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:14.830 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:14.929 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:07:14.995 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:15.018 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:15.019 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:07:15.019 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-25T09:07:15.019 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T09:07:15.019 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T09:07:15.019 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:15.075 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install libcephfs2 2024-03-25T09:07:15.183 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:48 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:15.339 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:15.340 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:15.340 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repo Size 2024-03-25T09:07:15.340 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:15.340 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:07:15.340 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.1 M 2024-03-25T09:07:15.341 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:15.341 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:07:15.341 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:15.341 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2024-03-25T09:07:15.341 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:15.341 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 3.1 M 2024-03-25T09:07:15.341 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 13 M 2024-03-25T09:07:15.341 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:07:15.652 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:34 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:15.753 INFO:teuthology.orchestra.run.smithi129.stdout:Package libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:15.808 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:15.809 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-25T09:07:15.809 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:15.879 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install libcephfs-devel 2024-03-25T09:07:16.125 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:16.126 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:16.126 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:07:16.126 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:16.126 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:16.126 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:16.387 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install rbd-nbd 2024-03-25T09:07:16.446 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:35 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:16.598 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 31 k 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:16.599 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 31 k 2024-03-25T09:07:16.600 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 140 k 2024-03-25T09:07:16.600 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:07:16.844 INFO:teuthology.orchestra.run.smithi129.stdout:libcephfs-devel-19.0.0-1997.g47ea673a.el9.x86_6 127 kB/s | 31 kB 00:00 2024-03-25T09:07:16.845 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:16.845 INFO:teuthology.orchestra.run.smithi129.stdout:Total 127 kB/s | 31 kB 00:00 2024-03-25T09:07:16.845 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:07:16.848 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:07:16.849 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:07:16.873 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:07:16.874 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:07:16.971 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:53 ago on Mon 25 Mar 2024 09:05:23 AM UTC. 2024-03-25T09:07:17.011 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:07:17.101 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:17.126 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-03-25T09:07:17.127 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:17.127 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-03-25T09:07:17.127 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:17.127 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-03-25T09:07:17.127 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 170 k 2024-03-25T09:07:17.128 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:17.128 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-03-25T09:07:17.128 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-03-25T09:07:17.128 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-03-25T09:07:17.128 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:17.129 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 170 k 2024-03-25T09:07:17.129 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 490 k 2024-03-25T09:07:17.130 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-03-25T09:07:17.205 INFO:teuthology.orchestra.run.smithi019.stdout:rbd-mirror-19.0.0-1997.g47ea673a.el9.x86_64.rpm 1.7 MB/s | 3.1 MB 00:01 2024-03-25T09:07:17.206 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:17.206 INFO:teuthology.orchestra.run.smithi019.stdout:Total 1.7 MB/s | 3.1 MB 00:01 2024-03-25T09:07:17.206 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:07:17.217 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:07:17.217 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi040.stdout:rbd-nbd-19.0.0-1997.g47ea673a.el9.x86_64.rpm 461 kB/s | 170 kB 00:00 2024-03-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi040.stdout:Total 459 kB/s | 170 kB 00:00 2024-03-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-03-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-03-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-03-25T09:07:17.565 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-03-25T09:07:17.566 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-03-25T09:07:17.717 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-03-25T09:07:17.740 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:07:17.772 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:17.772 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:17.772 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:07:17.772 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:17.772 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:17.772 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:17.788 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:17.813 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:17.813 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:07:17.813 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-25T09:07:17.813 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T09:07:17.813 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T09:07:17.813 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:17.824 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:17.937 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librados2 2024-03-25T09:07:18.265 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:18.507 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:37 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:18.522 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:18.523 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:18.523 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-03-25T09:07:18.523 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:18.523 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-03-25T09:07:18.523 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-03-25T09:07:18.605 INFO:teuthology.orchestra.run.smithi129.stdout:Package librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:18.658 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:18.659 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-25T09:07:18.659 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:18.718 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librbd1 2024-03-25T09:07:18.739 DEBUG:teuthology.parallel:result is None 2024-03-25T09:07:18.917 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:18.917 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:18.917 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:07:18.917 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:18.918 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:18.918 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:19.167 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install rbd-nbd 2024-03-25T09:07:19.285 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:38 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:19.382 INFO:teuthology.orchestra.run.smithi129.stdout:Package librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:19.433 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:19.434 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-25T09:07:19.434 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:19.486 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rados 2024-03-25T09:07:19.750 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:52 ago on Mon 25 Mar 2024 09:05:27 AM UTC. 2024-03-25T09:07:19.906 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-25T09:07:19.907 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:19.907 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 170 k 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 170 k 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 490 k 2024-03-25T09:07:19.908 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-25T09:07:20.052 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:39 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:20.132 INFO:teuthology.orchestra.run.smithi019.stdout:rbd-nbd-19.0.0-1997.g47ea673a.el9.x86_64.rpm 761 kB/s | 170 kB 00:00 2024-03-25T09:07:20.133 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:20.133 INFO:teuthology.orchestra.run.smithi019.stdout:Total 756 kB/s | 170 kB 00:00 2024-03-25T09:07:20.133 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-25T09:07:20.141 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-25T09:07:20.141 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-25T09:07:20.149 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:20.200 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:20.201 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-25T09:07:20.201 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:20.202 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-25T09:07:20.202 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-25T09:07:20.258 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rgw 2024-03-25T09:07:20.355 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-25T09:07:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:20.818 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:39 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:20.892 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:20.915 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:20.966 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:20.967 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-25T09:07:20.967 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:21.025 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-cephfs 2024-03-25T09:07:21.173 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:21.174 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:21.174 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-25T09:07:21.174 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:21.174 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:07:21.174 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-25T09:07:21.395 DEBUG:teuthology.parallel:result is None 2024-03-25T09:07:21.587 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:40 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:21.685 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:21.736 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:21.737 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-25T09:07:21.737 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:21.788 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rbd 2024-03-25T09:07:22.351 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:41 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:22.448 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:07:22.501 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:22.502 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-25T09:07:22.502 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:22.559 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-fuse 2024-03-25T09:07:23.120 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:42 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:23.268 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:23.269 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:23.269 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-25T09:07:23.269 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:23.270 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:07:23.270 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 85 k 2024-03-25T09:07:23.270 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:23.270 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:07:23.270 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:23.270 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-25T09:07:23.270 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:23.270 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 85 k 2024-03-25T09:07:23.270 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 231 k 2024-03-25T09:07:23.270 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:07:23.481 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-fuse-19.0.0-1997.g47ea673a.el9.x86_64.rpm 404 kB/s | 85 kB 00:00 2024-03-25T09:07:23.482 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:23.482 INFO:teuthology.orchestra.run.smithi129.stdout:Total 402 kB/s | 85 kB 00:00 2024-03-25T09:07:23.482 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:07:23.489 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:07:23.489 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:07:23.543 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:07:23.543 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:07:23.677 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:07:23.780 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:24.192 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:24.488 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:24.488 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:24.488 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:07:24.488 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:24.488 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:24.488 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:24.745 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-mirror 2024-03-25T09:07:25.342 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:44 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:25.497 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:25.498 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:25.498 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-03-25T09:07:25.498 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:25.498 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:07:25.498 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.1 M 2024-03-25T09:07:25.499 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:25.499 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:07:25.499 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:25.499 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-25T09:07:25.499 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:25.499 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 3.1 M 2024-03-25T09:07:25.499 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 13 M 2024-03-25T09:07:25.499 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:07:25.861 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-mirror-19.0.0-1997.g47ea673a.el9.x86_64.rpm 8.5 MB/s | 3.1 MB 00:00 2024-03-25T09:07:25.861 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:25.862 INFO:teuthology.orchestra.run.smithi129.stdout:Total 8.5 MB/s | 3.1 MB 00:00 2024-03-25T09:07:25.862 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:07:25.871 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:07:25.871 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:07:25.944 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:07:25.944 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:07:26.367 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:07:26.437 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:26.462 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:26.463 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:07:26.463 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-25T09:07:26.463 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T09:07:26.463 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T09:07:26.463 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:27.635 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:27.636 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:27.636 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:07:27.636 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:27.636 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:27.636 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:27.873 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-nbd 2024-03-25T09:07:28.459 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:47 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:07:28.609 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-25T09:07:28.609 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:28.609 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-25T09:07:28.609 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:28.610 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-25T09:07:28.610 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 170 k 2024-03-25T09:07:28.610 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:28.610 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-25T09:07:28.610 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-25T09:07:28.610 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-25T09:07:28.610 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:28.611 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 170 k 2024-03-25T09:07:28.611 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 490 k 2024-03-25T09:07:28.611 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-25T09:07:28.832 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-nbd-19.0.0-1997.g47ea673a.el9.x86_64.rpm 770 kB/s | 170 kB 00:00 2024-03-25T09:07:28.832 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:07:28.832 INFO:teuthology.orchestra.run.smithi129.stdout:Total 766 kB/s | 170 kB 00:00 2024-03-25T09:07:28.833 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-25T09:07:28.840 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:07:28.840 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-25T09:07:28.898 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:07:28.899 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-25T09:07:29.044 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-25T09:07:29.156 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:29.574 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:29.847 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:07:29.847 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:29.847 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-25T09:07:29.847 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:07:29.847 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-25T09:07:29.848 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-25T09:07:30.063 DEBUG:teuthology.parallel:result is None 2024-03-25T09:07:46.038 INFO:teuthology.orchestra.run.smithi059.stdout:(12/13): python3-google-auth-2.28.2-1.el9.noarc 3.1 kB/s | 203 kB 01:04 2024-03-25T09:08:50.858 INFO:teuthology.orchestra.run.smithi059.stdout:[MIRROR] python3-cachetools-4.2.4-1.el9.noarch.rpm: Curl error (28): Timeout was reached for http://epel.stl.us.ssimn.org/9/Everything/x86_64/Packages/p/python3-cachetools-4.2.4-1.el9.noarch.rpm [Failed to connect to epel.stl.us.ssimn.org port 80: Connection timed out] 2024-03-25T09:08:54.138 INFO:teuthology.orchestra.run.smithi059.stdout:(13/13): python3-cachetools-4.2.4-1.el9.noarch. 248 B/s | 32 kB 02:12 2024-03-25T09:08:54.138 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:08:54.138 INFO:teuthology.orchestra.run.smithi059.stdout:Total 16 kB/s | 2.0 MB 02:12 2024-03-25T09:08:54.139 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:08:54.155 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:08:54.155 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:08:54.260 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:08:54.260 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:08:54.794 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:08:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-25T09:08:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-25T09:08:55.087 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-25T09:08:55.123 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-25T09:08:55.165 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-25T09:08:55.261 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-25T09:08:55.378 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-25T09:08:55.433 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-25T09:08:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-25T09:08:56.237 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-25T09:08:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-25T09:08:56.320 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-25T09:08:56.349 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 13/13 2024-03-25T09:08:57.034 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 13/13 2024-03-25T09:08:57.034 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 1/13 2024-03-25T09:08:57.034 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-25T09:08:57.034 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-25T09:08:57.034 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-25T09:08:57.034 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-25T09:08:57.034 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-25T09:08:57.034 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-25T09:08:57.035 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-25T09:08:57.035 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-25T09:08:57.035 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-25T09:08:57.035 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-25T09:08:57.035 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-25T09:08:57.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-25T09:08:57.400 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:08:57.400 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:08:57.401 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:08:57.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-cephadm 2024-03-25T09:08:58.225 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:37 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:08:58.381 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:08:58.382 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================== 2024-03-25T09:08:58.382 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-25T09:08:58.382 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================== 2024-03-25T09:08:58.382 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:08:58.382 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 139 k 2024-03-25T09:08:58.382 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-25T09:08:58.382 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-25T09:08:58.382 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-25T09:08:58.382 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-25T09:08:58.383 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-25T09:08:58.383 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-25T09:08:58.383 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:08:58.383 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:08:58.383 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================== 2024-03-25T09:08:58.383 INFO:teuthology.orchestra.run.smithi059.stdout:Install 6 Packages 2024-03-25T09:08:58.383 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:08:58.383 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 6.8 M 2024-03-25T09:08:58.384 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 33 M 2024-03-25T09:08:58.384 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:08:58.613 INFO:teuthology.orchestra.run.smithi059.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 2.1 MB/s | 248 kB 00:00 2024-03-25T09:08:58.763 INFO:teuthology.orchestra.run.smithi059.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2024-03-25T09:08:58.863 INFO:teuthology.orchestra.run.smithi059.stdout:(3/6): ceph-mgr-cephadm-19.0.0-1997.g47ea673a.e 381 kB/s | 139 kB 00:00 2024-03-25T09:08:59.130 INFO:teuthology.orchestra.run.smithi059.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 157 kB/s | 58 kB 00:00 2024-03-25T09:08:59.205 INFO:teuthology.orchestra.run.smithi059.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 149 kB/s | 51 kB 00:00 2024-03-25T09:08:59.264 INFO:teuthology.orchestra.run.smithi059.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 844 kB/s | 548 kB 00:00 2024-03-25T09:08:59.265 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:08:59.266 INFO:teuthology.orchestra.run.smithi059.stdout:Total 7.7 MB/s | 6.8 MB 00:00 2024-03-25T09:08:59.280 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:08:59.291 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:08:59.291 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:08:59.385 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:08:59.385 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:08:59.687 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:08:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-25T09:08:59.925 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-25T09:09:00.476 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-25T09:09:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-25T09:09:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-25T09:09:00.652 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 6/6 2024-03-25T09:09:01.463 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 6/6 2024-03-25T09:09:01.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 1/6 2024-03-25T09:09:01.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-25T09:09:01.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-25T09:09:01.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-25T09:09:01.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-25T09:09:01.781 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-25T09:09:01.781 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:01.781 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:09:01.781 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:09:01.782 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-25T09:09:01.782 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-25T09:09:01.782 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-25T09:09:01.782 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-25T09:09:01.782 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-25T09:09:01.782 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:01.782 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:02.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-fuse 2024-03-25T09:09:02.579 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:41 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:02.738 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:02.738 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 888 k 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout:Install 2 Packages 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 966 k 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 2.8 M 2024-03-25T09:09:02.739 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:09:02.865 INFO:teuthology.orchestra.run.smithi059.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 625 kB/s | 79 kB 00:00 2024-03-25T09:09:03.181 INFO:teuthology.orchestra.run.smithi059.stdout:(2/2): ceph-fuse-19.0.0-1997.g47ea673a.el9.x86_ 2.0 MB/s | 888 kB 00:00 2024-03-25T09:09:03.182 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:09:03.183 INFO:teuthology.orchestra.run.smithi059.stdout:Total 2.1 MB/s | 966 kB 00:00 2024-03-25T09:09:03.183 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:09:03.205 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:09:03.205 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:09:03.280 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:09:03.281 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:09:03.474 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:09:03.612 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-25T09:09:03.684 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2/2 2024-03-25T09:09:04.399 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2/2 2024-03-25T09:09:04.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/2 2024-03-25T09:09:04.706 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-25T09:09:04.706 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:09:04.707 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-25T09:09:04.707 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:04.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-volume 2024-03-25T09:09:05.540 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:44 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:05.696 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:05.696 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:05.696 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-25T09:09:05.696 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:05.696 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:09:05.697 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:19.0.0-1997.g47ea673a.el9 ceph-noarch 264 k 2024-03-25T09:09:05.697 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-25T09:09:05.697 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-25T09:09:05.697 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:05.697 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:09:05.697 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:05.697 INFO:teuthology.orchestra.run.smithi059.stdout:Install 2 Packages 2024-03-25T09:09:05.697 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:05.698 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 332 k 2024-03-25T09:09:05.698 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 1.5 M 2024-03-25T09:09:05.698 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:09:05.894 INFO:teuthology.orchestra.run.smithi059.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 351 kB/s | 69 kB 00:00 2024-03-25T09:09:05.944 INFO:teuthology.orchestra.run.smithi059.stdout:(2/2): ceph-volume-19.0.0-1997.g47ea673a.el9.no 1.0 MB/s | 264 kB 00:00 2024-03-25T09:09:05.945 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:09:05.945 INFO:teuthology.orchestra.run.smithi059.stdout:Total 1.3 MB/s | 332 kB 00:00 2024-03-25T09:09:05.945 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:09:05.956 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:09:05.956 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:09:05.996 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:09:05.996 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:09:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:09:06.350 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-25T09:09:06.380 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2/2 2024-03-25T09:09:06.396 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2/2 2024-03-25T09:09:06.396 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:09:06.396 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-25T09:09:06.396 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:07.089 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 1/2 2024-03-25T09:09:07.422 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-25T09:09:07.423 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:07.423 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:09:07.423 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:19.0.0-1997.g47ea673a.el9.noarch 2024-03-25T09:09:07.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-25T09:09:07.423 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:07.423 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:07.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install librados-devel 2024-03-25T09:09:08.318 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:47 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:08.477 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:08.477 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2024-03-25T09:09:08.477 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:08.477 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:09:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 127 k 2024-03-25T09:09:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:08.478 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:09:08.478 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:08.478 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-03-25T09:09:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:08.478 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 127 k 2024-03-25T09:09:08.478 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 456 k 2024-03-25T09:09:08.478 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:09:08.693 INFO:teuthology.orchestra.run.smithi059.stdout:librados-devel-19.0.0-1997.g47ea673a.el9.x86_64 591 kB/s | 127 kB 00:00 2024-03-25T09:09:08.694 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:09:08.694 INFO:teuthology.orchestra.run.smithi059.stdout:Total 587 kB/s | 127 kB 00:00 2024-03-25T09:09:08.694 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:09:08.700 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:09:08.700 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:09:08.757 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:09:08.758 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:09:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:09.447 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:09.748 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:09:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:09:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:09.748 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:09.959 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install libcephfs2 2024-03-25T09:09:10.531 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:49 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:10.631 INFO:teuthology.orchestra.run.smithi059.stdout:Package libcephfs2-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:09:10.687 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:10.689 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-03-25T09:09:10.689 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:10.749 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install libcephfs-devel 2024-03-25T09:09:11.325 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:50 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:11.481 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:11.482 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:11.482 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2024-03-25T09:09:11.482 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:11.482 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:09:11.482 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 31 k 2024-03-25T09:09:11.482 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:11.482 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:09:11.482 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:11.482 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-03-25T09:09:11.482 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:11.483 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 31 k 2024-03-25T09:09:11.483 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 140 k 2024-03-25T09:09:11.483 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:09:11.729 INFO:teuthology.orchestra.run.smithi059.stdout:libcephfs-devel-19.0.0-1997.g47ea673a.el9.x86_6 127 kB/s | 31 kB 00:00 2024-03-25T09:09:11.729 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:09:11.729 INFO:teuthology.orchestra.run.smithi059.stdout:Total 126 kB/s | 31 kB 00:00 2024-03-25T09:09:11.729 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:09:11.733 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:09:11.734 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:09:11.765 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:09:11.766 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:09:11.881 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:09:11.996 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:12.392 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:12.730 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:12.730 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:12.730 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:09:12.730 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:09:12.730 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:12.730 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:13.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install librados2 2024-03-25T09:09:13.590 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:52 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:13.691 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:09:13.746 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:13.747 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-03-25T09:09:13.747 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:13.796 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install librbd1 2024-03-25T09:09:14.372 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:53 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:14.471 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:09:14.525 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:14.526 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-03-25T09:09:14.526 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:14.591 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-rados 2024-03-25T09:09:15.167 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:54 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:15.267 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-rados-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:09:15.322 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:15.323 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-03-25T09:09:15.323 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:15.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-rgw 2024-03-25T09:09:15.947 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:54 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:16.046 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-rgw-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:09:16.101 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:16.102 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-03-25T09:09:16.102 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:16.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-cephfs 2024-03-25T09:09:16.735 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:55 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:16.837 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-cephfs-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:09:16.891 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-03-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:16.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-rbd 2024-03-25T09:09:17.524 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:56 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:17.623 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-rbd-2:19.0.0-1997.g47ea673a.el9.x86_64 is already installed. 2024-03-25T09:09:17.678 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:17.679 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-03-25T09:09:17.679 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:17.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install rbd-fuse 2024-03-25T09:09:18.342 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:57 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:18.499 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:18.499 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 85 k 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 85 k 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 231 k 2024-03-25T09:09:18.500 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:09:18.806 INFO:teuthology.orchestra.run.smithi059.stdout:rbd-fuse-19.0.0-1997.g47ea673a.el9.x86_64.rpm 279 kB/s | 85 kB 00:00 2024-03-25T09:09:18.807 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:09:18.807 INFO:teuthology.orchestra.run.smithi059.stdout:Total 277 kB/s | 85 kB 00:00 2024-03-25T09:09:18.807 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:09:18.815 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:09:18.815 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:09:18.873 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:09:18.873 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:09:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:09:19.116 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:19.488 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:19.773 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:19.773 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:19.774 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:09:19.774 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:09:19.774 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:19.774 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:20.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install rbd-mirror 2024-03-25T09:09:20.585 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:03:59 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:20.739 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:20.740 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:20.740 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2024-03-25T09:09:20.740 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:20.740 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:09:20.740 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 3.1 M 2024-03-25T09:09:20.740 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:20.740 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:09:20.740 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:20.740 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-03-25T09:09:20.740 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:20.741 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 3.1 M 2024-03-25T09:09:20.741 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 13 M 2024-03-25T09:09:20.741 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:09:21.117 INFO:teuthology.orchestra.run.smithi059.stdout:rbd-mirror-19.0.0-1997.g47ea673a.el9.x86_64.rpm 8.2 MB/s | 3.1 MB 00:00 2024-03-25T09:09:21.209 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:09:21.209 INFO:teuthology.orchestra.run.smithi059.stdout:Total 8.2 MB/s | 3.1 MB 00:00 2024-03-25T09:09:21.210 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:09:21.210 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:09:21.210 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:09:21.210 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:09:21.210 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:09:21.646 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:09:21.710 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:21.734 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:21.734 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T09:09:21.734 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-25T09:09:21.734 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T09:09:21.734 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T09:09:21.734 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:22.936 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:22.936 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:22.936 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:09:22.936 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:09:22.937 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:22.937 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:23.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install rbd-nbd 2024-03-25T09:09:23.734 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:02 ago on Mon 25 Mar 2024 09:05:21 AM UTC. 2024-03-25T09:09:23.888 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-25T09:09:23.889 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:23.889 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2024-03-25T09:09:23.889 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:23.890 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-25T09:09:23.890 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:19.0.0-1997.g47ea673a.el9 ceph 170 k 2024-03-25T09:09:23.890 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:23.890 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-25T09:09:23.890 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-25T09:09:23.890 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-03-25T09:09:23.890 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:23.890 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 170 k 2024-03-25T09:09:23.890 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 490 k 2024-03-25T09:09:23.890 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-25T09:09:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:rbd-nbd-19.0.0-1997.g47ea673a.el9.x86_64.rpm 479 kB/s | 170 kB 00:00 2024-03-25T09:09:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:09:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:Total 478 kB/s | 170 kB 00:00 2024-03-25T09:09:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-25T09:09:24.256 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-25T09:09:24.256 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-25T09:09:24.314 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-25T09:09:24.314 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-25T09:09:24.463 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-25T09:09:24.563 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:24.963 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 1/1 2024-03-25T09:09:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:25.262 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-25T09:09:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:19.0.0-1997.g47ea673a.el9.x86_64 2024-03-25T09:09:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:09:25.262 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-25T09:09:25.483 DEBUG:teuthology.parallel:result is None 2024-03-25T09:09:25.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:09:25.710 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-25T09:09:25.735 INFO:teuthology.orchestra.run.smithi019.stdout:19.0.0-1997.g47ea673a.el9 2024-03-25T09:09:25.735 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1997.g47ea673a.el9 2024-03-25T09:09:25.735 INFO:teuthology.task.install:The correct ceph version 19.0.0-1997.g47ea673a is installed. 2024-03-25T09:09:25.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:09:25.887 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-25T09:09:25.913 INFO:teuthology.orchestra.run.smithi040.stdout:19.0.0-1997.g47ea673a.el9 2024-03-25T09:09:25.913 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1997.g47ea673a.el9 2024-03-25T09:09:25.913 INFO:teuthology.task.install:The correct ceph version 19.0.0-1997.g47ea673a is installed. 2024-03-25T09:09:25.915 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:09:26.063 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-25T09:09:26.085 INFO:teuthology.orchestra.run.smithi059.stdout:19.0.0-1997.g47ea673a.el9 2024-03-25T09:09:26.085 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1997.g47ea673a.el9 2024-03-25T09:09:26.085 INFO:teuthology.task.install:The correct ceph version 19.0.0-1997.g47ea673a is installed. 2024-03-25T09:09:26.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:09:26.235 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-25T09:09:26.260 INFO:teuthology.orchestra.run.smithi129.stdout:19.0.0-1997.g47ea673a.el9 2024-03-25T09:09:26.260 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1997.g47ea673a.el9 2024-03-25T09:09:26.261 INFO:teuthology.task.install:The correct ceph version 19.0.0-1997.g47ea673a is installed. 2024-03-25T09:09:26.262 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-25T09:09:26.263 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:09:26.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-25T09:09:26.360 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:09:26.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-25T09:09:26.393 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:09:26.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-25T09:09:26.423 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:09:26.423 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-25T09:09:26.456 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-25T09:09:26.456 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:09:26.456 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-03-25T09:09:26.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-25T09:09:26.559 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:09:26.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-03-25T09:09:26.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-25T09:09:26.655 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:09:26.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-03-25T09:09:26.682 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-25T09:09:26.750 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:09:26.751 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2024-03-25T09:09:26.783 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-25T09:09:26.852 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-25T09:09:26.852 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:09:26.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-25T09:09:26.879 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-25T09:09:26.947 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:09:26.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-25T09:09:26.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-25T09:09:27.041 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:09:27.041 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-25T09:09:27.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-25T09:09:27.135 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:09:27.135 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-25T09:09:27.162 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-25T09:09:27.232 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-25T09:09:27.232 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:09:27.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-03-25T09:09:27.259 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-25T09:09:27.325 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:09:27.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-03-25T09:09:27.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-25T09:09:27.420 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:09:27.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-03-25T09:09:27.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-25T09:09:27.512 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:09:27.512 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2024-03-25T09:09:27.539 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-25T09:09:27.606 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-25T09:09:27.824 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon warn on pool no app': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4'} 2024-03-25T09:09:27.825 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:09:27.825 INFO:tasks.cephadm:Cluster fsid is 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:09:27.825 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-25T09:09:27.825 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.19', 'mon.b': '172.21.15.40', 'mon.c': '172.21.15.59'} 2024-03-25T09:09:27.826 INFO:tasks.cephadm:First mon is mon.a on smithi019 2024-03-25T09:09:27.826 INFO:tasks.cephadm:First mgr is x 2024-03-25T09:09:27.826 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-25T09:09:27.826 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname $(hostname -s) 2024-03-25T09:09:27.853 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname $(hostname -s) 2024-03-25T09:09:27.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname $(hostname -s) 2024-03-25T09:09:27.908 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname $(hostname -s) 2024-03-25T09:09:27.936 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-03-25T09:09:27.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:09:28.156 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77549/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1997-g47ea673a', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1997.g47ea673a'}, 'url': 'https://4.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-12 03:56:10.028429', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'ceph-nvmeof-mon', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77547/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1997-g47ea673a', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1997.g47ea673a'}, 'url': 'https://1.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-12 01:58:25.592799', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'ceph-nvmeof-mon', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77545/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1997-g47ea673a', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1997.g47ea673a'}, 'url': 'https://3.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-12 01:38:12.602422', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'ceph-nvmeof-mon', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '47ea673ae9ebf51b2ebc505093bd7272422045e4', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77541/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1997-g47ea673a', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1997.g47ea673a'}, 'url': 'https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-12 00:38:06.592075', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'ceph-nvmeof-mon', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-25T09:09:28.301 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref ceph-nvmeof-mon, sha1 47ea673ae9ebf51b2ebc505093bd7272422045e4 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:09:28.302 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/x86_64/flavors/default/cephadm 2024-03-25T09:09:28.302 DEBUG:teuthology.orchestra.run.smithi019:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:28.778 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r--. 1 ubuntu ubuntu 767357 Mar 25 09:09 /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:28.779 DEBUG:teuthology.orchestra.run.smithi040:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:-rw-r--r--. 1 ubuntu ubuntu 767357 Mar 25 09:09 /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:29.254 DEBUG:teuthology.orchestra.run.smithi059:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:29.715 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r--. 1 ubuntu ubuntu 767357 Mar 25 09:09 /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:29.715 DEBUG:teuthology.orchestra.run.smithi129:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/ceph-nvmeof-mon/47ea673ae9ebf51b2ebc505093bd7272422045e4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:30.297 INFO:teuthology.orchestra.run.smithi129.stdout:-rw-r--r--. 1 ubuntu ubuntu 767357 Mar 25 09:09 /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:30.298 DEBUG:teuthology.orchestra.run.smithi019:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:30.316 DEBUG:teuthology.orchestra.run.smithi040:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:30.336 DEBUG:teuthology.orchestra.run.smithi059:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:30.355 DEBUG:teuthology.orchestra.run.smithi129:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-25T09:09:30.387 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 on all hosts... 2024-03-25T09:09:30.387 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 pull 2024-03-25T09:09:30.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 pull 2024-03-25T09:09:30.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 pull 2024-03-25T09:09:30.402 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 pull 2024-03-25T09:09:31.255 INFO:teuthology.orchestra.run.smithi129.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4... 2024-03-25T09:09:31.305 INFO:teuthology.orchestra.run.smithi059.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4... 2024-03-25T09:09:31.311 INFO:teuthology.orchestra.run.smithi019.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4... 2024-03-25T09:09:31.341 INFO:teuthology.orchestra.run.smithi040.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4... 2024-03-25T09:10:11.580 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-03-25T09:10:11.581 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_version": "ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev)", 2024-03-25T09:10:11.581 INFO:teuthology.orchestra.run.smithi129.stdout: "image_id": "57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da", 2024-03-25T09:10:11.581 INFO:teuthology.orchestra.run.smithi129.stdout: "repo_digests": [ 2024-03-25T09:10:11.581 INFO:teuthology.orchestra.run.smithi129.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca" 2024-03-25T09:10:11.581 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-03-25T09:10:11.581 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-03-25T09:10:13.991 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-03-25T09:10:13.992 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev)", 2024-03-25T09:10:13.992 INFO:teuthology.orchestra.run.smithi040.stdout: "image_id": "57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da", 2024-03-25T09:10:13.992 INFO:teuthology.orchestra.run.smithi040.stdout: "repo_digests": [ 2024-03-25T09:10:13.992 INFO:teuthology.orchestra.run.smithi040.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca" 2024-03-25T09:10:13.992 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-03-25T09:10:13.992 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-03-25T09:10:15.384 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-25T09:10:15.384 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev)", 2024-03-25T09:10:15.384 INFO:teuthology.orchestra.run.smithi019.stdout: "image_id": "57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da", 2024-03-25T09:10:15.384 INFO:teuthology.orchestra.run.smithi019.stdout: "repo_digests": [ 2024-03-25T09:10:15.384 INFO:teuthology.orchestra.run.smithi019.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca" 2024-03-25T09:10:15.385 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-03-25T09:10:15.385 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-25T09:10:18.062 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-03-25T09:10:18.062 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev)", 2024-03-25T09:10:18.063 INFO:teuthology.orchestra.run.smithi059.stdout: "image_id": "57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da", 2024-03-25T09:10:18.063 INFO:teuthology.orchestra.run.smithi059.stdout: "repo_digests": [ 2024-03-25T09:10:18.063 INFO:teuthology.orchestra.run.smithi059.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca" 2024-03-25T09:10:18.063 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-03-25T09:10:18.063 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-03-25T09:10:18.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph 2024-03-25T09:10:18.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph 2024-03-25T09:10:18.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph 2024-03-25T09:10:18.190 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph 2024-03-25T09:10:18.225 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /etc/ceph 2024-03-25T09:10:18.256 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /etc/ceph 2024-03-25T09:10:18.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /etc/ceph 2024-03-25T09:10:18.316 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /etc/ceph 2024-03-25T09:10:18.347 INFO:tasks.cephadm:Writing seed config... 2024-03-25T09:10:18.352 INFO:tasks.cephadm: override: [global] mon warn on pool no app = False 2024-03-25T09:10:18.353 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-25T09:10:18.353 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-25T09:10:18.353 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-25T09:10:18.353 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-25T09:10:18.353 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-25T09:10:18.353 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-25T09:10:18.353 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-25T09:10:18.354 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:10:18.354 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-25T09:10:18.372 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 61da756e-ea87-11ee-95cd-87774f69a715 mon warn on pool no app = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-03-25T09:10:18.373 DEBUG:teuthology.orchestra.run.smithi019:mon.a> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.a.service 2024-03-25T09:10:18.415 DEBUG:teuthology.orchestra.run.smithi019:mgr.x> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@mgr.x.service 2024-03-25T09:10:18.458 INFO:tasks.cephadm:Bootstrapping... 2024-03-25T09:10:18.459 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 -v bootstrap --fsid 61da756e-ea87-11ee-95cd-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.19 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:10:18.659 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:10:18.659 INFO:teuthology.orchestra.run.smithi019.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4', '-v', 'bootstrap', '--fsid', '61da756e-ea87-11ee-95cd-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.19', '--skip-admin-label'] 2024-03-25T09:10:18.684 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-25T09:10:18.684 INFO:teuthology.orchestra.run.smithi019.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-25T09:10:18.684 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying podman|docker is present... 2024-03-25T09:10:18.708 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-25T09:10:18.708 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying lvm2 is present... 2024-03-25T09:10:18.708 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying time synchronization is in place... 2024-03-25T09:10:18.716 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-25T09:10:18.716 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-25T09:10:18.722 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-25T09:10:18.722 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-03-25T09:10:18.728 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout enabled 2024-03-25T09:10:18.734 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout active 2024-03-25T09:10:18.734 INFO:teuthology.orchestra.run.smithi019.stdout:Unit chronyd.service is enabled and running 2024-03-25T09:10:18.734 INFO:teuthology.orchestra.run.smithi019.stdout:Repeating the final host check... 2024-03-25T09:10:18.757 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-25T09:10:18.757 INFO:teuthology.orchestra.run.smithi019.stdout:podman (/bin/podman) version 4.9.3 is present 2024-03-25T09:10:18.757 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl is present 2024-03-25T09:10:18.757 INFO:teuthology.orchestra.run.smithi019.stdout:lvcreate is present 2024-03-25T09:10:18.763 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-25T09:10:18.763 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-25T09:10:18.769 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-25T09:10:18.769 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-03-25T09:10:18.775 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout enabled 2024-03-25T09:10:18.781 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout active 2024-03-25T09:10:18.781 INFO:teuthology.orchestra.run.smithi019.stdout:Unit chronyd.service is enabled and running 2024-03-25T09:10:18.781 INFO:teuthology.orchestra.run.smithi019.stdout:Host looks OK 2024-03-25T09:10:18.781 INFO:teuthology.orchestra.run.smithi019.stdout:Cluster fsid: 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:10:18.781 INFO:teuthology.orchestra.run.smithi019.stdout:Acquiring lock 140392338124224 on /run/cephadm/61da756e-ea87-11ee-95cd-87774f69a715.lock 2024-03-25T09:10:18.781 INFO:teuthology.orchestra.run.smithi019.stdout:Lock 140392338124224 acquired on /run/cephadm/61da756e-ea87-11ee-95cd-87774f69a715.lock 2024-03-25T09:10:18.782 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying IP 172.21.15.19 port 3300 ... 2024-03-25T09:10:18.782 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying IP 172.21.15.19 port 6789 ... 2024-03-25T09:10:18.782 INFO:teuthology.orchestra.run.smithi019.stdout:Base mon IP(s) is [172.21.15.19:3300, 172.21.15.19:6789], mon addrv is [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-03-25T09:10:18.785 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.19 metric 100 2024-03-25T09:10:18.785 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.19 metric 100 2024-03-25T09:10:18.787 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-25T09:10:18.787 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-03-25T09:10:18.787 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-03-25T09:10:18.790 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-25T09:10:18.791 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-25T09:10:18.791 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-25T09:10:18.791 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-03-25T09:10:18.791 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-25T09:10:18.791 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-25T09:10:18.791 INFO:teuthology.orchestra.run.smithi019.stdout:Mon IP `172.21.15.19` is in CIDR network `172.21.0.0/20` 2024-03-25T09:10:18.791 INFO:teuthology.orchestra.run.smithi019.stdout:Mon IP `172.21.15.19` is in CIDR network `172.21.0.0/20` 2024-03-25T09:10:18.791 INFO:teuthology.orchestra.run.smithi019.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-25T09:10:18.792 INFO:teuthology.orchestra.run.smithi019.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-25T09:10:18.792 INFO:teuthology.orchestra.run.smithi019.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4... 2024-03-25T09:10:19.453 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da 2024-03-25T09:10:19.453 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4... 2024-03-25T09:10:19.453 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Getting image source signatures 2024-03-25T09:10:19.453 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying blob sha256:160ed06b772aa1cc43e1df1fc831799d21050c0c019f44452429ae37514a6690 2024-03-25T09:10:19.454 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying blob sha256:f58b4670ef4403d11d1c912aa26a4dbcf73447df5302e9dc66f6a7fc0d9d1e47 2024-03-25T09:10:19.454 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying config sha256:57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da 2024-03-25T09:10:19.454 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-25T09:10:20.341 INFO:teuthology.orchestra.run.smithi019.stdout:ceph: stdout ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:10:20.341 INFO:teuthology.orchestra.run.smithi019.stdout:Ceph version: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:10:20.341 INFO:teuthology.orchestra.run.smithi019.stdout:Extracting ceph user uid/gid from container image... 2024-03-25T09:10:21.282 INFO:teuthology.orchestra.run.smithi019.stdout:stat: stdout 167 167 2024-03-25T09:10:21.282 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial keys... 2024-03-25T09:10:22.103 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQB9PwFmFUNAIxAAooOBk5TXAhmsLgKgxsmrqg== 2024-03-25T09:10:22.934 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQB+PwFm0iAhGBAAbsSRSlEelA54K2o3TTuCLA== 2024-03-25T09:10:23.882 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQB/PwFmPSKiEBAAOw07IDV0YWk1BTR4qDcF2A== 2024-03-25T09:10:23.883 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial monmap... 2024-03-25T09:10:24.922 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-25T09:10:24.922 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-25T09:10:24.922 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:10:24.922 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool for a [v2:172.21.15.19:3300,v1:172.21.15.19:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-03-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: set fsid to 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi019.stdout:Creating mon... 2024-03-25T09:10:25.853 INFO:teuthology.orchestra.run.smithi019.stdout:create mon.a on 2024-03-25T09:10:26.079 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-25T09:10:26.230 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-25T09:10:26.409 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-61da756e-ea87-11ee-95cd-87774f69a715.target → /etc/systemd/system/ceph-61da756e-ea87-11ee-95cd-87774f69a715.target. 2024-03-25T09:10:26.409 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-61da756e-ea87-11ee-95cd-87774f69a715.target → /etc/systemd/system/ceph-61da756e-ea87-11ee-95cd-87774f69a715.target. 2024-03-25T09:10:26.681 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.a 2024-03-25T09:10:26.681 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to reset failed state of unit ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.a.service: Unit ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.a.service not loaded. 2024-03-25T09:10:26.846 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-61da756e-ea87-11ee-95cd-87774f69a715.target.wants/ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.a.service → /etc/systemd/system/ceph-61da756e-ea87-11ee-95cd-87774f69a715@.service. 2024-03-25T09:10:27.353 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-25T09:10:27.353 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-03-25T09:10:27.363 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-25T09:10:27.364 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-03-25T09:10:27.364 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-03-25T09:10:27.364 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to enable service . firewalld.service is not available 2024-03-25T09:10:27.364 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mon to start... 2024-03-25T09:10:27.364 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mon... 2024-03-25T09:10:28.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:28 smithi019 ceph-mon[29015]: from='client.? 172.21.15.19:0/657329517' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-03-25T09:10:28.516 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout cluster: 2024-03-25T09:10:28.516 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout id: 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:10:28.516 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-25T09:10:28.516 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:28.516 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout services: 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.512905s) 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout data: 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout pgs: 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:mon is available 2024-03-25T09:10:28.517 INFO:teuthology.orchestra.run.smithi019.stdout:Assimilating anything we can from ceph.conf... 2024-03-25T09:10:29.593 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:29 smithi019 ceph-mon[29015]: from='client.? 172.21.15.19:0/171511662' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-03-25T09:10:29.594 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:29 smithi019 ceph-mon[29015]: from='client.? 172.21.15.19:0/171511662' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-25T09:10:29.598 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:29.598 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [global] 2024-03-25T09:10:29.598 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout fsid = 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:10:29.598 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-03-25T09:10:29.598 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-25T09:10:29.598 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-25T09:10:29.598 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-25T09:10:29.598 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-25T09:10:29.598 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:29.598 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-25T09:10:29.599 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-25T09:10:29.599 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:29.599 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [osd] 2024-03-25T09:10:29.599 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-25T09:10:29.599 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-25T09:10:29.599 INFO:teuthology.orchestra.run.smithi019.stdout:Generating new minimal ceph.conf... 2024-03-25T09:10:30.583 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-mon[29015]: from='client.? 172.21.15.19:0/3159375906' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:10:30.586 INFO:teuthology.orchestra.run.smithi019.stdout:Restarting the monitor... 2024-03-25T09:10:30.904 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 systemd[1]: Stopping Ceph mon.a for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:10:31.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:30.902+0000 7f75bdd07700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f75bdd07700 time 2024-03-25T09:10:30.904264+0000 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:30.902+0000 7f75bdd07700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75c61663db] 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f75c61665a1] 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55b0adb70cb6] 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55b0adc58cd2] 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 5: (Monitor::shutdown()+0x2bc) [0x55b0adb4153c] 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 6: (SignalHandler::entry()+0x659) [0x55b0ade23cb9] 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f75c394d1ca] 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 8: clone() 2024-03-25T09:10:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:30.904+0000 7f75bdd07700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f75bdd07700 time 2024-03-25T09:10:30.904264+0000 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75c61663db] 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f75c61665a1] 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55b0adb70cb6] 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55b0adc58cd2] 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 5: (Monitor::shutdown()+0x2bc) [0x55b0adb4153c] 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 6: (SignalHandler::entry()+0x659) [0x55b0ade23cb9] 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f75c394d1ca] 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 8: clone() 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.161 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: *** Caught signal (Aborted) ** 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: in thread 7f75bdd07700 thread_name:signal_handler 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75c3957d20] 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2: gsignal() 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 3: abort() 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75c6166435] 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f75c61665a1] 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55b0adb70cb6] 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55b0adc58cd2] 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 8: (Monitor::shutdown()+0x2bc) [0x55b0adb4153c] 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 9: (SignalHandler::entry()+0x659) [0x55b0ade23cb9] 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f75c394d1ca] 2024-03-25T09:10:31.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 11: clone() 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:30.905+0000 7f75bdd07700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: in thread 7f75bdd07700 thread_name:signal_handler 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75c3957d20] 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2: gsignal() 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 3: abort() 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75c6166435] 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f75c61665a1] 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55b0adb70cb6] 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55b0adc58cd2] 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 8: (Monitor::shutdown()+0x2bc) [0x55b0adb4153c] 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 9: (SignalHandler::entry()+0x659) [0x55b0ade23cb9] 2024-03-25T09:10:31.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f75c394d1ca] 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 11: clone() 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: -23> 2024-03-25T09:10:30.902+0000 7f75bdd07700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: -22> 2024-03-25T09:10:30.902+0000 7f75bdd07700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: -1> 2024-03-25T09:10:30.904+0000 7f75bdd07700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f75bdd07700 time 2024-03-25T09:10:30.904264+0000 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75c61663db] 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f75c61665a1] 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55b0adb70cb6] 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55b0adc58cd2] 2024-03-25T09:10:31.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 5: (Monitor::shutdown()+0x2bc) [0x55b0adb4153c] 2024-03-25T09:10:31.165 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 6: (SignalHandler::entry()+0x659) [0x55b0ade23cb9] 2024-03-25T09:10:31.165 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f75c394d1ca] 2024-03-25T09:10:31.165 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 8: clone() 2024-03-25T09:10:31.165 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.165 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 0> 2024-03-25T09:10:30.905+0000 7f75bdd07700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:10:31.165 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: in thread 7f75bdd07700 thread_name:signal_handler 2024-03-25T09:10:31.165 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.165 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:10:31.165 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75c3957d20] 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2: gsignal() 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 3: abort() 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75c6166435] 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f75c61665a1] 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55b0adb70cb6] 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55b0adc58cd2] 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 8: (Monitor::shutdown()+0x2bc) [0x55b0adb4153c] 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 9: (SignalHandler::entry()+0x659) [0x55b0ade23cb9] 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f75c394d1ca] 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 11: clone() 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: -23> 2024-03-25T09:10:30.902+0000 7f75bdd07700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:10:31.166 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: -22> 2024-03-25T09:10:30.902+0000 7f75bdd07700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: -1> 2024-03-25T09:10:30.904+0000 7f75bdd07700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f75bdd07700 time 2024-03-25T09:10:30.904264+0000 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75c61663db] 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f75c61665a1] 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55b0adb70cb6] 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55b0adc58cd2] 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 5: (Monitor::shutdown()+0x2bc) [0x55b0adb4153c] 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 6: (SignalHandler::entry()+0x659) [0x55b0ade23cb9] 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f75c394d1ca] 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 8: clone() 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 0> 2024-03-25T09:10:30.905+0000 7f75bdd07700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: in thread 7f75bdd07700 thread_name:signal_handler 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75c3957d20] 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2: gsignal() 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 3: abort() 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75c6166435] 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f75c61665a1] 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55b0adb70cb6] 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55b0adc58cd2] 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 8: (Monitor::shutdown()+0x2bc) [0x55b0adb4153c] 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 9: (SignalHandler::entry()+0x659) [0x55b0ade23cb9] 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f75c394d1ca] 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 11: clone() 2024-03-25T09:10:31.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:10:31.169 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29011]: 2024-03-25T09:10:31.169 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:30 smithi019 podman[29261]: 2024-03-25 09:10:30.924348884 +0000 UTC m=+0.172844835 container died aafcc5cb1f6af1c403229fc186be2ea45749a99074d796fe12914d766a8978d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=ceph-nvmeof-mon-47ea673, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307) 2024-03-25T09:10:31.645 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:31 smithi019 podman[29261]: 2024-03-25 09:10:31.395466357 +0000 UTC m=+0.643962307 container cleanup aafcc5cb1f6af1c403229fc186be2ea45749a99074d796fe12914d766a8978d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-25T09:10:31.645 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:31 smithi019 bash[29261]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a 2024-03-25T09:10:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:31 smithi019 podman[29275]: 2024-03-25 09:10:31.646062552 +0000 UTC m=+0.717396280 container remove aafcc5cb1f6af1c403229fc186be2ea45749a99074d796fe12914d766a8978d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-47ea673, CEPH_POINT_RELEASE=) 2024-03-25T09:10:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:31 smithi019 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.a.service: Main process exited, code=exited, status=134/n/a 2024-03-25T09:10:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:31 smithi019 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.a.service: Failed with result 'exit-code'. 2024-03-25T09:10:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:31 smithi019 systemd[1]: Stopped Ceph mon.a for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:10:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:31 smithi019 systemd[1]: Starting Ceph mon.a for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:10:32.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:32 smithi019 podman[29368]: 2024-03-25 09:10:31.929857031 +0000 UTC m=+0.018919554 image pull 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:10:33.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:33 smithi019 podman[29368]: 2024-03-25 09:10:33.323262526 +0000 UTC m=+1.412325032 container create a34efeb6eefd58a0439146752455174ae3fb865a50b845af477cff7b691cfcfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-47ea673, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307) 2024-03-25T09:10:35.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 podman[29368]: 2024-03-25 09:10:35.12681979 +0000 UTC m=+3.215882311 container init a34efeb6eefd58a0439146752455174ae3fb865a50b845af477cff7b691cfcfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, RELEASE=ceph-nvmeof-mon-47ea673, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-25T09:10:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 podman[29368]: 2024-03-25 09:10:35.130513505 +0000 UTC m=+3.219576013 container start a34efeb6eefd58a0439146752455174ae3fb865a50b845af477cff7b691cfcfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-25T09:10:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: set uid:gid to 167:167 (ceph:ceph) 2024-03-25T09:10:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev), process ceph-mon, pid 2 2024-03-25T09:10:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: pidfile_write: ignore empty --pid-file 2024-03-25T09:10:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: load: jerasure load: lrc 2024-03-25T09:10:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: RocksDB version: 7.9.2 2024-03-25T09:10:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Git sha 0 2024-03-25T09:10:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Compile date 2024-03-12 00:00:24 2024-03-25T09:10:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: DB SUMMARY 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: DB Session ID: 1W2FW2Z3N1AVV1K4BBP2 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: CURRENT file: CURRENT 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: IDENTITY file: IDENTITY 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 84846 ; 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.error_if_exists: 0 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.create_if_missing: 0 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.paranoid_checks: 1 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-25T09:10:35.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.env: 0x5652f3217ea0 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.fs: PosixFileSystem 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.info_log: 0x5652f59c9920 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_file_opening_threads: 16 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.statistics: (nil) 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.use_fsync: 0 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_log_file_size: 0 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.keep_log_file_num: 1000 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.recycle_log_file_num: 0 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.allow_fallocate: 1 2024-03-25T09:10:35.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.allow_mmap_reads: 0 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.allow_mmap_writes: 0 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.use_direct_reads: 0 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.create_missing_column_families: 0 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.db_log_dir: 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.wal_dir: 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-25T09:10:35.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.advise_random_on_open: 1 2024-03-25T09:10:35.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.db_write_buffer_size: 0 2024-03-25T09:10:35.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.write_buffer_manager: 0x5652f599d400 2024-03-25T09:10:35.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-25T09:10:35.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-25T09:10:35.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-25T09:10:35.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.rate_limiter: (nil) 2024-03-25T09:10:35.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-25T09:10:35.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.wal_recovery_mode: 2 2024-03-25T09:10:35.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.enable_thread_tracking: 0 2024-03-25T09:10:35.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.enable_pipelined_write: 0 2024-03-25T09:10:35.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.unordered_write: 0 2024-03-25T09:10:35.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-25T09:10:35.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-25T09:10:35.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-25T09:10:35.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-25T09:10:35.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.row_cache: None 2024-03-25T09:10:35.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.wal_filter: None 2024-03-25T09:10:35.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.allow_ingest_behind: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.two_write_queues: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.manual_wal_flush: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.wal_compression: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.atomic_flush: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.log_readahead_size: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.best_efforts_recovery: 0 2024-03-25T09:10:35.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.allow_data_in_errors: 0 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.db_host_id: __hostname__ 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_background_jobs: 2 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_background_compactions: -1 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_subcompactions: 1 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_total_wal_size: 0 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-25T09:10:35.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_open_files: -1 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bytes_per_sync: 0 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_readahead_size: 0 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_background_flushes: -1 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Compression algorithms supported: 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: kZSTD supported: 0 2024-03-25T09:10:35.418 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: kXpressCompression supported: 0 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: kLZ4HCCompression supported: 1 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: kZlibCompression supported: 1 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: kSnappyCompression supported: 1 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: kLZ4Compression supported: 1 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: kBZip2Compression supported: 0 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.merge_operator: 2024-03-25T09:10:35.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_filter: None 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_filter_factory: None 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.sst_partitioner_factory: None 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5652f59c9a20) 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout: cache_index_and_filter_blocks: 1 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout: pin_top_level_index_and_filter: 1 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_type: 0 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout: data_block_index_type: 0 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_shortening: 1 2024-03-25T09:10:35.420 INFO:journalctl@ceph.mon.a.smithi019.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: checksum: 4 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: no_block_cache: 0 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache: 0x5652f59cf090 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_name: BinnedLRUCache 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_options: 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: capacity : 536870912 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: num_shard_bits : 4 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: strict_capacity_limit : 0 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: high_pri_pool_ratio: 0.000 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_compressed: (nil) 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: persistent_cache: (nil) 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_size: 4096 2024-03-25T09:10:35.421 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_size_deviation: 10 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_restart_interval: 16 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_block_restart_interval: 1 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: metadata_block_size: 4096 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: partition_filters: 0 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: use_delta_encoding: 1 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: filter_policy: bloomfilter 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: whole_key_filtering: 1 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: verify_compression: 0 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: read_amp_bytes_per_bit: 0 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: format_version: 5 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: enable_index_compression: 1 2024-03-25T09:10:35.422 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_align: 0 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout: max_auto_readahead_size: 262144 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout: prepopulate_block_cache: 0 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout: initial_auto_readahead_size: 8192 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout: num_file_reads_for_auto_readahead: 2 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.write_buffer_size: 33554432 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_write_buffer_number: 2 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compression: NoCompression 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bottommost_compression: Disabled 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.prefix_extractor: nullptr 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.num_levels: 7 2024-03-25T09:10:35.423 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-25T09:10:35.424 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compression_opts.level: 32767 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compression_opts.strategy: 0 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compression_opts.enabled: false 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-25T09:10:35.425 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-25T09:10:35.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.target_file_size_base: 67108864 2024-03-25T09:10:35.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-25T09:10:35.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-25T09:10:35.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-25T09:10:35.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-25T09:10:35.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-25T09:10:35.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-25T09:10:35.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-25T09:10:35.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-25T09:10:35.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.arena_block_size: 1048576 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.disable_auto_compactions: 0 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-25T09:10:35.427 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.table_properties_collectors: 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.inplace_update_support: 0 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-25T09:10:35.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.bloom_locality: 0 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.max_successive_merges: 0 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.paranoid_file_checks: 0 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.force_consistency_checks: 1 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.report_bg_io_stats: 0 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.ttl: 2592000 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-25T09:10:35.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.enable_blob_files: false 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.min_blob_size: 0 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.blob_file_size: 268435456 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.blob_file_starting_level: 0 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-25T09:10:35.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fa217974-af29-46d3-b596-605360c5d4c5 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711357835164473, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711357835165525, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 81451, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 255, "table_properties": {"data_size": 79638, "index_size": 223, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10096, "raw_average_key_size": 47, "raw_value_size": 73913, "raw_average_value_size": 345, "num_data_blocks": 10, "num_entries": 214, "num_filter_entries": 214, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711357835, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fa217974-af29-46d3-b596-605360c5d4c5", "db_session_id": "1W2FW2Z3N1AVV1K4BBP2", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711357835165622, "job": 1, "event": "recovery_finished"} 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5652f5ac2000 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: DB pointer 0x5652f5aac000 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-25T09:10:35.431 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** DB Stats ** 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** Compaction Stats [default] ** 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-25T09:10:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout: L0 2/0 81.38 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: Sum 2/0 81.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** Compaction Stats [default] ** 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 107.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-25T09:10:35.433 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative compaction: 0.00 GB write, 20.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval compaction: 0.00 GB write, 20.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout: Block cache BinnedLRUCache@0x5652f59cf090#2 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: starting mon.a rank 0 at public addrs [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] at bind addrs [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:10:35.434 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: mon.a@-1(???) e1 preinit fsid 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: mon.a@-1(???).mds e1 new map 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: mon.a@-1(???).mds e1 print_map 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout: e1 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout: legacy client fscid: -1 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout: No filesystems configured 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-25T09:10:35.435 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-25T09:10:35.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-25T09:10:35.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-25T09:10:35.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: monmap e1: 1 mons at {a=[v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-25T09:10:35.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: fsmap 2024-03-25T09:10:35.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: osdmap e1: 0 total, 0 up, 0 in 2024-03-25T09:10:35.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 ceph-mon[29386]: mgrmap e1: no daemons active 2024-03-25T09:10:35.948 INFO:teuthology.orchestra.run.smithi019.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-25T09:10:36.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 bash[29368]: a34efeb6eefd58a0439146752455174ae3fb865a50b845af477cff7b691cfcfe 2024-03-25T09:10:36.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:35 smithi019 systemd[1]: Started Ceph mon.a for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:10:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:39 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2736095401' entity='client.admin' 2024-03-25T09:10:40.950 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-25T09:10:40.970 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:10:40.971 INFO:teuthology.orchestra.run.smithi019.stdout:Creating mgr... 2024-03-25T09:10:40.971 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-25T09:10:40.971 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-25T09:10:41.232 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-61da756e-ea87-11ee-95cd-87774f69a715@mgr.x 2024-03-25T09:10:41.232 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to reset failed state of unit ceph-61da756e-ea87-11ee-95cd-87774f69a715@mgr.x.service: Unit ceph-61da756e-ea87-11ee-95cd-87774f69a715@mgr.x.service not loaded. 2024-03-25T09:10:41.376 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-61da756e-ea87-11ee-95cd-87774f69a715.target.wants/ceph-61da756e-ea87-11ee-95cd-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-61da756e-ea87-11ee-95cd-87774f69a715@.service. 2024-03-25T09:10:41.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:41 smithi019 podman[29620]: 2024-03-25 09:10:41.517596073 +0000 UTC m=+0.017540245 image pull 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 2024-03-25T09:10:41.922 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-25T09:10:41.925 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-03-25T09:10:41.929 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-25T09:10:41.930 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-03-25T09:10:41.930 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-03-25T09:10:41.930 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to enable service . firewalld.service is not available 2024-03-25T09:10:41.938 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-25T09:10:41.938 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-03-25T09:10:41.945 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-25T09:10:41.945 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-03-25T09:10:41.945 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-03-25T09:10:41.945 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-25T09:10:41.945 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr to start... 2024-03-25T09:10:41.945 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr... 2024-03-25T09:10:42.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:41 smithi019 podman[29620]: 2024-03-25 09:10:41.800920024 +0000 UTC m=+0.300864193 container init c5caafa6dd4bd61dbf53d3dd46ed9166ffb7a5d5a11d6e44e9f13e390b30c270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, ceph=True) 2024-03-25T09:10:42.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:41 smithi019 podman[29620]: 2024-03-25 09:10:41.803281557 +0000 UTC m=+0.303225714 container start c5caafa6dd4bd61dbf53d3dd46ed9166ffb7a5d5a11d6e44e9f13e390b30c270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.build-date=20240307, GIT_CLEAN=True) 2024-03-25T09:10:42.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:41 smithi019 bash[29620]: c5caafa6dd4bd61dbf53d3dd46ed9166ffb7a5d5a11d6e44e9f13e390b30c270 2024-03-25T09:10:42.069 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:41 smithi019 systemd[1]: Started Ceph mgr.x for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:10:42.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:42 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/3579880281' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-03-25T09:10:42.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:42.364+0000 7fcc131b9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-25T09:10:42.659 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:42.460+0000 7fcc131b9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-25T09:10:43.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:43.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-03-25T09:10:43.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "61da756e-ea87-11ee-95cd-87774f69a715", 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-25T09:10:43.016 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-25T09:10:43.017 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-25T09:10:43.018 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-03-25T09:10:27.343910+0000", 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-03-25T09:10:43.019 INFO:teuthology.orchestra.run.smithi019.stdout:mgr not available, waiting (1/15)... 2024-03-25T09:10:43.408 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:43.134+0000 7fcc131b9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-25T09:10:43.408 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:43.227+0000 7fcc131b9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-25T09:10:43.408 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:43.370+0000 7fcc131b9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-25T09:10:43.818 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:43.467+0000 7fcc131b9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-25T09:10:43.819 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:43.551+0000 7fcc131b9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-25T09:10:43.819 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:43.817+0000 7fcc131b9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-25T09:10:44.113 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:43.929+0000 7fcc131b9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-25T09:10:44.113 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:44.016+0000 7fcc131b9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-25T09:10:44.113 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:44.112+0000 7fcc131b9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-25T09:10:44.408 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:44.290+0000 7fcc131b9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-25T09:10:45.408 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:45.299+0000 7fcc131b9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-25T09:10:45.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:45 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/3429286003' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-03-25T09:10:45.778 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:45.434+0000 7fcc131b9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-25T09:10:45.778 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:45.776+0000 7fcc131b9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-25T09:10:46.119 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:45.868+0000 7fcc131b9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-25T09:10:46.119 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:46.067+0000 7fcc131b9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-25T09:10:46.408 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:46.254+0000 7fcc131b9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-25T09:10:46.806 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:46.542+0000 7fcc131b9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-25T09:10:46.806 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:46.805+0000 7fcc131b9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-25T09:10:47.158 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:47.047+0000 7fcc131b9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-25T09:10:48.158 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:47.871+0000 7fcc131b9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-25T09:10:48.557 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:48.456+0000 7fcc131b9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-25T09:10:48.557 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:48.556+0000 7fcc131b9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-25T09:10:48.675 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:48.683 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-03-25T09:10:48.683 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "61da756e-ea87-11ee-95cd-87774f69a715", 2024-03-25T09:10:48.683 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-03-25T09:10:48.683 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-25T09:10:48.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-25T09:10:48.685 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-25T09:10:48.686 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-03-25T09:10:27.343910+0000", 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-03-25T09:10:48.687 INFO:teuthology.orchestra.run.smithi019.stdout:mgr not available, waiting (2/15)... 2024-03-25T09:10:48.844 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:48.778+0000 7fcc131b9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-25T09:10:49.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: Activating manager daemon x 2024-03-25T09:10:49.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: mgrmap e2: x(active, starting, since 0.00302329s) 2024-03-25T09:10:49.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: from='mgr.14100 172.21.15.19:0/2885148625' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-03-25T09:10:49.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: from='mgr.14100 172.21.15.19:0/2885148625' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-03-25T09:10:49.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: from='mgr.14100 172.21.15.19:0/2885148625' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-03-25T09:10:49.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: from='mgr.14100 172.21.15.19:0/2885148625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:10:49.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: from='mgr.14100 172.21.15.19:0/2885148625' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-03-25T09:10:49.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: Manager daemon x is now available 2024-03-25T09:10:49.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: from='mgr.14100 172.21.15.19:0/2885148625' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-03-25T09:10:49.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: from='mgr.14100 172.21.15.19:0/2885148625' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-03-25T09:10:49.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: from='mgr.14100 172.21.15.19:0/2885148625' entity='mgr.x' 2024-03-25T09:10:49.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: from='mgr.14100 172.21.15.19:0/2885148625' entity='mgr.x' 2024-03-25T09:10:49.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:48 smithi019 ceph-mon[29386]: from='mgr.14100 172.21.15.19:0/2885148625' entity='mgr.x' 2024-03-25T09:10:51.085 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:50 smithi019 ceph-mon[29386]: mgrmap e3: x(active, since 1.00727s) 2024-03-25T09:10:51.972 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "61da756e-ea87-11ee-95cd-87774f69a715", 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-25T09:10:51.973 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-25T09:10:51.975 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-25T09:10:51.976 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:51.977 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-25T09:10:51.977 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-25T09:10:51.977 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-03-25T09:10:27.343910+0000", 2024-03-25T09:10:51.977 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-25T09:10:51.977 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-03-25T09:10:51.977 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-25T09:10:51.977 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-03-25T09:10:51.977 INFO:teuthology.orchestra.run.smithi019.stdout:mgr is available 2024-03-25T09:10:52.089 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:51 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/317967039' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-03-25T09:10:53.086 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:52 smithi019 ceph-mon[29386]: mgrmap e4: x(active, since 3s) 2024-03-25T09:10:53.086 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:52 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/171799717' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-03-25T09:10:53.090 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:53.090 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [global] 2024-03-25T09:10:53.090 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout fsid = 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:10:53.090 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-25T09:10:53.090 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-25T09:10:53.090 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-25T09:10:53.091 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-25T09:10:53.091 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:53.091 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-25T09:10:53.091 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-25T09:10:53.091 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-03-25T09:10:53.091 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [osd] 2024-03-25T09:10:53.091 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-25T09:10:53.091 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-25T09:10:53.091 INFO:teuthology.orchestra.run.smithi019.stdout:Enabling cephadm module... 2024-03-25T09:10:54.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:53 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2765318932' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-03-25T09:10:54.158 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: ignoring --setuser ceph since I am not root 2024-03-25T09:10:54.158 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: ignoring --setgroup ceph since I am not root 2024-03-25T09:10:54.477 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:54.370+0000 7fdd55f20200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-25T09:10:54.796 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:54.476+0000 7fdd55f20200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-25T09:10:55.108 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:54 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2765318932' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-25T09:10:55.108 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:54 smithi019 ceph-mon[29386]: mgrmap e5: x(active, since 5s) 2024-03-25T09:10:55.394 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:55.155+0000 7fdd55f20200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-25T09:10:55.394 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:55.249+0000 7fdd55f20200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-25T09:10:55.394 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:55.393+0000 7fdd55f20200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-25T09:10:55.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:55.491+0000 7fdd55f20200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-25T09:10:55.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:55.575+0000 7fdd55f20200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-25T09:10:55.703 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-03-25T09:10:55.703 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-25T09:10:55.703 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-25T09:10:55.703 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-25T09:10:55.703 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-25T09:10:55.704 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-03-25T09:10:55.704 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for the mgr to restart... 2024-03-25T09:10:55.704 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr epoch 5... 2024-03-25T09:10:55.963 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:10:55 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/453382575' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-03-25T09:10:55.963 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:55.847+0000 7fdd55f20200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-25T09:10:55.963 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:55.962+0000 7fdd55f20200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-25T09:10:56.329 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:56.051+0000 7fdd55f20200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-25T09:10:56.329 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:56.151+0000 7fdd55f20200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-25T09:10:56.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:56.329+0000 7fdd55f20200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-25T09:10:57.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:57.315+0000 7fdd55f20200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-25T09:10:57.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:57.448+0000 7fdd55f20200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-25T09:10:58.075 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:57.785+0000 7fdd55f20200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-25T09:10:58.076 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:57.877+0000 7fdd55f20200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-25T09:10:58.076 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:58.076+0000 7fdd55f20200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-25T09:10:58.408 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:58.264+0000 7fdd55f20200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-25T09:10:58.816 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:58.554+0000 7fdd55f20200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-25T09:10:58.816 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:58.816+0000 7fdd55f20200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-25T09:10:59.158 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:59.057+0000 7fdd55f20200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-25T09:11:00.158 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:10:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:10:59.882+0000 7fdd55f20200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-25T09:11:00.784 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:00.465+0000 7fdd55f20200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-25T09:11:00.784 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:00.565+0000 7fdd55f20200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-25T09:11:00.784 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:00.784+0000 7fdd55f20200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-25T09:11:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: Active manager daemon x restarted 2024-03-25T09:11:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: Activating manager daemon x 2024-03-25T09:11:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: osdmap e2: 0 total, 0 up, 0 in 2024-03-25T09:11:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: mgrmap e6: x(active, starting, since 0.0035579s) 2024-03-25T09:11:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:11:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-03-25T09:11:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-03-25T09:11:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-03-25T09:11:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-03-25T09:11:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: Manager daemon x is now available 2024-03-25T09:11:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:00 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:02.114 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:01 smithi019 ceph-mon[29386]: Found migration_current of "None". Setting to last migration. 2024-03-25T09:11:02.115 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:01 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:02.115 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:01 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-03-25T09:11:02.115 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:01 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-03-25T09:11:02.116 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:01 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:02.116 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:01 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:02.116 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:01 smithi019 ceph-mon[29386]: mgrmap e7: x(active, since 1.00656s) 2024-03-25T09:11:02.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-03-25T09:11:02.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-25T09:11:02.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-25T09:11:02.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-03-25T09:11:02.377 INFO:teuthology.orchestra.run.smithi019.stdout:mgr epoch 5 is available 2024-03-25T09:11:02.377 INFO:teuthology.orchestra.run.smithi019.stdout:Setting orchestrator backend to cephadm... 2024-03-25T09:11:02.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:02 smithi019 ceph-mon[29386]: [25/Mar/2024:09:11:01] ENGINE Bus STARTING 2024-03-25T09:11:02.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:02 smithi019 ceph-mon[29386]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-25T09:11:02.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:02 smithi019 ceph-mon[29386]: [25/Mar/2024:09:11:01] ENGINE Serving on https://172.21.15.19:7150 2024-03-25T09:11:02.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:02 smithi019 ceph-mon[29386]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-25T09:11:02.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:02 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:03.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:03 smithi019 ceph-mon[29386]: [25/Mar/2024:09:11:01] ENGINE Serving on http://172.21.15.19:8765 2024-03-25T09:11:03.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:03 smithi019 ceph-mon[29386]: [25/Mar/2024:09:11:01] ENGINE Bus STARTED 2024-03-25T09:11:03.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:03 smithi019 ceph-mon[29386]: mgrmap e8: x(active, since 2s) 2024-03-25T09:11:03.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:03 smithi019 ceph-mon[29386]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:03.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:03 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:03.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:03 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:04.756 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-25T09:11:04.756 INFO:teuthology.orchestra.run.smithi019.stdout:Generating ssh key... 2024-03-25T09:11:05.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:04 smithi019 ceph-mon[29386]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:05.951 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: Generating public/private rsa key pair. 2024-03-25T09:11:05.951 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: Your identification has been saved in /tmp/tmpujv1r139/key. 2024-03-25T09:11:05.951 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: Your public key has been saved in /tmp/tmpujv1r139/key.pub. 2024-03-25T09:11:05.951 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: The key fingerprint is: 2024-03-25T09:11:05.951 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: SHA256:cB/HH9WiY5gY822Aiq7NaDhYIOHbxTsghgqKdcW3BQU ceph-61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: The key's randomart image is: 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: +---[RSA 3072]----+ 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: | . E=. o| 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: |. o = o. ...| 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: |o. .o.o.B.=o... | 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: |=+..oo.oo.+o*. . | 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: |Bo+oo . S .o .. | 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: |+....o | 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: |.o = . | 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: |+ + o | 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: | o | 2024-03-25T09:11:05.952 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: +----[SHA256]-----+ 2024-03-25T09:11:06.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:06 smithi019 ceph-mon[29386]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:06.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:06 smithi019 ceph-mon[29386]: Generating ssh key... 2024-03-25T09:11:06.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:06 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:06.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:06 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:07.412 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJdjLe64E4uSzlyFKyn9bmRQbXN2eB62y0nRDaNFGBSzwp80zzlbAzG7i8JYKQKP00Wpqomn2j1Pc2xEKei2qg54vplcgf3QLYiPOE2Z6HuqG7I88BVnPya7M4+KKDM+pNx92Y0mzzJjaQ3BxbkSBbnMNS7TORssqR5RBpsTb7NdNVcjUyVbPqLG4eI6tNXdVW6ABVGmxN6Uy/dP8g10vjYm6l4pDBF9sh8ne2haUidC4WuimhFsawNaFSQq7ZZxF7e/ywZebBgZdcI5ImG0rd1eTz+/tGbZRpTVTzAeaY3CBDkxN74UERLEWi6fUldxi8wIoi/ajM9u7LNfC+sNIKsAFWcpjuHOgOrXTRJHJwQfZtVdc6SIlk4tN2NJ2r9dkcPXy6xGnivHWhqSUvNvWrxEfrO4hK1T9JEKZvrSwC1DCuXpXhqlcm5qy0oiOTpHP0TGDuRAbuqi5IBPRhL0CIKebGD2GWBpXAhFGfoPQRJe649A7MQVE1XmEFru8598M= ceph-61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:11:07.412 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-25T09:11:07.412 INFO:teuthology.orchestra.run.smithi019.stdout:Adding key to root@localhost authorized_keys... 2024-03-25T09:11:07.413 INFO:teuthology.orchestra.run.smithi019.stdout:Adding host smithi019... 2024-03-25T09:11:08.089 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:07 smithi019 ceph-mon[29386]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:09.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:08 smithi019 ceph-mon[29386]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi019", "addr": "172.21.15.19", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:09.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:08 smithi019 ceph-mon[29386]: Deploying cephadm binary to smithi019 2024-03-25T09:11:12.870 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Added host 'smithi019' with addr '172.21.15.19' 2024-03-25T09:11:12.870 INFO:teuthology.orchestra.run.smithi019.stdout:Deploying unmanaged mon service... 2024-03-25T09:11:13.640 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:13 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:13.640 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:13 smithi019 ceph-mon[29386]: Added host smithi019 2024-03-25T09:11:13.640 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:13 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:14.658 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-25T09:11:14.658 INFO:teuthology.orchestra.run.smithi019.stdout:Deploying unmanaged mgr service... 2024-03-25T09:11:14.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:14 smithi019 ceph-mon[29386]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:14.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:14 smithi019 ceph-mon[29386]: Saving service mon spec with placement count:5 2024-03-25T09:11:14.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:14 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:16.323 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:16 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:16.323 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:16 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:16.323 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:16 smithi019 ceph-mon[29386]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:16.324 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:16 smithi019 ceph-mon[29386]: Saving service mgr spec with placement count:2 2024-03-25T09:11:16.324 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:16 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:16.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-25T09:11:18.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:17 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/929814999' entity='client.admin' 2024-03-25T09:11:19.117 INFO:teuthology.orchestra.run.smithi019.stdout:Enabling the dashboard module... 2024-03-25T09:11:19.372 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:19 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:19.372 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:19 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/330612458' entity='client.admin' 2024-03-25T09:11:21.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:20 smithi019 ceph-mon[29386]: from='mgr.14118 172.21.15.19:0/626337213' entity='mgr.x' 2024-03-25T09:11:21.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:20 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/582872899' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-03-25T09:11:21.159 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: ignoring --setuser ceph since I am not root 2024-03-25T09:11:21.159 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: ignoring --setgroup ceph since I am not root 2024-03-25T09:11:21.527 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:21.431+0000 7fcd12650200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-25T09:11:21.527 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:21.527+0000 7fcd12650200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-25T09:11:22.107 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:21 smithi019 ceph-mon[29386]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:11:22.107 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:21 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/582872899' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-25T09:11:22.107 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:21 smithi019 ceph-mon[29386]: mgrmap e9: x(active, since 20s) 2024-03-25T09:11:22.400 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:22.206+0000 7fcd12650200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-25T09:11:22.400 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:22.302+0000 7fcd12650200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-25T09:11:22.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:22.457+0000 7fcd12650200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-25T09:11:22.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:22.555+0000 7fcd12650200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-25T09:11:22.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:22.641+0000 7fcd12650200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-25T09:11:22.964 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-03-25T09:11:22.964 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-25T09:11:22.964 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-25T09:11:22.964 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-25T09:11:22.965 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-25T09:11:22.965 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-03-25T09:11:22.965 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for the mgr to restart... 2024-03-25T09:11:22.965 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr epoch 9... 2024-03-25T09:11:23.086 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:22 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/431905157' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-03-25T09:11:23.086 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:22.915+0000 7fcd12650200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-25T09:11:23.086 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:23.031+0000 7fcd12650200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-25T09:11:23.388 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:23.119+0000 7fcd12650200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-25T09:11:23.389 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:23.219+0000 7fcd12650200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-25T09:11:23.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:23.399+0000 7fcd12650200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-25T09:11:24.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:24.385+0000 7fcd12650200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-25T09:11:24.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:24.519+0000 7fcd12650200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-25T09:11:25.148 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:24.856+0000 7fcd12650200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-25T09:11:25.149 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:24.948+0000 7fcd12650200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-25T09:11:25.149 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:25.149+0000 7fcd12650200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-25T09:11:25.408 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:25.337+0000 7fcd12650200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-25T09:11:25.889 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:25.628+0000 7fcd12650200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-25T09:11:25.889 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:25.889+0000 7fcd12650200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-25T09:11:26.158 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:26.131+0000 7fcd12650200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-25T09:11:27.410 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:26.956+0000 7fcd12650200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-25T09:11:27.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:27.539+0000 7fcd12650200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-25T09:11:27.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:27.639+0000 7fcd12650200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-25T09:11:27.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:11:27.860+0000 7fcd12650200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-25T09:11:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: Active manager daemon x restarted 2024-03-25T09:11:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: Activating manager daemon x 2024-03-25T09:11:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: osdmap e3: 0 total, 0 up, 0 in 2024-03-25T09:11:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: mgrmap e10: x(active, starting, since 0.00292979s) 2024-03-25T09:11:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:11:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-03-25T09:11:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-03-25T09:11:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-03-25T09:11:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-03-25T09:11:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: Manager daemon x is now available 2024-03-25T09:11:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:29.103 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-03-25T09:11:29.103 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-03-25T09:11:29.103 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:28 smithi019 ceph-mon[29386]: [25/Mar/2024:09:11:28] ENGINE Bus STARTING 2024-03-25T09:11:29.103 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:28 smithi019 ceph-mon[29386]: [25/Mar/2024:09:11:28] ENGINE Serving on https://172.21.15.19:7150 2024-03-25T09:11:29.104 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:28 smithi019 ceph-mon[29386]: [25/Mar/2024:09:11:28] ENGINE Serving on http://172.21.15.19:8765 2024-03-25T09:11:29.104 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:28 smithi019 ceph-mon[29386]: [25/Mar/2024:09:11:28] ENGINE Bus STARTED 2024-03-25T09:11:29.104 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:28 smithi019 ceph-mon[29386]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-25T09:11:29.104 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:28 smithi019 ceph-mon[29386]: mgrmap e11: x(active, since 1.00539s) 2024-03-25T09:11:29.104 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:28 smithi019 ceph-mon[29386]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-25T09:11:29.614 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-03-25T09:11:29.615 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-25T09:11:29.615 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-25T09:11:29.615 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-03-25T09:11:29.615 INFO:teuthology.orchestra.run.smithi019.stdout:mgr epoch 9 is available 2024-03-25T09:11:29.615 INFO:teuthology.orchestra.run.smithi019.stdout:Generating a dashboard self-signed certificate... 2024-03-25T09:11:30.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:30.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:30.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:30.923 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-25T09:11:30.924 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial admin user... 2024-03-25T09:11:31.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:31 smithi019 ceph-mon[29386]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:31.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:31 smithi019 ceph-mon[29386]: mgrmap e12: x(active, since 2s) 2024-03-25T09:11:31.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:31 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:32.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$.HB/WsosjFdgvE.vSXuaW.BL9cgdWGzA6EFMQ7oh0szzBGEMK6mq2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711357891, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-25T09:11:32.506 INFO:teuthology.orchestra.run.smithi019.stdout:Fetching dashboard port number... 2024-03-25T09:11:32.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:32 smithi019 ceph-mon[29386]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:32.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:33.885 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:33 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/909499200' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-03-25T09:11:33.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 8443 2024-03-25T09:11:33.898 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-25T09:11:33.898 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-03-25T09:11:33.906 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-25T09:11:33.906 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-03-25T09:11:33.906 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-03-25T09:11:33.906 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-25T09:11:33.908 INFO:teuthology.orchestra.run.smithi019.stdout:Ceph Dashboard is now available at: 2024-03-25T09:11:33.908 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:33.908 INFO:teuthology.orchestra.run.smithi019.stdout: URL: https://smithi019.front.sepia.ceph.com:8443/ 2024-03-25T09:11:33.908 INFO:teuthology.orchestra.run.smithi019.stdout: User: admin 2024-03-25T09:11:33.908 INFO:teuthology.orchestra.run.smithi019.stdout: Password: xyot14gyxj 2024-03-25T09:11:33.908 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:33.908 INFO:teuthology.orchestra.run.smithi019.stdout:Saving cluster configuration to /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config directory 2024-03-25T09:11:33.909 INFO:teuthology.orchestra.run.smithi019.stdout:Enabling autotune for osd_memory_target 2024-03-25T09:11:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:35 smithi019 ceph-mon[29386]: mgrmap e13: x(active, since 7s) 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout:Or, if you are only running a single cluster on this host: 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-25T09:11:36.518 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:36.519 INFO:teuthology.orchestra.run.smithi019.stdout: ceph telemetry on 2024-03-25T09:11:36.519 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:36.519 INFO:teuthology.orchestra.run.smithi019.stdout:For more information see: 2024-03-25T09:11:36.519 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:36.519 INFO:teuthology.orchestra.run.smithi019.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-25T09:11:36.519 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:36.519 INFO:teuthology.orchestra.run.smithi019.stdout:Bootstrap complete. 2024-03-25T09:11:36.563 INFO:tasks.cephadm:Fetching config... 2024-03-25T09:11:36.564 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:11:36.564 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-25T09:11:36.580 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-25T09:11:36.580 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:11:36.580 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-25T09:11:36.636 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-25T09:11:36.636 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:11:36.636 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/keyring of=/dev/stdout 2024-03-25T09:11:36.704 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-25T09:11:36.704 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:11:36.704 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-25T09:11:36.760 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-25T09:11:36.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJdjLe64E4uSzlyFKyn9bmRQbXN2eB62y0nRDaNFGBSzwp80zzlbAzG7i8JYKQKP00Wpqomn2j1Pc2xEKei2qg54vplcgf3QLYiPOE2Z6HuqG7I88BVnPya7M4+KKDM+pNx92Y0mzzJjaQ3BxbkSBbnMNS7TORssqR5RBpsTb7NdNVcjUyVbPqLG4eI6tNXdVW6ABVGmxN6Uy/dP8g10vjYm6l4pDBF9sh8ne2haUidC4WuimhFsawNaFSQq7ZZxF7e/ywZebBgZdcI5ImG0rd1eTz+/tGbZRpTVTzAeaY3CBDkxN74UERLEWi6fUldxi8wIoi/ajM9u7LNfC+sNIKsAFWcpjuHOgOrXTRJHJwQfZtVdc6SIlk4tN2NJ2r9dkcPXy6xGnivHWhqSUvNvWrxEfrO4hK1T9JEKZvrSwC1DCuXpXhqlcm5qy0oiOTpHP0TGDuRAbuqi5IBPRhL0CIKebGD2GWBpXAhFGfoPQRJe649A7MQVE1XmEFru8598M= ceph-61da756e-ea87-11ee-95cd-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-25T09:11:36.839 INFO:teuthology.orchestra.run.smithi019.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJdjLe64E4uSzlyFKyn9bmRQbXN2eB62y0nRDaNFGBSzwp80zzlbAzG7i8JYKQKP00Wpqomn2j1Pc2xEKei2qg54vplcgf3QLYiPOE2Z6HuqG7I88BVnPya7M4+KKDM+pNx92Y0mzzJjaQ3BxbkSBbnMNS7TORssqR5RBpsTb7NdNVcjUyVbPqLG4eI6tNXdVW6ABVGmxN6Uy/dP8g10vjYm6l4pDBF9sh8ne2haUidC4WuimhFsawNaFSQq7ZZxF7e/ywZebBgZdcI5ImG0rd1eTz+/tGbZRpTVTzAeaY3CBDkxN74UERLEWi6fUldxi8wIoi/ajM9u7LNfC+sNIKsAFWcpjuHOgOrXTRJHJwQfZtVdc6SIlk4tN2NJ2r9dkcPXy6xGnivHWhqSUvNvWrxEfrO4hK1T9JEKZvrSwC1DCuXpXhqlcm5qy0oiOTpHP0TGDuRAbuqi5IBPRhL0CIKebGD2GWBpXAhFGfoPQRJe649A7MQVE1XmEFru8598M= ceph-61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:11:36.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJdjLe64E4uSzlyFKyn9bmRQbXN2eB62y0nRDaNFGBSzwp80zzlbAzG7i8JYKQKP00Wpqomn2j1Pc2xEKei2qg54vplcgf3QLYiPOE2Z6HuqG7I88BVnPya7M4+KKDM+pNx92Y0mzzJjaQ3BxbkSBbnMNS7TORssqR5RBpsTb7NdNVcjUyVbPqLG4eI6tNXdVW6ABVGmxN6Uy/dP8g10vjYm6l4pDBF9sh8ne2haUidC4WuimhFsawNaFSQq7ZZxF7e/ywZebBgZdcI5ImG0rd1eTz+/tGbZRpTVTzAeaY3CBDkxN74UERLEWi6fUldxi8wIoi/ajM9u7LNfC+sNIKsAFWcpjuHOgOrXTRJHJwQfZtVdc6SIlk4tN2NJ2r9dkcPXy6xGnivHWhqSUvNvWrxEfrO4hK1T9JEKZvrSwC1DCuXpXhqlcm5qy0oiOTpHP0TGDuRAbuqi5IBPRhL0CIKebGD2GWBpXAhFGfoPQRJe649A7MQVE1XmEFru8598M= ceph-61da756e-ea87-11ee-95cd-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-25T09:11:36.903 INFO:teuthology.orchestra.run.smithi040.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJdjLe64E4uSzlyFKyn9bmRQbXN2eB62y0nRDaNFGBSzwp80zzlbAzG7i8JYKQKP00Wpqomn2j1Pc2xEKei2qg54vplcgf3QLYiPOE2Z6HuqG7I88BVnPya7M4+KKDM+pNx92Y0mzzJjaQ3BxbkSBbnMNS7TORssqR5RBpsTb7NdNVcjUyVbPqLG4eI6tNXdVW6ABVGmxN6Uy/dP8g10vjYm6l4pDBF9sh8ne2haUidC4WuimhFsawNaFSQq7ZZxF7e/ywZebBgZdcI5ImG0rd1eTz+/tGbZRpTVTzAeaY3CBDkxN74UERLEWi6fUldxi8wIoi/ajM9u7LNfC+sNIKsAFWcpjuHOgOrXTRJHJwQfZtVdc6SIlk4tN2NJ2r9dkcPXy6xGnivHWhqSUvNvWrxEfrO4hK1T9JEKZvrSwC1DCuXpXhqlcm5qy0oiOTpHP0TGDuRAbuqi5IBPRhL0CIKebGD2GWBpXAhFGfoPQRJe649A7MQVE1XmEFru8598M= ceph-61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:11:36.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJdjLe64E4uSzlyFKyn9bmRQbXN2eB62y0nRDaNFGBSzwp80zzlbAzG7i8JYKQKP00Wpqomn2j1Pc2xEKei2qg54vplcgf3QLYiPOE2Z6HuqG7I88BVnPya7M4+KKDM+pNx92Y0mzzJjaQ3BxbkSBbnMNS7TORssqR5RBpsTb7NdNVcjUyVbPqLG4eI6tNXdVW6ABVGmxN6Uy/dP8g10vjYm6l4pDBF9sh8ne2haUidC4WuimhFsawNaFSQq7ZZxF7e/ywZebBgZdcI5ImG0rd1eTz+/tGbZRpTVTzAeaY3CBDkxN74UERLEWi6fUldxi8wIoi/ajM9u7LNfC+sNIKsAFWcpjuHOgOrXTRJHJwQfZtVdc6SIlk4tN2NJ2r9dkcPXy6xGnivHWhqSUvNvWrxEfrO4hK1T9JEKZvrSwC1DCuXpXhqlcm5qy0oiOTpHP0TGDuRAbuqi5IBPRhL0CIKebGD2GWBpXAhFGfoPQRJe649A7MQVE1XmEFru8598M= ceph-61da756e-ea87-11ee-95cd-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-25T09:11:36.972 INFO:teuthology.orchestra.run.smithi059.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJdjLe64E4uSzlyFKyn9bmRQbXN2eB62y0nRDaNFGBSzwp80zzlbAzG7i8JYKQKP00Wpqomn2j1Pc2xEKei2qg54vplcgf3QLYiPOE2Z6HuqG7I88BVnPya7M4+KKDM+pNx92Y0mzzJjaQ3BxbkSBbnMNS7TORssqR5RBpsTb7NdNVcjUyVbPqLG4eI6tNXdVW6ABVGmxN6Uy/dP8g10vjYm6l4pDBF9sh8ne2haUidC4WuimhFsawNaFSQq7ZZxF7e/ywZebBgZdcI5ImG0rd1eTz+/tGbZRpTVTzAeaY3CBDkxN74UERLEWi6fUldxi8wIoi/ajM9u7LNfC+sNIKsAFWcpjuHOgOrXTRJHJwQfZtVdc6SIlk4tN2NJ2r9dkcPXy6xGnivHWhqSUvNvWrxEfrO4hK1T9JEKZvrSwC1DCuXpXhqlcm5qy0oiOTpHP0TGDuRAbuqi5IBPRhL0CIKebGD2GWBpXAhFGfoPQRJe649A7MQVE1XmEFru8598M= ceph-61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:11:36.986 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJdjLe64E4uSzlyFKyn9bmRQbXN2eB62y0nRDaNFGBSzwp80zzlbAzG7i8JYKQKP00Wpqomn2j1Pc2xEKei2qg54vplcgf3QLYiPOE2Z6HuqG7I88BVnPya7M4+KKDM+pNx92Y0mzzJjaQ3BxbkSBbnMNS7TORssqR5RBpsTb7NdNVcjUyVbPqLG4eI6tNXdVW6ABVGmxN6Uy/dP8g10vjYm6l4pDBF9sh8ne2haUidC4WuimhFsawNaFSQq7ZZxF7e/ywZebBgZdcI5ImG0rd1eTz+/tGbZRpTVTzAeaY3CBDkxN74UERLEWi6fUldxi8wIoi/ajM9u7LNfC+sNIKsAFWcpjuHOgOrXTRJHJwQfZtVdc6SIlk4tN2NJ2r9dkcPXy6xGnivHWhqSUvNvWrxEfrO4hK1T9JEKZvrSwC1DCuXpXhqlcm5qy0oiOTpHP0TGDuRAbuqi5IBPRhL0CIKebGD2GWBpXAhFGfoPQRJe649A7MQVE1XmEFru8598M= ceph-61da756e-ea87-11ee-95cd-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi129.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJdjLe64E4uSzlyFKyn9bmRQbXN2eB62y0nRDaNFGBSzwp80zzlbAzG7i8JYKQKP00Wpqomn2j1Pc2xEKei2qg54vplcgf3QLYiPOE2Z6HuqG7I88BVnPya7M4+KKDM+pNx92Y0mzzJjaQ3BxbkSBbnMNS7TORssqR5RBpsTb7NdNVcjUyVbPqLG4eI6tNXdVW6ABVGmxN6Uy/dP8g10vjYm6l4pDBF9sh8ne2haUidC4WuimhFsawNaFSQq7ZZxF7e/ywZebBgZdcI5ImG0rd1eTz+/tGbZRpTVTzAeaY3CBDkxN74UERLEWi6fUldxi8wIoi/ajM9u7LNfC+sNIKsAFWcpjuHOgOrXTRJHJwQfZtVdc6SIlk4tN2NJ2r9dkcPXy6xGnivHWhqSUvNvWrxEfrO4hK1T9JEKZvrSwC1DCuXpXhqlcm5qy0oiOTpHP0TGDuRAbuqi5IBPRhL0CIKebGD2GWBpXAhFGfoPQRJe649A7MQVE1XmEFru8598M= ceph-61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:11:37.053 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-25T09:11:37.076 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:36 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/3939145025' entity='client.admin' 2024-03-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:11:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi019", "name": "osd_memory_target"} : dispatch 2024-03-25T09:11:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:39 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/3237571540' entity='client.admin' 2024-03-25T09:11:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:40.564 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-25T09:11:40.565 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-25T09:11:41.178 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:11:43.587 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi040 2024-03-25T09:11:43.588 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:11:43.588 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/etc/ceph/ceph.conf 2024-03-25T09:11:43.607 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:11:43.607 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:11:43.664 INFO:tasks.cephadm:Adding host smithi040 to orchestrator... 2024-03-25T09:11:43.665 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch host add smithi040 2024-03-25T09:11:43.909 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:11:44.129 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:43 smithi019 ceph-mon[29386]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:44.129 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:44.129 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:44.129 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:11:44.129 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:11:44.129 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:43 smithi019 ceph-mon[29386]: Updating smithi019:/etc/ceph/ceph.conf 2024-03-25T09:11:44.130 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:44.130 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:44.130 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:45.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:44 smithi019 ceph-mon[29386]: Updating smithi019:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:11:45.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:44 smithi019 ceph-mon[29386]: Updating smithi019:/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:11:45.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:44 smithi019 ceph-mon[29386]: Updating smithi019:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-25T09:11:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:45 smithi019 ceph-mon[29386]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi040", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:47.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:46 smithi019 ceph-mon[29386]: Deploying cephadm binary to smithi040 2024-03-25T09:11:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:47 smithi019 ceph-mon[29386]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:11:49.890 INFO:teuthology.orchestra.run.smithi019.stdout:Added host 'smithi040' with addr '172.21.15.40' 2024-03-25T09:11:50.483 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch host ls --format=json 2024-03-25T09:11:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:11:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:50 smithi019 ceph-mon[29386]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:11:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:50 smithi019 ceph-mon[29386]: Added host smithi040 2024-03-25T09:11:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:11:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:52.031 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:51 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:52.031 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:51 smithi019 ceph-mon[29386]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:11:52.515 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:11:52.515 INFO:teuthology.orchestra.run.smithi019.stdout:[{"addr": "172.21.15.19", "hostname": "smithi019", "labels": [], "status": ""}, {"addr": "172.21.15.40", "hostname": "smithi040", "labels": [], "status": ""}] 2024-03-25T09:11:53.125 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi059 2024-03-25T09:11:53.125 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:11:53.125 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/etc/ceph/ceph.conf 2024-03-25T09:11:53.144 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:11:53.144 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:11:53.202 INFO:tasks.cephadm:Adding host smithi059 to orchestrator... 2024-03-25T09:11:53.202 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch host add smithi059 2024-03-25T09:11:53.438 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:11:53.885 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:53 smithi019 ceph-mon[29386]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:11:53.885 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:53 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:54.719 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:54 smithi019 ceph-mon[29386]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:11:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi059", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:11:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:56.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:11:56.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi040", "name": "osd_memory_target"} : dispatch 2024-03-25T09:11:56.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:11:56.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:11:56.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: Updating smithi040:/etc/ceph/ceph.conf 2024-03-25T09:11:56.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: Deploying cephadm binary to smithi059 2024-03-25T09:11:56.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:11:56.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:56 smithi019 ceph-mon[29386]: Updating smithi040:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:11:57.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:57 smithi019 ceph-mon[29386]: Updating smithi040:/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:11:57.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:57 smithi019 ceph-mon[29386]: Updating smithi040:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-25T09:11:58.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:58 smithi019 ceph-mon[29386]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:11:59.602 INFO:teuthology.orchestra.run.smithi019.stdout:Added host 'smithi059' with addr '172.21.15.59' 2024-03-25T09:12:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:59 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:59 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:59 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:59 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:59 smithi019 ceph-mon[29386]: Added host smithi059 2024-03-25T09:12:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:59 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:11:59 smithi019 ceph-mon[29386]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:00.517 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch host ls --format=json 2024-03-25T09:12:00.766 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:12:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:01 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:01 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:02.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:02 smithi019 ceph-mon[29386]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:02.560 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:12:02.560 INFO:teuthology.orchestra.run.smithi019.stdout:[{"addr": "172.21.15.19", "hostname": "smithi019", "labels": [], "status": ""}, {"addr": "172.21.15.40", "hostname": "smithi040", "labels": [], "status": ""}, {"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}] 2024-03-25T09:12:03.209 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi129 2024-03-25T09:12:03.209 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:12:03.209 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/etc/ceph/ceph.conf 2024-03-25T09:12:03.228 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:12:03.229 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:12:03.286 INFO:tasks.cephadm:Adding host smithi129 to orchestrator... 2024-03-25T09:12:03.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch host add smithi129 2024-03-25T09:12:03.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:03 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:03.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:03 smithi019 ceph-mon[29386]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:12:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:12:04.651 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:04 smithi019 ceph-mon[29386]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:06.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:06.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:06.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:06.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:06.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"} : dispatch 2024-03-25T09:12:06.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:06.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:12:06.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: Updating smithi059:/etc/ceph/ceph.conf 2024-03-25T09:12:06.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi129", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:12:06.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: Updating smithi059:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:06.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:12:06.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:06.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:06 smithi019 ceph-mon[29386]: Deploying cephadm binary to smithi129 2024-03-25T09:12:07.559 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:07 smithi019 ceph-mon[29386]: Updating smithi059:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-25T09:12:07.559 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:07 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:07.559 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:07 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:07.559 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:07 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:08.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:08 smithi019 ceph-mon[29386]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:09.610 INFO:teuthology.orchestra.run.smithi019.stdout:Added host 'smithi129' with addr '172.21.15.129' 2024-03-25T09:12:10.177 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch host ls --format=json 2024-03-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:12:10.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:10 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:10.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:10 smithi019 ceph-mon[29386]: Added host smithi129 2024-03-25T09:12:10.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:10 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:10.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:10 smithi019 ceph-mon[29386]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:10.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:10 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:11.806 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:11 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:12.241 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:12:12.241 INFO:teuthology.orchestra.run.smithi019.stdout:[{"addr": "172.21.15.19", "hostname": "smithi019", "labels": [], "status": ""}, {"addr": "172.21.15.40", "hostname": "smithi040", "labels": [], "status": ""}, {"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}, {"addr": "172.21.15.129", "hostname": "smithi129", "labels": [], "status": ""}] 2024-03-25T09:12:12.814 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:12 smithi019 ceph-mon[29386]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:12.814 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:12 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:12.843 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-25T09:12:12.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd crush tunables default 2024-03-25T09:12:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:12:13.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:13 smithi019 ceph-mon[29386]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:12:15.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:14 smithi019 ceph-mon[29386]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-03-25T09:12:16.034 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:15 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/3152457872' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-03-25T09:12:16.034 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:16.035 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:16.035 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:16.035 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:16.035 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"} : dispatch 2024-03-25T09:12:16.035 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:16.035 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:12:16.350 INFO:tasks.cephadm:Adding mon.a on smithi019 2024-03-25T09:12:16.351 INFO:tasks.cephadm:Adding mon.b on smithi040 2024-03-25T09:12:16.351 INFO:tasks.cephadm:Adding mon.c on smithi059 2024-03-25T09:12:16.351 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch apply mon '3;smithi019:172.21.15.19=a;smithi040:172.21.15.40=b;smithi059:172.21.15.59=c' 2024-03-25T09:12:16.581 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:16 smithi019 ceph-mon[29386]: Updating smithi129:/etc/ceph/ceph.conf 2024-03-25T09:12:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:16 smithi019 ceph-mon[29386]: Updating smithi129:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:16 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/3152457872' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-25T09:12:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:16 smithi019 ceph-mon[29386]: osdmap e4: 0 total, 0 up, 0 in 2024-03-25T09:12:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:16 smithi019 ceph-mon[29386]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:16 smithi019 ceph-mon[29386]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:12:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:16 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:16 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:17.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:16 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:18.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:17 smithi019 ceph-mon[29386]: Updating smithi129:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-25T09:12:18.242 INFO:teuthology.orchestra.run.smithi129.stdout:Scheduled mon update... 2024-03-25T09:12:18.856 DEBUG:teuthology.orchestra.run.smithi040:mon.b> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.b.service 2024-03-25T09:12:18.859 DEBUG:teuthology.orchestra.run.smithi059:mon.c> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.c.service 2024-03-25T09:12:18.862 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-25T09:12:18.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-25T09:12:19.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:18 smithi019 ceph-mon[29386]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:19.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:19.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:19.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:19.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:12:19.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:19.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:19.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:20.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:19 smithi019 ceph-mon[29386]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi019:172.21.15.19=a;smithi040:172.21.15.40=b;smithi059:172.21.15.59=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:12:20.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:19 smithi019 ceph-mon[29386]: Saving service mon spec with placement smithi019:172.21.15.19=a;smithi040:172.21.15.40=b;smithi059:172.21.15.59=c;count:3 2024-03-25T09:12:20.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:19 smithi019 ceph-mon[29386]: Deploying daemon mon.c on smithi059 2024-03-25T09:12:20.774 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.c/config 2024-03-25T09:12:21.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:20 smithi019 ceph-mon[29386]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:22.238 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:21 smithi019 ceph-mon[29386]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:23.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:22 smithi059 systemd[1]: Started Ceph mon.c for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:12:27.795 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:12:27.795 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":2,"fsid":"61da756e-ea87-11ee-95cd-87774f69a715","modified":"2024-03-25T09:12:22.758705Z","created":"2024-03-25T09:10:24.366020Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-25T09:12:27.798 INFO:teuthology.orchestra.run.smithi059.stderr:dumped monmap epoch 2 2024-03-25T09:12:28.083 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:12:28.083 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: mon.a calling monitor election 2024-03-25T09:12:28.083 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.083 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='client.? 172.21.15.59:0/1487176090' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-03-25T09:12:28.083 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.083 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: mon.c calling monitor election 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: monmap e2: 2 mons at {a=[v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0],c=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: fsmap 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: osdmap e4: 0 total, 0 up, 0 in 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: mgrmap e13: x(active, since 59s) 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: overall HEALTH_OK 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:28.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:28.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:28.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:28.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:12:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: mon.a calling monitor election 2024-03-25T09:12:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='client.? 172.21.15.59:0/1487176090' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: mon.c calling monitor election 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: monmap e2: 2 mons at {a=[v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0],c=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: fsmap 2024-03-25T09:12:28.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: osdmap e4: 0 total, 0 up, 0 in 2024-03-25T09:12:28.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: mgrmap e13: x(active, since 59s) 2024-03-25T09:12:28.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: overall HEALTH_OK 2024-03-25T09:12:28.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:28.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:28.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:28.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:28.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:29.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:28 smithi019 ceph-mon[29386]: Deploying daemon mon.b on smithi040 2024-03-25T09:12:29.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:28 smithi019 ceph-mon[29386]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:29.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:29.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:28 smithi059 ceph-mon[32732]: Deploying daemon mon.b on smithi040 2024-03-25T09:12:29.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:28 smithi059 ceph-mon[32732]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:29.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:29.367 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-25T09:12:29.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-25T09:12:29.616 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.c/config 2024-03-25T09:12:30.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:29 smithi059 ceph-mon[32732]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:30.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:29 smithi019 ceph-mon[29386]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":2,"fsid":"61da756e-ea87-11ee-95cd-87774f69a715","modified":"2024-03-25T09:12:22.758705Z","created":"2024-03-25T09:10:24.366020Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi059.stderr:dumped monmap epoch 2 2024-03-25T09:12:31.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:31 smithi059 ceph-mon[32732]: from='client.? 172.21.15.59:0/1833313165' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-03-25T09:12:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:31 smithi019 ceph-mon[29386]: from='client.? 172.21.15.59:0/1833313165' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-03-25T09:12:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:31 smithi040 systemd[1]: Started Ceph mon.b for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:12:33.048 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-25T09:12:33.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-25T09:12:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.c/config 2024-03-25T09:12:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:12:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: mon.a calling monitor election 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: mon.c calling monitor election 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-25T09:12:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: monmap e3: 3 mons at {a=[v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0],b=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],c=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: fsmap 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: osdmap e4: 0 total, 0 up, 0 in 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: mgrmap e13: x(active, since 68s) 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: mon.b (rank 2) addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] is down (out of quorum) 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:37.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:12:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: mon.a calling monitor election 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: mon.c calling monitor election 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: monmap e3: 3 mons at {a=[v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0],b=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],c=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-25T09:12:37.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: fsmap 2024-03-25T09:12:37.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: osdmap e4: 0 total, 0 up, 0 in 2024-03-25T09:12:37.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: mgrmap e13: x(active, since 68s) 2024-03-25T09:12:37.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-25T09:12:37.265 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-25T09:12:37.265 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-25T09:12:37.265 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: mon.b (rank 2) addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] is down (out of quorum) 2024-03-25T09:12:37.265 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:37.265 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:37.265 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:37.266 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:37.889 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:37 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:37.889 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:37 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-25T09:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":3,"fsid":"61da756e-ea87-11ee-95cd-87774f69a715","modified":"2024-03-25T09:12:31.717293Z","created":"2024-03-25T09:10:24.366020Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-25T09:12:38.013 INFO:teuthology.orchestra.run.smithi059.stderr:dumped monmap epoch 3 2024-03-25T09:12:38.153 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:37 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:38.153 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:37 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:38.741 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-25T09:12:38.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph config generate-minimal-conf 2024-03-25T09:12:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:12:39.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:12:39.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:39.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: mon.a calling monitor election 2024-03-25T09:12:39.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: mon.c calling monitor election 2024-03-25T09:12:39.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:12:39.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: monmap e3: 3 mons at {a=[v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0],b=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],c=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: fsmap 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: osdmap e4: 0 total, 0 up, 0 in 2024-03-25T09:12:39.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: mgrmap e13: x(active, since 68s) 2024-03-25T09:12:39.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-25T09:12:39.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-25T09:12:39.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-25T09:12:39.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: mon.b (rank 2) addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] is down (out of quorum) 2024-03-25T09:12:39.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:39.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: mon.b calling monitor election 2024-03-25T09:12:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: Updating smithi019:/etc/ceph/ceph.conf 2024-03-25T09:12:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: Updating smithi040:/etc/ceph/ceph.conf 2024-03-25T09:12:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: Updating smithi059:/etc/ceph/ceph.conf 2024-03-25T09:12:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: Updating smithi129:/etc/ceph/ceph.conf 2024-03-25T09:12:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: Updating smithi019:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: Updating smithi040:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: Updating smithi129:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: Updating smithi059:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: mon.b calling monitor election 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: mon.c calling monitor election 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: mon.a calling monitor election 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: monmap e3: 3 mons at {a=[v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0],b=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],c=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: fsmap 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: osdmap e4: 0 total, 0 up, 0 in 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: mgrmap e13: x(active, since 70s) 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: Cluster is now healthy 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: overall HEALTH_OK 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-25T09:12:39.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:39.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: mon.b calling monitor election 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: Updating smithi019:/etc/ceph/ceph.conf 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: Updating smithi040:/etc/ceph/ceph.conf 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: Updating smithi059:/etc/ceph/ceph.conf 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: Updating smithi129:/etc/ceph/ceph.conf 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: Updating smithi019:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: Updating smithi040:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: Updating smithi129:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: Updating smithi059:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: mon.b calling monitor election 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: mon.c calling monitor election 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: mon.a calling monitor election 2024-03-25T09:12:39.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: monmap e3: 3 mons at {a=[v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0],b=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],c=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: fsmap 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: osdmap e4: 0 total, 0 up, 0 in 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: mgrmap e13: x(active, since 70s) 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: Cluster is now healthy 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: overall HEALTH_OK 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.763 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.764 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.764 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.764 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.764 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.764 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.764 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:39.764 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-25T09:12:39.764 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:39.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: mon.b calling monitor election 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: Updating smithi019:/etc/ceph/ceph.conf 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: Updating smithi040:/etc/ceph/ceph.conf 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: Updating smithi059:/etc/ceph/ceph.conf 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: Updating smithi129:/etc/ceph/ceph.conf 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: Updating smithi019:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: Updating smithi040:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: Updating smithi129:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: Updating smithi059:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: mon.b calling monitor election 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: mon.c calling monitor election 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: mon.a calling monitor election 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: monmap e3: 3 mons at {a=[v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0],b=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],c=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: fsmap 2024-03-25T09:12:39.765 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: osdmap e4: 0 total, 0 up, 0 in 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: mgrmap e13: x(active, since 70s) 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: Cluster is now healthy 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: overall HEALTH_OK 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:39.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:39.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-25T09:12:39.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:40 smithi019 ceph-mon[29386]: Reconfiguring mon.a (unknown last config time)... 2024-03-25T09:12:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:40 smithi019 ceph-mon[29386]: Reconfiguring daemon mon.a on smithi019 2024-03-25T09:12:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:40 smithi019 ceph-mon[29386]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:40 smithi059 ceph-mon[32732]: Reconfiguring mon.a (unknown last config time)... 2024-03-25T09:12:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:40 smithi059 ceph-mon[32732]: Reconfiguring daemon mon.a on smithi019 2024-03-25T09:12:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:40 smithi059 ceph-mon[32732]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:40.761 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:40 smithi040 ceph-mon[33094]: Reconfiguring mon.a (unknown last config time)... 2024-03-25T09:12:40.761 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:40 smithi040 ceph-mon[33094]: Reconfiguring daemon mon.a on smithi019 2024-03-25T09:12:40.761 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:12:40.762 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:40 smithi040 ceph-mon[33094]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:40.804 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:12:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:12:40.718+0000 7fccc07ef700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-25T09:12:41.292 INFO:teuthology.orchestra.run.smithi019.stdout:# minimal ceph.conf for 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:12:41.292 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-03-25T09:12:41.292 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:12:41.292 INFO:teuthology.orchestra.run.smithi019.stdout: mon_host = [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] 2024-03-25T09:12:41.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:41 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/166948988' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:41.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:41 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/166948988' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:41 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/166948988' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:42.066 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-25T09:12:42.067 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:12:42.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.conf 2024-03-25T09:12:42.097 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:12:42.097 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:12:42.165 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:12:42.166 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.conf 2024-03-25T09:12:42.195 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:12:42.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:12:42.288 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:12:42.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.conf 2024-03-25T09:12:42.321 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:12:42.321 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:12:42.393 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:12:42.393 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.conf 2024-03-25T09:12:42.427 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:12:42.428 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-25T09:12:42.499 INFO:tasks.cephadm:Adding mgr.x on smithi019 2024-03-25T09:12:42.499 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch apply mgr '1;smithi019=x' 2024-03-25T09:12:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:42 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:42 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:42 smithi059 ceph-mon[32732]: Reconfiguring mon.b (monmap changed)... 2024-03-25T09:12:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:42 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:42 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-25T09:12:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:42 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:42 smithi059 ceph-mon[32732]: Reconfiguring daemon mon.b on smithi040 2024-03-25T09:12:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:42 smithi059 ceph-mon[32732]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:42 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:42 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:42 smithi040 ceph-mon[33094]: Reconfiguring mon.b (monmap changed)... 2024-03-25T09:12:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:42 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:42 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-25T09:12:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:42 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:42 smithi040 ceph-mon[33094]: Reconfiguring daemon mon.b on smithi040 2024-03-25T09:12:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:42 smithi040 ceph-mon[33094]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:42.769 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:12:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:42 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:42 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:42 smithi019 ceph-mon[29386]: Reconfiguring mon.b (monmap changed)... 2024-03-25T09:12:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:42 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:42 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-25T09:12:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:42 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:42 smithi019 ceph-mon[29386]: Reconfiguring daemon mon.b on smithi040 2024-03-25T09:12:42.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:42 smithi019 ceph-mon[29386]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:43 smithi059 ceph-mon[32732]: Reconfiguring mon.c (monmap changed)... 2024-03-25T09:12:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-25T09:12:44.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:44.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:43 smithi059 ceph-mon[32732]: Reconfiguring daemon mon.c on smithi059 2024-03-25T09:12:44.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:43 smithi059 ceph-mon[32732]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:43 smithi040 ceph-mon[33094]: Reconfiguring mon.c (monmap changed)... 2024-03-25T09:12:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-25T09:12:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:43 smithi040 ceph-mon[33094]: Reconfiguring daemon mon.c on smithi059 2024-03-25T09:12:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:43 smithi040 ceph-mon[33094]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:43 smithi019 ceph-mon[29386]: Reconfiguring mon.c (monmap changed)... 2024-03-25T09:12:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-25T09:12:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-25T09:12:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:43 smithi019 ceph-mon[29386]: Reconfiguring daemon mon.c on smithi059 2024-03-25T09:12:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:43 smithi019 ceph-mon[29386]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:44.577 INFO:teuthology.orchestra.run.smithi129.stdout:Scheduled mgr update... 2024-03-25T09:12:45.178 INFO:tasks.cephadm:Deploying OSDs... 2024-03-25T09:12:45.179 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:12:45.179 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-03-25T09:12:45.194 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-25T09:12:45.194 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-03-25T09:12:45.248 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-25T09:12:45.248 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:45.248 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-25T09:12:45.248 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:45.248 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:45.248 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-25 09:11:40.245993724 +0000 2024-03-25T09:12:45.248 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-25 09:04:38.897325017 +0000 2024-03-25T09:12:45.248 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-25 09:04:38.897325017 +0000 2024-03-25T09:12:45.249 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-25 09:04:38.897325017 +0000 2024-03-25T09:12:45.249 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-25T09:12:45.314 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-25T09:12:45.315 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-25T09:12:45.315 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000252231 s, 2.0 MB/s 2024-03-25T09:12:45.316 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-25T09:12:45.371 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-03-25T09:12:45.426 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-25T09:12:45.426 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:45.426 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-03-25T09:12:45.426 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:45.426 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:45.427 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-25 09:11:40.281993367 +0000 2024-03-25T09:12:45.427 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-25 09:04:39.250321538 +0000 2024-03-25T09:12:45.427 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-25 09:04:39.250321538 +0000 2024-03-25T09:12:45.427 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-25 09:04:39.250321538 +0000 2024-03-25T09:12:45.427 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-25T09:12:45.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:45.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:45.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:12:45.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;smithi019=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:12:45.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: Saving service mgr spec with placement smithi019=x;count:1 2024-03-25T09:12:45.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: Reconfiguring mgr.x (unknown last config time)... 2024-03-25T09:12:45.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-03-25T09:12:45.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-03-25T09:12:45.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:45.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:45 smithi019 ceph-mon[29386]: Reconfiguring daemon mgr.x on smithi019 2024-03-25T09:12:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-25T09:12:45.495 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-25T09:12:45.495 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000259966 s, 2.0 MB/s 2024-03-25T09:12:45.496 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-25T09:12:45.552 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-03-25T09:12:45.606 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-25T09:12:45.606 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:45.606 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-03-25T09:12:45.606 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:45.606 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:45.606 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-25 09:11:40.315993029 +0000 2024-03-25T09:12:45.607 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-25 09:04:39.608318010 +0000 2024-03-25T09:12:45.607 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-25 09:04:39.608318010 +0000 2024-03-25T09:12:45.607 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-25 09:04:39.608318010 +0000 2024-03-25T09:12:45.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-25T09:12:45.672 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-25T09:12:45.672 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-25T09:12:45.672 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000208584 s, 2.5 MB/s 2024-03-25T09:12:45.673 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-25T09:12:45.729 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-03-25T09:12:45.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:45.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:45.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:12:45.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;smithi019=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:12:45.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: Saving service mgr spec with placement smithi019=x;count:1 2024-03-25T09:12:45.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: Reconfiguring mgr.x (unknown last config time)... 2024-03-25T09:12:45.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-03-25T09:12:45.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-03-25T09:12:45.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:45.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:45 smithi059 ceph-mon[32732]: Reconfiguring daemon mgr.x on smithi019 2024-03-25T09:12:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:12:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;smithi019=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:12:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: Saving service mgr spec with placement smithi019=x;count:1 2024-03-25T09:12:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: Reconfiguring mgr.x (unknown last config time)... 2024-03-25T09:12:45.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-03-25T09:12:45.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-03-25T09:12:45.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:45.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:45 smithi040 ceph-mon[33094]: Reconfiguring daemon mgr.x on smithi019 2024-03-25T09:12:45.783 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-25T09:12:45.784 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:45.784 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-25T09:12:45.784 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:45.784 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:45.784 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-25 09:11:40.348992702 +0000 2024-03-25T09:12:45.784 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-25 09:04:39.961314531 +0000 2024-03-25T09:12:45.784 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-25 09:04:39.961314531 +0000 2024-03-25T09:12:45.784 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-25 09:04:39.961314531 +0000 2024-03-25T09:12:45.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-25T09:12:45.852 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-25T09:12:45.852 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-25T09:12:45.852 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000199853 s, 2.6 MB/s 2024-03-25T09:12:45.853 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-25T09:12:45.908 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:12:45.908 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-03-25T09:12:45.926 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-25T09:12:45.927 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-03-25T09:12:45.985 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-25T09:12:45.985 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:45.985 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-03-25T09:12:45.985 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:45.985 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:45.985 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-03-25 09:12:31.173965710 +0000 2024-03-25T09:12:45.985 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-03-25 09:04:38.029154231 +0000 2024-03-25T09:12:45.985 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-03-25 09:04:38.029154231 +0000 2024-03-25T09:12:45.985 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-03-25 09:04:38.029154231 +0000 2024-03-25T09:12:45.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-25T09:12:46.055 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-03-25T09:12:46.055 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-03-25T09:12:46.055 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000265031 s, 1.9 MB/s 2024-03-25T09:12:46.056 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-25T09:12:46.114 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-03-25T09:12:46.189 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-25T09:12:46.189 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:46.189 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-25T09:12:46.189 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:46.189 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:46.189 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-03-25 09:12:31.173965710 +0000 2024-03-25T09:12:46.189 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-03-25 09:04:38.372149382 +0000 2024-03-25T09:12:46.189 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-03-25 09:04:38.372149382 +0000 2024-03-25T09:12:46.190 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-03-25 09:04:38.372149382 +0000 2024-03-25T09:12:46.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-25T09:12:46.258 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-03-25T09:12:46.258 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-03-25T09:12:46.258 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000237968 s, 2.2 MB/s 2024-03-25T09:12:46.259 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-25T09:12:46.317 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-03-25T09:12:46.372 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-25T09:12:46.373 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:46.373 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-25T09:12:46.373 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:46.373 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:46.373 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-03-25 09:12:31.174965696 +0000 2024-03-25T09:12:46.373 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-03-25 09:04:38.713144560 +0000 2024-03-25T09:12:46.373 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-03-25 09:04:38.713144560 +0000 2024-03-25T09:12:46.373 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-03-25 09:04:38.713144560 +0000 2024-03-25T09:12:46.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-25T09:12:46.441 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-03-25T09:12:46.441 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-03-25T09:12:46.441 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000240839 s, 2.1 MB/s 2024-03-25T09:12:46.443 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-25T09:12:46.499 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-03-25T09:12:46.554 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-25T09:12:46.554 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:46.554 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-03-25T09:12:46.555 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:46.555 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:46.555 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-03-25 09:12:31.174965696 +0000 2024-03-25T09:12:46.555 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-03-25 09:04:39.057139696 +0000 2024-03-25T09:12:46.555 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-03-25 09:04:39.057139696 +0000 2024-03-25T09:12:46.555 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-03-25 09:04:39.057139696 +0000 2024-03-25T09:12:46.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-25T09:12:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-03-25T09:12:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-03-25T09:12:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000199363 s, 2.6 MB/s 2024-03-25T09:12:46.621 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-25T09:12:46.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:46 smithi019 ceph-mon[29386]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:46.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:46 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:46 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:46 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:46.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:46 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:46.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:46 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:12:46.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:46 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:46 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.677 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:12:46.677 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-03-25T09:12:46.695 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-25T09:12:46.695 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-03-25T09:12:46.753 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-25T09:12:46.754 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:46.754 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-03-25T09:12:46.754 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:46.754 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:46.754 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-03-25 09:12:21.775477733 +0000 2024-03-25T09:12:46.754 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-03-25 09:04:37.595947525 +0000 2024-03-25T09:12:46.754 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-03-25 09:04:37.595947525 +0000 2024-03-25T09:12:46.754 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-03-25 09:04:37.595947525 +0000 2024-03-25T09:12:46.754 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-25T09:12:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:46 smithi059 ceph-mon[32732]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:46 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:46 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:46 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:46 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:46 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:12:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:46 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:46 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:46 smithi040 ceph-mon[33094]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:46 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:46 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:46 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:12:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:46 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:46 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:12:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:46 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:46 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:12:46.791 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-03-25T09:12:46.791 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-03-25T09:12:46.791 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000226694 s, 2.3 MB/s 2024-03-25T09:12:46.793 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-25T09:12:46.851 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-03-25T09:12:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-25T09:12:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:46.908 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-25T09:12:46.908 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:46.908 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:46.908 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-03-25 09:12:21.776477720 +0000 2024-03-25T09:12:46.908 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-03-25 09:04:37.926943043 +0000 2024-03-25T09:12:46.908 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-03-25 09:04:37.926943043 +0000 2024-03-25T09:12:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-03-25 09:04:37.926943043 +0000 2024-03-25T09:12:46.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-25T09:12:46.976 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-03-25T09:12:46.977 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-03-25T09:12:46.977 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000242085 s, 2.1 MB/s 2024-03-25T09:12:46.978 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-25T09:12:47.035 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-03-25T09:12:47.091 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-25T09:12:47.091 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:47.091 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-25T09:12:47.091 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:47.091 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:47.091 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-03-25 09:12:21.776477720 +0000 2024-03-25T09:12:47.091 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-03-25 09:04:38.282938223 +0000 2024-03-25T09:12:47.091 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-03-25 09:04:38.282938223 +0000 2024-03-25T09:12:47.091 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-03-25 09:04:38.282938223 +0000 2024-03-25T09:12:47.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-25T09:12:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-03-25T09:12:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-03-25T09:12:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000214179 s, 2.4 MB/s 2024-03-25T09:12:47.159 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-25T09:12:47.216 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-03-25T09:12:47.271 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-25T09:12:47.271 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:47.271 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-25T09:12:47.272 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:47.272 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:47.272 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-03-25 09:12:21.776477720 +0000 2024-03-25T09:12:47.272 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-03-25 09:04:38.621933634 +0000 2024-03-25T09:12:47.272 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-03-25 09:04:38.621933634 +0000 2024-03-25T09:12:47.272 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-03-25 09:04:38.621933634 +0000 2024-03-25T09:12:47.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-25T09:12:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-03-25T09:12:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-03-25T09:12:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.00017662 s, 2.9 MB/s 2024-03-25T09:12:47.340 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-25T09:12:47.395 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:12:47.395 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/scratch_devs of=/dev/stdout 2024-03-25T09:12:47.413 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-25T09:12:47.414 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 2024-03-25T09:12:47.472 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-25T09:12:47.472 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:47.472 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-25T09:12:47.472 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:47.472 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:47.472 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-03-25 09:12:14.580067713 +0000 2024-03-25T09:12:47.472 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-03-25 09:04:35.985368745 +0000 2024-03-25T09:12:47.472 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-03-25 09:04:35.985368745 +0000 2024-03-25T09:12:47.473 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-03-25 09:04:35.985368745 +0000 2024-03-25T09:12:47.473 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-25T09:12:47.544 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-03-25T09:12:47.544 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-03-25T09:12:47.544 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000251585 s, 2.0 MB/s 2024-03-25T09:12:47.546 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-25T09:12:47.604 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 2024-03-25T09:12:47.662 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-25T09:12:47.662 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:47.662 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-25T09:12:47.662 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:47.663 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:47.663 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-03-25 09:12:14.604067194 +0000 2024-03-25T09:12:47.663 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-03-25 09:04:36.312361610 +0000 2024-03-25T09:12:47.663 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-03-25 09:04:36.312361610 +0000 2024-03-25T09:12:47.663 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-03-25 09:04:36.312361610 +0000 2024-03-25T09:12:47.663 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-25T09:12:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-03-25T09:12:47.731 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-03-25T09:12:47.731 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.00019164 s, 2.7 MB/s 2024-03-25T09:12:47.732 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-25T09:12:47.789 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 2024-03-25T09:12:47.846 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-25T09:12:47.846 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:47.846 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-25T09:12:47.847 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:47.847 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:47.847 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-03-25 09:12:14.627066696 +0000 2024-03-25T09:12:47.847 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-03-25 09:04:36.672353754 +0000 2024-03-25T09:12:47.847 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-03-25 09:04:36.672353754 +0000 2024-03-25T09:12:47.847 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-03-25 09:04:36.672353754 +0000 2024-03-25T09:12:47.847 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-25T09:12:47.914 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-03-25T09:12:47.914 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-03-25T09:12:47.914 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000192027 s, 2.7 MB/s 2024-03-25T09:12:47.915 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-25T09:12:47.973 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 2024-03-25T09:12:48.028 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-25T09:12:48.028 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T09:12:48.028 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-25T09:12:48.028 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T09:12:48.029 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T09:12:48.029 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-03-25 09:12:14.650066199 +0000 2024-03-25T09:12:48.029 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-03-25 09:04:37.028345986 +0000 2024-03-25T09:12:48.029 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-03-25 09:04:37.028345986 +0000 2024-03-25T09:12:48.029 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-03-25 09:04:37.028345986 +0000 2024-03-25T09:12:48.029 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-25T09:12:48.096 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-03-25T09:12:48.096 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-03-25T09:12:48.096 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000231706 s, 2.2 MB/s 2024-03-25T09:12:48.098 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-25T09:12:48.155 INFO:tasks.cephadm:Deploying osd.0 on smithi019 with /dev/vg_nvme/lv_4... 2024-03-25T09:12:48.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-25T09:12:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:47 smithi059 ceph-mon[32732]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:48.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:47 smithi040 ceph-mon[33094]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:48.339 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:47 smithi019 ceph-mon[29386]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:12:50.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:49 smithi019 ceph-mon[29386]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:50.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:49 smithi059 ceph-mon[32732]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:50.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:49 smithi040 ceph-mon[33094]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-25T09:12:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-25T09:12:50.344 INFO:teuthology.orchestra.run.smithi019.stderr: stderr: 10+0 records in 2024-03-25T09:12:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:10+0 records out 2024-03-25T09:12:50.344 INFO:teuthology.orchestra.run.smithi019.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114379 s, 917 MB/s 2024-03-25T09:12:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:--> Zapping successful for: 2024-03-25T09:12:50.994 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi019:vg_nvme/lv_4 2024-03-25T09:12:51.238 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:12:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:51 smithi019 ceph-mon[29386]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:52.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:51 smithi059 ceph-mon[32732]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:51 smithi040 ceph-mon[33094]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:52 smithi059 ceph-mon[32732]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:12:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:52 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:12:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:52 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:12:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:52 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:53.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:52 smithi040 ceph-mon[33094]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:12:53.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:52 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:12:53.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:52 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:12:53.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:52 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:53.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:52 smithi019 ceph-mon[29386]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:12:53.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:52 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:12:53.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:52 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:12:53.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:52 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:12:54.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:53 smithi019 ceph-mon[29386]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:54.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:53 smithi059 ceph-mon[32732]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:54.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:53 smithi040 ceph-mon[33094]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:55 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/4038341501' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5abf7a61-63e0-4a7a-b7d9-fcb15988556f"} : dispatch 2024-03-25T09:12:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:55 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/4038341501' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5abf7a61-63e0-4a7a-b7d9-fcb15988556f"}]': finished 2024-03-25T09:12:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:55 smithi059 ceph-mon[32732]: osdmap e5: 1 total, 0 up, 1 in 2024-03-25T09:12:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:55 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:12:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:55 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/4038341501' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5abf7a61-63e0-4a7a-b7d9-fcb15988556f"} : dispatch 2024-03-25T09:12:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:55 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/4038341501' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5abf7a61-63e0-4a7a-b7d9-fcb15988556f"}]': finished 2024-03-25T09:12:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:55 smithi040 ceph-mon[33094]: osdmap e5: 1 total, 0 up, 1 in 2024-03-25T09:12:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:55 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:12:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:55 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/4038341501' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5abf7a61-63e0-4a7a-b7d9-fcb15988556f"} : dispatch 2024-03-25T09:12:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:55 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/4038341501' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5abf7a61-63e0-4a7a-b7d9-fcb15988556f"}]': finished 2024-03-25T09:12:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:55 smithi019 ceph-mon[29386]: osdmap e5: 1 total, 0 up, 1 in 2024-03-25T09:12:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:55 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:12:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:56 smithi059 ceph-mon[32732]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:56 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/230418042' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:12:57.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:56 smithi040 ceph-mon[33094]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:57.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:56 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/230418042' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:12:57.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:56 smithi019 ceph-mon[29386]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:57.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:56 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/230418042' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:12:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:57 smithi059 ceph-mon[32732]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:58.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:57 smithi040 ceph-mon[33094]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:12:58.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:57 smithi019 ceph-mon[29386]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:00.077 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:12:59 smithi019 ceph-mon[29386]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:00.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:12:59 smithi059 ceph-mon[32732]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:12:59 smithi040 ceph-mon[33094]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:02.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:01 smithi019 ceph-mon[29386]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:02.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:01 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-03-25T09:13:02.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:01 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:01 smithi059 ceph-mon[32732]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:01 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-03-25T09:13:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:01 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:01 smithi040 ceph-mon[33094]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:01 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-03-25T09:13:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:01 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:03.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:02 smithi019 ceph-mon[29386]: Deploying daemon osd.0 on smithi019 2024-03-25T09:13:03.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:02 smithi059 ceph-mon[32732]: Deploying daemon osd.0 on smithi019 2024-03-25T09:13:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:02 smithi040 ceph-mon[33094]: Deploying daemon osd.0 on smithi019 2024-03-25T09:13:04.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:03 smithi059 ceph-mon[32732]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:04.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:03 smithi040 ceph-mon[33094]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:03 smithi019 ceph-mon[29386]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:05 smithi059 ceph-mon[32732]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:05 smithi040 ceph-mon[33094]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:06.389 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:05 smithi019 ceph-mon[29386]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:08.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:08.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:08.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:08.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:08 smithi019 ceph-mon[29386]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:08.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:08.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:08.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:08.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:08 smithi059 ceph-mon[32732]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:08.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:08.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:08.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:08.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:08 smithi040 ceph-mon[33094]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:10.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:09 smithi019 ceph-mon[29386]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:10.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:09 smithi059 ceph-mon[32732]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:10.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:09 smithi040 ceph-mon[33094]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:10.778 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 0 on host 'smithi019' 2024-03-25T09:13:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:10 smithi059 ceph-mon[32732]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-03-25T09:13:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:10 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:10 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:10 smithi040 ceph-mon[33094]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-03-25T09:13:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:10 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:10 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:11.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:10 smithi019 ceph-mon[29386]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-03-25T09:13:11.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:10 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:11.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:10 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:11.330 DEBUG:teuthology.orchestra.run.smithi019:osd.0> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.0.service 2024-03-25T09:13:11.333 INFO:tasks.cephadm:Deploying osd.1 on smithi019 with /dev/vg_nvme/lv_3... 2024-03-25T09:13:11.333 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-25T09:13:11.617 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:13:12.075 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:11 smithi019 ceph-mon[29386]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-25T09:13:12.075 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:11 smithi019 ceph-mon[29386]: osdmap e6: 1 total, 0 up, 1 in 2024-03-25T09:13:12.075 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:11 smithi019 ceph-mon[29386]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-03-25T09:13:12.076 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:11 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:12.076 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:11 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:12.076 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:11 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:12.076 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:11 smithi019 ceph-mon[29386]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:12.076 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:13:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0[44071]: 2024-03-25T09:13:11.987+0000 7f044e863700 -1 osd.0 0 waiting for initial osdmap 2024-03-25T09:13:12.076 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:13:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0[44071]: 2024-03-25T09:13:11.991+0000 7f044a656700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T09:13:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:11 smithi059 ceph-mon[32732]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-25T09:13:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:11 smithi059 ceph-mon[32732]: osdmap e6: 1 total, 0 up, 1 in 2024-03-25T09:13:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:11 smithi059 ceph-mon[32732]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-03-25T09:13:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:11 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:11 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:11 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:11 smithi059 ceph-mon[32732]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:11 smithi040 ceph-mon[33094]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-25T09:13:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:11 smithi040 ceph-mon[33094]: osdmap e6: 1 total, 0 up, 1 in 2024-03-25T09:13:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:11 smithi040 ceph-mon[33094]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-03-25T09:13:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:11 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:11 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:11 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:11 smithi040 ceph-mon[33094]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:12 smithi059 ceph-mon[32732]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-03-25T09:13:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:12 smithi059 ceph-mon[32732]: osdmap e7: 1 total, 0 up, 1 in 2024-03-25T09:13:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:12 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:12 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:13.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:12 smithi040 ceph-mon[33094]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-03-25T09:13:13.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:12 smithi040 ceph-mon[33094]: osdmap e7: 1 total, 0 up, 1 in 2024-03-25T09:13:13.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:12 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:13.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:12 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:13.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:12 smithi019 ceph-mon[29386]: from='osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-03-25T09:13:13.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:12 smithi019 ceph-mon[29386]: osdmap e7: 1 total, 0 up, 1 in 2024-03-25T09:13:13.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:12 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:13.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:12 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:14.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:13 smithi019 ceph-mon[29386]: purged_snaps scrub starts 2024-03-25T09:13:14.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:13 smithi019 ceph-mon[29386]: purged_snaps scrub ok 2024-03-25T09:13:14.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:13 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:14.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:13 smithi019 ceph-mon[29386]: osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073] boot 2024-03-25T09:13:14.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:13 smithi019 ceph-mon[29386]: osdmap e8: 1 total, 1 up, 1 in 2024-03-25T09:13:14.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:13 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:14.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:13 smithi019 ceph-mon[29386]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:14.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:13 smithi059 ceph-mon[32732]: purged_snaps scrub starts 2024-03-25T09:13:14.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:13 smithi059 ceph-mon[32732]: purged_snaps scrub ok 2024-03-25T09:13:14.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:13 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:14.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:13 smithi059 ceph-mon[32732]: osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073] boot 2024-03-25T09:13:14.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:13 smithi059 ceph-mon[32732]: osdmap e8: 1 total, 1 up, 1 in 2024-03-25T09:13:14.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:13 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:14.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:13 smithi059 ceph-mon[32732]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:14.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:13 smithi040 ceph-mon[33094]: purged_snaps scrub starts 2024-03-25T09:13:14.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:13 smithi040 ceph-mon[33094]: purged_snaps scrub ok 2024-03-25T09:13:14.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:13 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:14.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:13 smithi040 ceph-mon[33094]: osd.0 [v2:172.21.15.19:6802/3324613073,v1:172.21.15.19:6803/3324613073] boot 2024-03-25T09:13:14.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:13 smithi040 ceph-mon[33094]: osdmap e8: 1 total, 1 up, 1 in 2024-03-25T09:13:14.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:13 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-25T09:13:14.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:13 smithi040 ceph-mon[33094]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi019.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi019.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi019.stderr: stderr: 10+0 records in 2024-03-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi019.stderr:10+0 records out 2024-03-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi019.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012444 s, 843 MB/s 2024-03-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi019.stderr:--> Zapping successful for: 2024-03-25T09:13:15.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:14 smithi019 ceph-mon[29386]: osdmap e9: 1 total, 1 up, 1 in 2024-03-25T09:13:15.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:14 smithi059 ceph-mon[32732]: osdmap e9: 1 total, 1 up, 1 in 2024-03-25T09:13:15.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:14 smithi040 ceph-mon[33094]: osdmap e9: 1 total, 1 up, 1 in 2024-03-25T09:13:15.488 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi019:vg_nvme/lv_3 2024-03-25T09:13:16.107 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:16 smithi019 ceph-mon[29386]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:16.162 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:13:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:16 smithi059 ceph-mon[32732]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:16.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:16 smithi040 ceph-mon[33094]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:17.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: Detected new or changed devices on smithi019 2024-03-25T09:13:17.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-25T09:13:17.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi019 to 17093M 2024-03-25T09:13:17.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:17.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:17.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:17.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:17.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:17.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: Detected new or changed devices on smithi019 2024-03-25T09:13:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-25T09:13:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi019 to 17093M 2024-03-25T09:13:17.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:17.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:17.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:17.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:17.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:17.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: Detected new or changed devices on smithi019 2024-03-25T09:13:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-25T09:13:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi019 to 17093M 2024-03-25T09:13:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:17.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:17.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:17.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:18 smithi059 ceph-mon[32732]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:18 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:13:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:18 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:13:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:18 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:18 smithi040 ceph-mon[33094]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:18 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:13:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:18 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:13:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:18 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:18.571 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:18 smithi019 ceph-mon[29386]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:18.571 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:13:18.572 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:13:18.572 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:19.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:19 smithi059 ceph-mon[32732]: from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:13:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:19 smithi040 ceph-mon[33094]: from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:13:19.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:19 smithi019 ceph-mon[29386]: from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:13:20.432 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:20 smithi019 ceph-mon[29386]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:20.435 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:20 smithi040 ceph-mon[33094]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:20 smithi059 ceph-mon[32732]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:21 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/1479309553' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "169b654e-44fc-46af-ab9c-62e09de1b803"} : dispatch 2024-03-25T09:13:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:21 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/1479309553' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "169b654e-44fc-46af-ab9c-62e09de1b803"}]': finished 2024-03-25T09:13:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:21 smithi059 ceph-mon[32732]: osdmap e10: 2 total, 1 up, 2 in 2024-03-25T09:13:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:21 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:21 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/1479309553' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "169b654e-44fc-46af-ab9c-62e09de1b803"} : dispatch 2024-03-25T09:13:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:21 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/1479309553' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "169b654e-44fc-46af-ab9c-62e09de1b803"}]': finished 2024-03-25T09:13:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:21 smithi040 ceph-mon[33094]: osdmap e10: 2 total, 1 up, 2 in 2024-03-25T09:13:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:21 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:21.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:21 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/1479309553' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "169b654e-44fc-46af-ab9c-62e09de1b803"} : dispatch 2024-03-25T09:13:21.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:21 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/1479309553' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "169b654e-44fc-46af-ab9c-62e09de1b803"}]': finished 2024-03-25T09:13:21.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:21 smithi019 ceph-mon[29386]: osdmap e10: 2 total, 1 up, 2 in 2024-03-25T09:13:21.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:21 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:22 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/3120065917' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:13:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:22 smithi059 ceph-mon[32732]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:22 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/3120065917' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:13:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:22 smithi040 ceph-mon[33094]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:22.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:22 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/3120065917' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:13:22.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:22 smithi019 ceph-mon[29386]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:24.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:23 smithi019 ceph-mon[29386]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:24.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:23 smithi059 ceph-mon[32732]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:23 smithi040 ceph-mon[33094]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:26.074 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:25 smithi019 ceph-mon[29386]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:25 smithi059 ceph-mon[32732]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:26.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:25 smithi040 ceph-mon[33094]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-03-25T09:13:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-03-25T09:13:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:27.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:27 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-03-25T09:13:27.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:27 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:28.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:28 smithi019 ceph-mon[29386]: Deploying daemon osd.1 on smithi019 2024-03-25T09:13:28.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:28 smithi019 ceph-mon[29386]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:28.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:28 smithi059 ceph-mon[32732]: Deploying daemon osd.1 on smithi019 2024-03-25T09:13:28.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:28 smithi059 ceph-mon[32732]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:28.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:28 smithi040 ceph-mon[33094]: Deploying daemon osd.1 on smithi019 2024-03-25T09:13:28.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:28 smithi040 ceph-mon[33094]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:30.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:29 smithi019 ceph-mon[29386]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:30.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:29 smithi059 ceph-mon[32732]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:30.266 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:29 smithi040 ceph-mon[33094]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:31 smithi040 ceph-mon[33094]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:32.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:31 smithi059 ceph-mon[32732]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:32.304 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:31 smithi019 ceph-mon[29386]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:33.194 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:33.194 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:33.194 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:33.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:33.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:33.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:34.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:33 smithi019 ceph-mon[29386]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:34.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:33 smithi059 ceph-mon[32732]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:34.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:33 smithi040 ceph-mon[33094]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:36.070 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 1 on host 'smithi019' 2024-03-25T09:13:36.378 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.379 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.379 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:36.379 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:36.379 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.379 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:36 smithi019 ceph-mon[29386]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-03-25T09:13:36.379 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:36 smithi019 ceph-mon[29386]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:36.379 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.379 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.379 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:36 smithi059 ceph-mon[32732]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-03-25T09:13:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:36 smithi059 ceph-mon[32732]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:36 smithi040 ceph-mon[33094]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-03-25T09:13:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:36 smithi040 ceph-mon[33094]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:36.683 DEBUG:teuthology.orchestra.run.smithi019:osd.1> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.1.service 2024-03-25T09:13:36.685 INFO:tasks.cephadm:Deploying osd.2 on smithi040 with /dev/vg_nvme/lv_4... 2024-03-25T09:13:36.685 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-25T09:13:36.931 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.b/config 2024-03-25T09:13:37.308 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:37 smithi040 ceph-mon[33094]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-25T09:13:37.309 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:37 smithi040 ceph-mon[33094]: osdmap e11: 2 total, 1 up, 2 in 2024-03-25T09:13:37.309 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:37 smithi040 ceph-mon[33094]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-03-25T09:13:37.309 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:37 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:37 smithi019 ceph-mon[29386]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-25T09:13:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:37 smithi019 ceph-mon[29386]: osdmap e11: 2 total, 1 up, 2 in 2024-03-25T09:13:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:37 smithi019 ceph-mon[29386]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-03-25T09:13:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:37 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:37.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:37 smithi059 ceph-mon[32732]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-25T09:13:37.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:37 smithi059 ceph-mon[32732]: osdmap e11: 2 total, 1 up, 2 in 2024-03-25T09:13:37.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:37 smithi059 ceph-mon[32732]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-03-25T09:13:37.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:37 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:37.752 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:13:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1[49893]: 2024-03-25T09:13:37.612+0000 7fae12f8c700 -1 osd.1 0 waiting for initial osdmap 2024-03-25T09:13:37.752 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:13:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1[49893]: 2024-03-25T09:13:37.615+0000 7fae0ad77700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T09:13:38.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:38 smithi019 ceph-mon[29386]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-03-25T09:13:38.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:38 smithi019 ceph-mon[29386]: osdmap e12: 2 total, 1 up, 2 in 2024-03-25T09:13:38.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:38.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:38.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:38 smithi019 ceph-mon[29386]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' 2024-03-25T09:13:38.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:38 smithi019 ceph-mon[29386]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:38.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:38 smithi059 ceph-mon[32732]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-03-25T09:13:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:38 smithi059 ceph-mon[32732]: osdmap e12: 2 total, 1 up, 2 in 2024-03-25T09:13:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:38 smithi059 ceph-mon[32732]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' 2024-03-25T09:13:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:38 smithi059 ceph-mon[32732]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:38 smithi040 ceph-mon[33094]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-03-25T09:13:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:38 smithi040 ceph-mon[33094]: osdmap e12: 2 total, 1 up, 2 in 2024-03-25T09:13:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:38 smithi040 ceph-mon[33094]: from='osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651]' entity='osd.1' 2024-03-25T09:13:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:38 smithi040 ceph-mon[33094]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-25T09:13:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-25T09:13:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-25T09:13:38.763 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-03-25T09:13:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-03-25T09:13:38.763 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.010976 s, 955 MB/s 2024-03-25T09:13:38.764 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-03-25T09:13:39.376 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_4 2024-03-25T09:13:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.b/config 2024-03-25T09:13:39.872 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: purged_snaps scrub starts 2024-03-25T09:13:39.872 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: purged_snaps scrub ok 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651] boot 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: osdmap e13: 2 total, 2 up, 2 in 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:39.873 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:39.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: purged_snaps scrub starts 2024-03-25T09:13:39.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: purged_snaps scrub ok 2024-03-25T09:13:39.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651] boot 2024-03-25T09:13:39.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: osdmap e13: 2 total, 2 up, 2 in 2024-03-25T09:13:39.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:39.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:39.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:39.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-25T09:13:39.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-25T09:13:39.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:39.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:39.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:39.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:40.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: purged_snaps scrub starts 2024-03-25T09:13:40.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: purged_snaps scrub ok 2024-03-25T09:13:40.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: osd.1 [v2:172.21.15.19:6810/266458651,v1:172.21.15.19:6811/266458651] boot 2024-03-25T09:13:40.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: osdmap e13: 2 total, 2 up, 2 in 2024-03-25T09:13:40.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-25T09:13:40.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:40.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:40.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-25T09:13:40.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-25T09:13:40.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:40.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:40.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:40.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:40.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:40 smithi019 ceph-mon[29386]: Detected new or changed devices on smithi019 2024-03-25T09:13:40.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:40 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi019 to 8546M 2024-03-25T09:13:40.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:40 smithi019 ceph-mon[29386]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:40.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:40 smithi019 ceph-mon[29386]: osdmap e14: 2 total, 2 up, 2 in 2024-03-25T09:13:40.976 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:40 smithi040 ceph-mon[33094]: Detected new or changed devices on smithi019 2024-03-25T09:13:40.977 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:40 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi019 to 8546M 2024-03-25T09:13:40.977 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:40 smithi040 ceph-mon[33094]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:40.977 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:40 smithi040 ceph-mon[33094]: osdmap e14: 2 total, 2 up, 2 in 2024-03-25T09:13:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:40 smithi059 ceph-mon[32732]: Detected new or changed devices on smithi019 2024-03-25T09:13:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:40 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi019 to 8546M 2024-03-25T09:13:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:40 smithi059 ceph-mon[32732]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:40 smithi059 ceph-mon[32732]: osdmap e14: 2 total, 2 up, 2 in 2024-03-25T09:13:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:13:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:13:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:41.927 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:13:41.927 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:13:41.927 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:13:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:13:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:42.902 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:42 smithi040 ceph-mon[33094]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:13:42.903 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:42 smithi040 ceph-mon[33094]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:42 smithi019 ceph-mon[29386]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:13:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:42 smithi019 ceph-mon[29386]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:43.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:42 smithi059 ceph-mon[32732]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:13:43.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:42 smithi059 ceph-mon[32732]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:43 smithi019 ceph-mon[29386]: from='client.? 172.21.15.40:0/2875397806' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b55fe141-e42a-4d64-90c9-b91e13632a76"} : dispatch 2024-03-25T09:13:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:43 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b55fe141-e42a-4d64-90c9-b91e13632a76"} : dispatch 2024-03-25T09:13:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:43 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b55fe141-e42a-4d64-90c9-b91e13632a76"}]': finished 2024-03-25T09:13:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:43 smithi019 ceph-mon[29386]: osdmap e15: 3 total, 2 up, 3 in 2024-03-25T09:13:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:13:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:43 smithi059 ceph-mon[32732]: from='client.? 172.21.15.40:0/2875397806' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b55fe141-e42a-4d64-90c9-b91e13632a76"} : dispatch 2024-03-25T09:13:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:43 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b55fe141-e42a-4d64-90c9-b91e13632a76"} : dispatch 2024-03-25T09:13:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:43 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b55fe141-e42a-4d64-90c9-b91e13632a76"}]': finished 2024-03-25T09:13:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:43 smithi059 ceph-mon[32732]: osdmap e15: 3 total, 2 up, 3 in 2024-03-25T09:13:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:13:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:43 smithi040 ceph-mon[33094]: from='client.? 172.21.15.40:0/2875397806' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b55fe141-e42a-4d64-90c9-b91e13632a76"} : dispatch 2024-03-25T09:13:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:43 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b55fe141-e42a-4d64-90c9-b91e13632a76"} : dispatch 2024-03-25T09:13:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:43 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b55fe141-e42a-4d64-90c9-b91e13632a76"}]': finished 2024-03-25T09:13:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:43 smithi040 ceph-mon[33094]: osdmap e15: 3 total, 2 up, 3 in 2024-03-25T09:13:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:13:45.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:44 smithi019 ceph-mon[29386]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:45.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:44 smithi019 ceph-mon[29386]: from='client.? 172.21.15.40:0/1986499329' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:13:45.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:44 smithi059 ceph-mon[32732]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:45.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:44 smithi059 ceph-mon[32732]: from='client.? 172.21.15.40:0/1986499329' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:13:45.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:44 smithi040 ceph-mon[33094]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:45.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:44 smithi040 ceph-mon[33094]: from='client.? 172.21.15.40:0/1986499329' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:13:46.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:45 smithi059 ceph-mon[32732]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:46.266 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:45 smithi040 ceph-mon[33094]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:45 smithi019 ceph-mon[29386]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:47 smithi059 ceph-mon[32732]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:48.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:47 smithi040 ceph-mon[33094]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:47 smithi019 ceph-mon[29386]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:50.253 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:49 smithi040 ceph-mon[33094]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:50.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:49 smithi059 ceph-mon[32732]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:50.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:49 smithi019 ceph-mon[29386]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:51.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:50 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-03-25T09:13:51.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:50 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:51.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:50 smithi040 ceph-mon[33094]: Deploying daemon osd.2 on smithi040 2024-03-25T09:13:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:50 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-03-25T09:13:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:50 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:50 smithi059 ceph-mon[32732]: Deploying daemon osd.2 on smithi040 2024-03-25T09:13:51.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-03-25T09:13:51.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:51.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:50 smithi019 ceph-mon[29386]: Deploying daemon osd.2 on smithi040 2024-03-25T09:13:52.162 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:51 smithi040 ceph-mon[33094]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:52.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:51 smithi059 ceph-mon[32732]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:51 smithi019 ceph-mon[29386]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:54.171 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:53 smithi040 ceph-mon[33094]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:54.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:53 smithi059 ceph-mon[32732]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:53 smithi019 ceph-mon[29386]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:56.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:56.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:56 smithi019 ceph-mon[29386]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:56.917 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:56 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:56.917 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:56 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:56.917 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:56 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:56.917 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:56 smithi040 ceph-mon[33094]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:56 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:56 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:56 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:13:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:56 smithi059 ceph-mon[32732]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:58.251 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:57 smithi040 ceph-mon[33094]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:57 smithi059 ceph-mon[32732]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:58.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:57 smithi019 ceph-mon[29386]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:13:59.334 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:59 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:59.335 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:59 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:59.335 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:59 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:59.335 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:59 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:59.335 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:59 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:59.335 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:59 smithi040 ceph-mon[33094]: from='osd.2 [v2:172.21.15.40:6800/1433104527,v1:172.21.15.40:6801/1433104527]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-25T09:13:59.335 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:13:59 smithi040 ceph-mon[33094]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-25T09:13:59.375 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 2 on host 'smithi040' 2024-03-25T09:13:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:59 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:59 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:59 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:59 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:59 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:59 smithi019 ceph-mon[29386]: from='osd.2 [v2:172.21.15.40:6800/1433104527,v1:172.21.15.40:6801/1433104527]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-25T09:13:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:13:59 smithi019 ceph-mon[29386]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-25T09:13:59.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:59 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:59.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:59 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:59.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:59 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:13:59.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:59 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:13:59.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:59 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:13:59.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:59 smithi059 ceph-mon[32732]: from='osd.2 [v2:172.21.15.40:6800/1433104527,v1:172.21.15.40:6801/1433104527]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-25T09:13:59.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:13:59 smithi059 ceph-mon[32732]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-25T09:14:00.114 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-mon[33094]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-25T09:14:00.114 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-mon[33094]: from='osd.2 [v2:172.21.15.40:6800/1433104527,v1:172.21.15.40:6801/1433104527]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:00.114 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-mon[33094]: osdmap e16: 3 total, 2 up, 3 in 2024-03-25T09:14:00.114 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:00.114 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-mon[33094]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:00.114 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:00.114 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:00.114 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:00.115 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-mon[33094]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:14:00.116 DEBUG:teuthology.orchestra.run.smithi040:osd.2> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.2.service 2024-03-25T09:14:00.118 INFO:tasks.cephadm:Deploying osd.3 on smithi040 with /dev/vg_nvme/lv_3... 2024-03-25T09:14:00.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-25T09:14:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:00 smithi019 ceph-mon[29386]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-25T09:14:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:00 smithi019 ceph-mon[29386]: from='osd.2 [v2:172.21.15.40:6800/1433104527,v1:172.21.15.40:6801/1433104527]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:00 smithi019 ceph-mon[29386]: osdmap e16: 3 total, 2 up, 3 in 2024-03-25T09:14:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:00 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:00 smithi019 ceph-mon[29386]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:00 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:00 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:00 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:00 smithi019 ceph-mon[29386]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:14:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:00 smithi059 ceph-mon[32732]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-25T09:14:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:00 smithi059 ceph-mon[32732]: from='osd.2 [v2:172.21.15.40:6800/1433104527,v1:172.21.15.40:6801/1433104527]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:00 smithi059 ceph-mon[32732]: osdmap e16: 3 total, 2 up, 3 in 2024-03-25T09:14:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:00 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:00 smithi059 ceph-mon[32732]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:00 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:00 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:00 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:00 smithi059 ceph-mon[32732]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:14:00.763 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2[36742]: 2024-03-25T09:14:00.487+0000 7f1ea40f4700 -1 osd.2 0 waiting for initial osdmap 2024-03-25T09:14:00.764 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:14:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2[36742]: 2024-03-25T09:14:00.489+0000 7f1e9bedf700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T09:14:00.947 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.b/config 2024-03-25T09:14:01.350 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:01 smithi040 ceph-mon[33094]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-03-25T09:14:01.350 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:01 smithi040 ceph-mon[33094]: osdmap e17: 3 total, 2 up, 3 in 2024-03-25T09:14:01.350 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:01 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:01.350 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:01 smithi040 ceph-mon[33094]: from='osd.2 ' entity='osd.2' 2024-03-25T09:14:01.350 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:01 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:01 smithi019 ceph-mon[29386]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-03-25T09:14:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:01 smithi019 ceph-mon[29386]: osdmap e17: 3 total, 2 up, 3 in 2024-03-25T09:14:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:01 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:01 smithi019 ceph-mon[29386]: from='osd.2 ' entity='osd.2' 2024-03-25T09:14:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:01 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:01.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:01 smithi059 ceph-mon[32732]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-03-25T09:14:01.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:01 smithi059 ceph-mon[32732]: osdmap e17: 3 total, 2 up, 3 in 2024-03-25T09:14:01.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:01 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:01.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:01 smithi059 ceph-mon[32732]: from='osd.2 ' entity='osd.2' 2024-03-25T09:14:01.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:01 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:02.626 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:02 smithi040 ceph-mon[33094]: purged_snaps scrub starts 2024-03-25T09:14:02.626 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:02 smithi040 ceph-mon[33094]: purged_snaps scrub ok 2024-03-25T09:14:02.627 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:02 smithi040 ceph-mon[33094]: osd.2 [v2:172.21.15.40:6800/1433104527,v1:172.21.15.40:6801/1433104527] boot 2024-03-25T09:14:02.627 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:02 smithi040 ceph-mon[33094]: osdmap e18: 3 total, 3 up, 3 in 2024-03-25T09:14:02.627 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:02 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:02.627 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:02 smithi040 ceph-mon[33094]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:14:02.627 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:02 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-03-25T09:14:02.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:02 smithi059 ceph-mon[32732]: purged_snaps scrub starts 2024-03-25T09:14:02.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:02 smithi059 ceph-mon[32732]: purged_snaps scrub ok 2024-03-25T09:14:02.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:02 smithi059 ceph-mon[32732]: osd.2 [v2:172.21.15.40:6800/1433104527,v1:172.21.15.40:6801/1433104527] boot 2024-03-25T09:14:02.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:02 smithi059 ceph-mon[32732]: osdmap e18: 3 total, 3 up, 3 in 2024-03-25T09:14:02.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:02 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:02.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:02 smithi059 ceph-mon[32732]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:14:02.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:02 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-03-25T09:14:02.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:02 smithi019 ceph-mon[29386]: purged_snaps scrub starts 2024-03-25T09:14:02.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:02 smithi019 ceph-mon[29386]: purged_snaps scrub ok 2024-03-25T09:14:02.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:02 smithi019 ceph-mon[29386]: osd.2 [v2:172.21.15.40:6800/1433104527,v1:172.21.15.40:6801/1433104527] boot 2024-03-25T09:14:02.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:02 smithi019 ceph-mon[29386]: osdmap e18: 3 total, 3 up, 3 in 2024-03-25T09:14:02.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:02 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-25T09:14:02.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:02 smithi019 ceph-mon[29386]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-25T09:14:02.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:02 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-03-25T09:14:03.653 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-25T09:14:03.653 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-25T09:14:03.653 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-03-25T09:14:03.653 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-03-25T09:14:03.654 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110749 s, 947 MB/s 2024-03-25T09:14:03.654 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-03-25T09:14:03.680 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:03 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-25T09:14:03.680 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:03 smithi040 ceph-mon[33094]: osdmap e19: 3 total, 3 up, 3 in 2024-03-25T09:14:03.680 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:03 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-03-25T09:14:03.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:03 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-25T09:14:03.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:03 smithi059 ceph-mon[32732]: osdmap e19: 3 total, 3 up, 3 in 2024-03-25T09:14:03.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:03 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-03-25T09:14:03.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:03 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-25T09:14:03.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:03 smithi019 ceph-mon[29386]: osdmap e19: 3 total, 3 up, 3 in 2024-03-25T09:14:03.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:03 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-03-25T09:14:04.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_3 2024-03-25T09:14:04.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:04 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-25T09:14:04.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:04 smithi059 ceph-mon[32732]: osdmap e20: 3 total, 3 up, 3 in 2024-03-25T09:14:04.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:04 smithi059 ceph-mon[32732]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:04.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:04 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:04 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:04 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:04.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:04 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:04 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:04.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:04 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:04.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:04 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:04 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-25T09:14:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:04 smithi040 ceph-mon[33094]: osdmap e20: 3 total, 3 up, 3 in 2024-03-25T09:14:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:04 smithi040 ceph-mon[33094]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:04 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:04 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:04 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:04 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:04 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:04 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:04 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.770 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:14:04 smithi019 sudo[53374]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-25T09:14:04.770 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:14:04 smithi019 sudo[53374]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:04.771 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:14:04 smithi019 sudo[53374]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:04.771 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:14:04 smithi019 sudo[53374]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:04.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:04 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-25T09:14:04.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:04 smithi019 ceph-mon[29386]: osdmap e20: 3 total, 3 up, 3 in 2024-03-25T09:14:04.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:04 smithi019 ceph-mon[29386]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:04.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:04 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:04 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:04 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:04.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:04 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:04 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:04.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:04 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:04.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:04 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.b/config 2024-03-25T09:14:05.303 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53377]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-25T09:14:05.303 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53377]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:05.303 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53377]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:05.303 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53377]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:05.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:05 smithi019 ceph-mon[29386]: Detected new or changed devices on smithi040 2024-03-25T09:14:05.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:05 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi040 to 21189M 2024-03-25T09:14:05.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:05 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:05.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:05 smithi019 ceph-mon[29386]: osdmap e21: 3 total, 3 up, 3 in 2024-03-25T09:14:05.570 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53380]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-25T09:14:05.570 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53380]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:05.570 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53380]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:05.570 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53380]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:05 smithi059 ceph-mon[32732]: Detected new or changed devices on smithi040 2024-03-25T09:14:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:05 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi040 to 21189M 2024-03-25T09:14:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:05 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:05 smithi059 ceph-mon[32732]: osdmap e21: 3 total, 3 up, 3 in 2024-03-25T09:14:05.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:05 smithi040 ceph-mon[33094]: Detected new or changed devices on smithi040 2024-03-25T09:14:05.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:05 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi040 to 21189M 2024-03-25T09:14:05.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:05 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:05.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:05 smithi040 ceph-mon[33094]: osdmap e21: 3 total, 3 up, 3 in 2024-03-25T09:14:05.908 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53383]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-25T09:14:05.908 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53383]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:05.908 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53383]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:05.908 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:14:05 smithi019 sudo[53383]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:06.105 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:14:05 smithi040 sudo[40291]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-25T09:14:06.105 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:14:05 smithi040 sudo[40291]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:06.105 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:14:05 smithi040 sudo[40291]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:06.105 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:14:05 smithi040 sudo[40291]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:06.375 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:14:06 smithi040 sudo[40314]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-25T09:14:06.375 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:14:06 smithi040 sudo[40314]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:06.375 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:14:06 smithi040 sudo[40314]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:06.375 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:14:06 smithi040 sudo[40314]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:06.649 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:06 smithi019 sudo[53386]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-25T09:14:06.649 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:06 smithi019 sudo[53386]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:06.649 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:06 smithi019 sudo[53386]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:06.649 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:06 smithi019 sudo[53386]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:06 smithi019 sudo[53389]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-25T09:14:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:06 smithi019 sudo[53389]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:06 smithi019 sudo[53389]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:06 smithi019 sudo[53389]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:07.177 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:06 smithi059 sudo[34516]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-25T09:14:07.177 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:06 smithi059 sudo[34516]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:07.177 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:06 smithi059 sudo[34516]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:07.177 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:06 smithi059 sudo[34516]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:07.454 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 ceph-mon[33094]: mgrmap e14: x(active, since 2m) 2024-03-25T09:14:07.454 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 ceph-mon[33094]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:07.454 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:07.454 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 ceph-mon[33094]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-25T09:14:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:07 smithi059 sudo[34519]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-25T09:14:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:07 smithi059 sudo[34519]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:07 smithi059 sudo[34519]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:07 smithi059 sudo[34519]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:07 smithi059 ceph-mon[32732]: mgrmap e14: x(active, since 2m) 2024-03-25T09:14:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:07 smithi059 ceph-mon[32732]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:07.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:07 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:07.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:07 smithi059 ceph-mon[32732]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-25T09:14:07.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:07 smithi019 ceph-mon[29386]: mgrmap e14: x(active, since 2m) 2024-03-25T09:14:07.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:07 smithi019 ceph-mon[29386]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:07.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:07 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:07.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:07 smithi019 ceph-mon[29386]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-25T09:14:07.722 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 sudo[40470]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-25T09:14:07.722 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 sudo[40470]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:07.722 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 sudo[40470]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:07.723 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 sudo[40470]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:08.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 sudo[40488]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-25T09:14:08.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 sudo[40488]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-25T09:14:08.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 sudo[40488]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-25T09:14:08.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:07 smithi040 sudo[40488]: pam_unix(sudo:session): session closed for user root 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:14:08.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:08.402 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-25T09:14:08.402 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:08.402 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-25T09:14:08.402 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:14:08.402 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:14:08.402 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:14:08.402 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-25T09:14:08.402 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:08 smithi040 ceph-mon[33094]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:14:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-25T09:14:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:14:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:14:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-25T09:14:08.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:08 smithi019 ceph-mon[29386]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:14:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-25T09:14:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:14:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:14:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:14:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:14:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-25T09:14:08.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:08 smithi059 ceph-mon[32732]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:09.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:09 smithi019 ceph-mon[29386]: from='client.? 172.21.15.40:0/1687511501' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "22630c5e-7f72-4e80-ae1d-518e90aaad9e"} : dispatch 2024-03-25T09:14:09.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:09 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "22630c5e-7f72-4e80-ae1d-518e90aaad9e"} : dispatch 2024-03-25T09:14:09.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:09 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22630c5e-7f72-4e80-ae1d-518e90aaad9e"}]': finished 2024-03-25T09:14:09.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:09 smithi019 ceph-mon[29386]: osdmap e22: 4 total, 3 up, 4 in 2024-03-25T09:14:09.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:09 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:09.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:09 smithi059 ceph-mon[32732]: from='client.? 172.21.15.40:0/1687511501' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "22630c5e-7f72-4e80-ae1d-518e90aaad9e"} : dispatch 2024-03-25T09:14:09.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:09 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "22630c5e-7f72-4e80-ae1d-518e90aaad9e"} : dispatch 2024-03-25T09:14:09.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:09 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22630c5e-7f72-4e80-ae1d-518e90aaad9e"}]': finished 2024-03-25T09:14:09.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:09 smithi059 ceph-mon[32732]: osdmap e22: 4 total, 3 up, 4 in 2024-03-25T09:14:09.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:09 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:09.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:09 smithi040 ceph-mon[33094]: from='client.? 172.21.15.40:0/1687511501' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "22630c5e-7f72-4e80-ae1d-518e90aaad9e"} : dispatch 2024-03-25T09:14:09.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:09 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "22630c5e-7f72-4e80-ae1d-518e90aaad9e"} : dispatch 2024-03-25T09:14:09.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:09 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22630c5e-7f72-4e80-ae1d-518e90aaad9e"}]': finished 2024-03-25T09:14:09.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:09 smithi040 ceph-mon[33094]: osdmap e22: 4 total, 3 up, 4 in 2024-03-25T09:14:09.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:09 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:10 smithi040 ceph-mon[33094]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:10 smithi040 ceph-mon[33094]: from='client.? 172.21.15.40:0/1042789682' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:14:10.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:10 smithi019 ceph-mon[29386]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:10.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:10 smithi019 ceph-mon[29386]: from='client.? 172.21.15.40:0/1042789682' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:14:10.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:10 smithi059 ceph-mon[32732]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:10.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:10 smithi059 ceph-mon[32732]: from='client.? 172.21.15.40:0/1042789682' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:14:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:11 smithi059 ceph-mon[32732]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:11 smithi040 ceph-mon[33094]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:12.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:11 smithi019 ceph-mon[29386]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:14.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:13 smithi059 ceph-mon[32732]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-25T09:14:14.262 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:13 smithi040 ceph-mon[33094]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-25T09:14:14.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:13 smithi019 ceph-mon[29386]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-25T09:14:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:15 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-03-25T09:14:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:15 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-03-25T09:14:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:16.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:15 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-03-25T09:14:16.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:15 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:16 smithi040 ceph-mon[33094]: Deploying daemon osd.3 on smithi040 2024-03-25T09:14:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:16 smithi040 ceph-mon[33094]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-25T09:14:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:16 smithi019 ceph-mon[29386]: Deploying daemon osd.3 on smithi040 2024-03-25T09:14:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:16 smithi019 ceph-mon[29386]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-25T09:14:17.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:16 smithi059 ceph-mon[32732]: Deploying daemon osd.3 on smithi040 2024-03-25T09:14:17.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:16 smithi059 ceph-mon[32732]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-25T09:14:18.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:17 smithi040 ceph-mon[33094]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-25T09:14:18.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:17 smithi059 ceph-mon[32732]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-25T09:14:18.384 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:17 smithi019 ceph-mon[29386]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-25T09:14:20.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:19 smithi040 ceph-mon[33094]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 74 KiB/s wr, 5 op/s 2024-03-25T09:14:20.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:19 smithi059 ceph-mon[32732]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 74 KiB/s wr, 5 op/s 2024-03-25T09:14:20.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:19 smithi019 ceph-mon[29386]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 74 KiB/s wr, 5 op/s 2024-03-25T09:14:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:21 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:21 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:21 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:22.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:21 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:22.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:21 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:22.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:21 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:21 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:21 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:21 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:23.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:22 smithi040 ceph-mon[33094]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-25T09:14:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:22 smithi059 ceph-mon[32732]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-25T09:14:23.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:22 smithi019 ceph-mon[29386]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-25T09:14:24.614 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:24.614 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:24.614 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:24 smithi040 ceph-mon[33094]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-25T09:14:24.614 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:24 smithi040 ceph-mon[33094]: from='osd.3 [v2:172.21.15.40:6808/736915151,v1:172.21.15.40:6809/736915151]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-25T09:14:24.615 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:24 smithi040 ceph-mon[33094]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-25T09:14:24.615 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:24.615 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:24.615 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:24.615 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 3 on host 'smithi040' 2024-03-25T09:14:24.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:24.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:24.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:24 smithi059 ceph-mon[32732]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-25T09:14:24.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:24 smithi059 ceph-mon[32732]: from='osd.3 [v2:172.21.15.40:6808/736915151,v1:172.21.15.40:6809/736915151]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-25T09:14:24.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:24 smithi059 ceph-mon[32732]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-25T09:14:24.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:24.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:24.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:24.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:24.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:24.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:24 smithi019 ceph-mon[29386]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-25T09:14:24.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:24 smithi019 ceph-mon[29386]: from='osd.3 [v2:172.21.15.40:6808/736915151,v1:172.21.15.40:6809/736915151]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-25T09:14:24.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:24 smithi019 ceph-mon[29386]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-25T09:14:24.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:24.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:24.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:25.296 DEBUG:teuthology.orchestra.run.smithi040:osd.3> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.3.service 2024-03-25T09:14:25.298 INFO:tasks.cephadm:Deploying osd.4 on smithi040 with /dev/vg_nvme/lv_2... 2024-03-25T09:14:25.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-25T09:14:25.542 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:25 smithi040 ceph-mon[33094]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-25T09:14:25.542 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:25 smithi040 ceph-mon[33094]: osdmap e23: 4 total, 3 up, 4 in 2024-03-25T09:14:25.542 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:25 smithi040 ceph-mon[33094]: from='osd.3 [v2:172.21.15.40:6808/736915151,v1:172.21.15.40:6809/736915151]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:25.542 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:25 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:25.542 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:25 smithi040 ceph-mon[33094]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:25.542 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:25 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:25.542 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:25 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:25.542 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:25 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:25 smithi059 ceph-mon[32732]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-25T09:14:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:25 smithi059 ceph-mon[32732]: osdmap e23: 4 total, 3 up, 4 in 2024-03-25T09:14:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:25 smithi059 ceph-mon[32732]: from='osd.3 [v2:172.21.15.40:6808/736915151,v1:172.21.15.40:6809/736915151]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:25 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:25 smithi059 ceph-mon[32732]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:25 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:25 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:25 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:25.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:25 smithi019 ceph-mon[29386]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-25T09:14:25.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:25 smithi019 ceph-mon[29386]: osdmap e23: 4 total, 3 up, 4 in 2024-03-25T09:14:25.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:25 smithi019 ceph-mon[29386]: from='osd.3 [v2:172.21.15.40:6808/736915151,v1:172.21.15.40:6809/736915151]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:25.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:25 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:25.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:25 smithi019 ceph-mon[29386]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:25.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:25 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:25.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:25 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:25.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:25 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:26.253 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:14:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3[42245]: 2024-03-25T09:14:25.916+0000 7f5862c76700 -1 osd.3 0 waiting for initial osdmap 2024-03-25T09:14:26.253 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:14:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3[42245]: 2024-03-25T09:14:25.919+0000 7f585aa61700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T09:14:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:26 smithi040 ceph-mon[33094]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-03-25T09:14:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:26 smithi040 ceph-mon[33094]: osdmap e24: 4 total, 3 up, 4 in 2024-03-25T09:14:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:26 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:26 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:26 smithi040 ceph-mon[33094]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:26 smithi040 ceph-mon[33094]: from='osd.3 ' entity='osd.3' 2024-03-25T09:14:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:26 smithi040 ceph-mon[33094]: osd.3 [v2:172.21.15.40:6808/736915151,v1:172.21.15.40:6809/736915151] boot 2024-03-25T09:14:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:26 smithi040 ceph-mon[33094]: osdmap e25: 4 total, 4 up, 4 in 2024-03-25T09:14:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:26 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:26 smithi059 ceph-mon[32732]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-03-25T09:14:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:26 smithi059 ceph-mon[32732]: osdmap e24: 4 total, 3 up, 4 in 2024-03-25T09:14:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:26 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:26 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:26 smithi059 ceph-mon[32732]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:26 smithi059 ceph-mon[32732]: from='osd.3 ' entity='osd.3' 2024-03-25T09:14:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:26 smithi059 ceph-mon[32732]: osd.3 [v2:172.21.15.40:6808/736915151,v1:172.21.15.40:6809/736915151] boot 2024-03-25T09:14:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:26 smithi059 ceph-mon[32732]: osdmap e25: 4 total, 4 up, 4 in 2024-03-25T09:14:26.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:26 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:26.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:26 smithi019 ceph-mon[29386]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-03-25T09:14:26.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:26 smithi019 ceph-mon[29386]: osdmap e24: 4 total, 3 up, 4 in 2024-03-25T09:14:26.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:26 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:26.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:26 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:26.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:26 smithi019 ceph-mon[29386]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-25T09:14:26.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:26 smithi019 ceph-mon[29386]: from='osd.3 ' entity='osd.3' 2024-03-25T09:14:26.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:26 smithi019 ceph-mon[29386]: osd.3 [v2:172.21.15.40:6808/736915151,v1:172.21.15.40:6809/736915151] boot 2024-03-25T09:14:26.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:26 smithi019 ceph-mon[29386]: osdmap e25: 4 total, 4 up, 4 in 2024-03-25T09:14:26.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:26 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-25T09:14:27.029 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.b/config 2024-03-25T09:14:27.718 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:27 smithi040 ceph-mon[33094]: purged_snaps scrub starts 2024-03-25T09:14:27.718 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:27 smithi040 ceph-mon[33094]: purged_snaps scrub ok 2024-03-25T09:14:27.718 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:27 smithi040 ceph-mon[33094]: osdmap e26: 4 total, 4 up, 4 in 2024-03-25T09:14:27.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:27 smithi059 ceph-mon[32732]: purged_snaps scrub starts 2024-03-25T09:14:27.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:27 smithi059 ceph-mon[32732]: purged_snaps scrub ok 2024-03-25T09:14:27.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:27 smithi059 ceph-mon[32732]: osdmap e26: 4 total, 4 up, 4 in 2024-03-25T09:14:27.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:27 smithi019 ceph-mon[29386]: purged_snaps scrub starts 2024-03-25T09:14:27.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:27 smithi019 ceph-mon[29386]: purged_snaps scrub ok 2024-03-25T09:14:27.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:27 smithi019 ceph-mon[29386]: osdmap e26: 4 total, 4 up, 4 in 2024-03-25T09:14:28.733 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:28 smithi040 ceph-mon[33094]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:28.733 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.733 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.733 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:28.733 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:28.733 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.733 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:28.734 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:28.734 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.734 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:28 smithi040 ceph-mon[33094]: osdmap e27: 4 total, 4 up, 4 in 2024-03-25T09:14:28.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:28 smithi059 ceph-mon[32732]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:28.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:28.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:28.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:28.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:28.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:28 smithi059 ceph-mon[32732]: osdmap e27: 4 total, 4 up, 4 in 2024-03-25T09:14:28.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:28 smithi019 ceph-mon[29386]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:28.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:28.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:28.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:28.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:28.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:28.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:28 smithi019 ceph-mon[29386]: osdmap e27: 4 total, 4 up, 4 in 2024-03-25T09:14:29.588 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-25T09:14:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-25T09:14:29.589 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-03-25T09:14:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-03-25T09:14:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111088 s, 944 MB/s 2024-03-25T09:14:29.589 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 2024-03-25T09:14:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-03-25T09:14:29.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:29 smithi059 ceph-mon[32732]: Detected new or changed devices on smithi040 2024-03-25T09:14:29.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:29 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi040 to 10594M 2024-03-25T09:14:29.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:29 smithi040 ceph-mon[33094]: Detected new or changed devices on smithi040 2024-03-25T09:14:29.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:29 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi040 to 10594M 2024-03-25T09:14:29.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:29 smithi019 ceph-mon[29386]: Detected new or changed devices on smithi040 2024-03-25T09:14:29.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:29 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi040 to 10594M 2024-03-25T09:14:30.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_2 2024-03-25T09:14:30.481 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.b/config 2024-03-25T09:14:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:30 smithi059 ceph-mon[32732]: osdmap e28: 4 total, 4 up, 4 in 2024-03-25T09:14:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:30 smithi059 ceph-mon[32732]: pgmap v109: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-25T09:14:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:30 smithi040 ceph-mon[33094]: osdmap e28: 4 total, 4 up, 4 in 2024-03-25T09:14:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:30 smithi040 ceph-mon[33094]: pgmap v109: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-25T09:14:30.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:30 smithi019 ceph-mon[29386]: osdmap e28: 4 total, 4 up, 4 in 2024-03-25T09:14:30.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:30 smithi019 ceph-mon[29386]: pgmap v109: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-25T09:14:31.713 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:31 smithi040 ceph-mon[33094]: osdmap e29: 4 total, 4 up, 4 in 2024-03-25T09:14:31.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:31 smithi059 ceph-mon[32732]: osdmap e29: 4 total, 4 up, 4 in 2024-03-25T09:14:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:31 smithi019 ceph-mon[29386]: osdmap e29: 4 total, 4 up, 4 in 2024-03-25T09:14:32.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:32 smithi040 ceph-mon[33094]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-03-25T09:14:32.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:14:32.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:14:32.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:32.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:32 smithi019 ceph-mon[29386]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-03-25T09:14:32.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:14:32.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:14:32.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:33.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:32 smithi059 ceph-mon[32732]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-03-25T09:14:33.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:14:33.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:14:33.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:33.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:33 smithi059 ceph-mon[32732]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:14:33.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:33 smithi040 ceph-mon[33094]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:14:33.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:33 smithi019 ceph-mon[29386]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:14:34.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:34 smithi019 ceph-mon[29386]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-25T09:14:35.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:34 smithi059 ceph-mon[32732]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-25T09:14:35.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:34 smithi040 ceph-mon[33094]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-25T09:14:35.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:35 smithi019 ceph-mon[29386]: from='client.? 172.21.15.40:0/2696312260' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cd59332-94eb-4561-8087-35997ce9d39d"} : dispatch 2024-03-25T09:14:35.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:35 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cd59332-94eb-4561-8087-35997ce9d39d"} : dispatch 2024-03-25T09:14:35.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:35 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cd59332-94eb-4561-8087-35997ce9d39d"}]': finished 2024-03-25T09:14:35.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:35 smithi019 ceph-mon[29386]: osdmap e30: 5 total, 4 up, 5 in 2024-03-25T09:14:35.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:36.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:35 smithi059 ceph-mon[32732]: from='client.? 172.21.15.40:0/2696312260' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cd59332-94eb-4561-8087-35997ce9d39d"} : dispatch 2024-03-25T09:14:36.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:35 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cd59332-94eb-4561-8087-35997ce9d39d"} : dispatch 2024-03-25T09:14:36.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:35 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cd59332-94eb-4561-8087-35997ce9d39d"}]': finished 2024-03-25T09:14:36.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:35 smithi059 ceph-mon[32732]: osdmap e30: 5 total, 4 up, 5 in 2024-03-25T09:14:36.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:36.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:35 smithi040 ceph-mon[33094]: from='client.? 172.21.15.40:0/2696312260' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cd59332-94eb-4561-8087-35997ce9d39d"} : dispatch 2024-03-25T09:14:36.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:35 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cd59332-94eb-4561-8087-35997ce9d39d"} : dispatch 2024-03-25T09:14:36.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:35 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cd59332-94eb-4561-8087-35997ce9d39d"}]': finished 2024-03-25T09:14:36.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:35 smithi040 ceph-mon[33094]: osdmap e30: 5 total, 4 up, 5 in 2024-03-25T09:14:36.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:36.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:36 smithi019 ceph-mon[29386]: from='client.? 172.21.15.40:0/987154981' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:14:36.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:36 smithi019 ceph-mon[29386]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:36 smithi059 ceph-mon[32732]: from='client.? 172.21.15.40:0/987154981' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:14:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:36 smithi059 ceph-mon[32732]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:36 smithi040 ceph-mon[33094]: from='client.? 172.21.15.40:0/987154981' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:14:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:36 smithi040 ceph-mon[33094]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:38.224 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:37 smithi040 ceph-mon[33094]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:37 smithi059 ceph-mon[32732]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:38.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:37 smithi019 ceph-mon[29386]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:39 smithi059 ceph-mon[32732]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:40.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:39 smithi040 ceph-mon[33094]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:39 smithi019 ceph-mon[29386]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:41.860 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-03-25T09:14:41.860 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-03-25T09:14:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-03-25T09:14:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:42 smithi040 ceph-mon[33094]: Deploying daemon osd.4 on smithi040 2024-03-25T09:14:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:42 smithi040 ceph-mon[33094]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:42 smithi019 ceph-mon[29386]: Deploying daemon osd.4 on smithi040 2024-03-25T09:14:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:42 smithi019 ceph-mon[29386]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:43.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:42 smithi059 ceph-mon[32732]: Deploying daemon osd.4 on smithi040 2024-03-25T09:14:43.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:42 smithi059 ceph-mon[32732]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:44.233 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:43 smithi040 ceph-mon[33094]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:44.340 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:43 smithi059 ceph-mon[32732]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:43 smithi019 ceph-mon[29386]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:46.174 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:45 smithi040 ceph-mon[33094]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:46.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:45 smithi059 ceph-mon[32732]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:45 smithi019 ceph-mon[29386]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:48 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:48 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:48 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:48 smithi059 ceph-mon[32732]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:48.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:48 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:48.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:48 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:48.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:48 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:48.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:48 smithi040 ceph-mon[33094]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:48 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:48 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:48 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:48 smithi019 ceph-mon[29386]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:50.748 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 4 on host 'smithi040' 2024-03-25T09:14:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:51.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:51.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: from='osd.4 [v2:172.21.15.40:6816/3881244643,v1:172.21.15.40:6817/3881244643]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-25T09:14:51.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-25T09:14:51.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:50 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:51.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:51.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:51.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: from='osd.4 [v2:172.21.15.40:6816/3881244643,v1:172.21.15.40:6817/3881244643]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-25T09:14:51.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-25T09:14:51.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:50 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: from='osd.4 [v2:172.21.15.40:6816/3881244643,v1:172.21.15.40:6817/3881244643]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-25T09:14:51.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-25T09:14:51.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:51.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:50 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:14:51.452 DEBUG:teuthology.orchestra.run.smithi040:osd.4> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.4.service 2024-03-25T09:14:51.454 INFO:tasks.cephadm:Deploying osd.5 on smithi059 with /dev/vg_nvme/lv_4... 2024-03-25T09:14:51.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-25T09:14:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.c/config 2024-03-25T09:14:52.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:51 smithi040 ceph-mon[33094]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-25T09:14:52.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:51 smithi040 ceph-mon[33094]: osdmap e31: 5 total, 4 up, 5 in 2024-03-25T09:14:52.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:51 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:52.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:51 smithi040 ceph-mon[33094]: from='osd.4 [v2:172.21.15.40:6816/3881244643,v1:172.21.15.40:6817/3881244643]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:52.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:51 smithi040 ceph-mon[33094]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:52.014 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:14:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:14:51.903+0000 7fd583818700 -1 osd.4 0 waiting for initial osdmap 2024-03-25T09:14:52.014 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:14:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:14:51.907+0000 7fd57f60b700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T09:14:52.137 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:51 smithi059 ceph-mon[32732]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-25T09:14:52.137 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:51 smithi059 ceph-mon[32732]: osdmap e31: 5 total, 4 up, 5 in 2024-03-25T09:14:52.137 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:51 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:52.137 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:51 smithi059 ceph-mon[32732]: from='osd.4 [v2:172.21.15.40:6816/3881244643,v1:172.21.15.40:6817/3881244643]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:52.137 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:51 smithi059 ceph-mon[32732]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:51 smithi019 ceph-mon[29386]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-25T09:14:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:51 smithi019 ceph-mon[29386]: osdmap e31: 5 total, 4 up, 5 in 2024-03-25T09:14:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:51 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:51 smithi019 ceph-mon[29386]: from='osd.4 [v2:172.21.15.40:6816/3881244643,v1:172.21.15.40:6817/3881244643]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:51 smithi019 ceph-mon[29386]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi040", "root=default"]} : dispatch 2024-03-25T09:14:52.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:52 smithi059 ceph-mon[32732]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-03-25T09:14:52.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:52 smithi059 ceph-mon[32732]: osdmap e32: 5 total, 4 up, 5 in 2024-03-25T09:14:52.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:52 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:52.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:52 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:52.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:52 smithi059 ceph-mon[32732]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:53.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:52 smithi019 ceph-mon[29386]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-03-25T09:14:53.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:52 smithi019 ceph-mon[29386]: osdmap e32: 5 total, 4 up, 5 in 2024-03-25T09:14:53.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:52 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:53.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:52 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:53.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:52 smithi019 ceph-mon[29386]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:53.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:52 smithi040 ceph-mon[33094]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-03-25T09:14:53.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:52 smithi040 ceph-mon[33094]: osdmap e32: 5 total, 4 up, 5 in 2024-03-25T09:14:53.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:52 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:53.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:52 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:53.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:52 smithi040 ceph-mon[33094]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2024-03-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2024-03-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111049 s, 944 MB/s 2024-03-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2024-03-25T09:14:54.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi059:vg_nvme/lv_4 2024-03-25T09:14:54.159 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:53 smithi059 ceph-mon[32732]: purged_snaps scrub starts 2024-03-25T09:14:54.159 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:53 smithi059 ceph-mon[32732]: purged_snaps scrub ok 2024-03-25T09:14:54.159 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:53 smithi059 ceph-mon[32732]: osd.4 [v2:172.21.15.40:6816/3881244643,v1:172.21.15.40:6817/3881244643] boot 2024-03-25T09:14:54.159 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:53 smithi059 ceph-mon[32732]: osdmap e33: 5 total, 5 up, 5 in 2024-03-25T09:14:54.159 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:53 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:54.204 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:53 smithi040 ceph-mon[33094]: purged_snaps scrub starts 2024-03-25T09:14:54.204 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:53 smithi040 ceph-mon[33094]: purged_snaps scrub ok 2024-03-25T09:14:54.204 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:53 smithi040 ceph-mon[33094]: osd.4 [v2:172.21.15.40:6816/3881244643,v1:172.21.15.40:6817/3881244643] boot 2024-03-25T09:14:54.204 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:53 smithi040 ceph-mon[33094]: osdmap e33: 5 total, 5 up, 5 in 2024-03-25T09:14:54.204 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:53 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.c/config 2024-03-25T09:14:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:53 smithi019 ceph-mon[29386]: purged_snaps scrub starts 2024-03-25T09:14:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:53 smithi019 ceph-mon[29386]: purged_snaps scrub ok 2024-03-25T09:14:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:53 smithi019 ceph-mon[29386]: osd.4 [v2:172.21.15.40:6816/3881244643,v1:172.21.15.40:6817/3881244643] boot 2024-03-25T09:14:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:53 smithi019 ceph-mon[29386]: osdmap e33: 5 total, 5 up, 5 in 2024-03-25T09:14:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:53 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-25T09:14:55.135 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:14:55.135 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: osdmap e34: 5 total, 5 up, 5 in 2024-03-25T09:14:55.135 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.135 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.136 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:55.136 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:55.136 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:55.136 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.136 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:55.136 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:55.136 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:54 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:14:55.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: osdmap e34: 5 total, 5 up, 5 in 2024-03-25T09:14:55.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:54 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:14:55.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: osdmap e34: 5 total, 5 up, 5 in 2024-03-25T09:14:55.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:55.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-25T09:14:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:14:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:54 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:14:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:55 smithi059 ceph-mon[32732]: Detected new or changed devices on smithi040 2024-03-25T09:14:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:55 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi040 to 7063M 2024-03-25T09:14:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:55 smithi040 ceph-mon[33094]: Detected new or changed devices on smithi040 2024-03-25T09:14:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:55 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi040 to 7063M 2024-03-25T09:14:56.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:55 smithi019 ceph-mon[29386]: Detected new or changed devices on smithi040 2024-03-25T09:14:56.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:55 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi040 to 7063M 2024-03-25T09:14:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:56 smithi059 ceph-mon[32732]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:14:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:56 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:14:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:56 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:14:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:56 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:57.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:56 smithi040 ceph-mon[33094]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:14:57.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:56 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:14:57.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:56 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:14:57.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:56 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:56 smithi019 ceph-mon[29386]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:14:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:14:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:14:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:56 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:14:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:57 smithi059 ceph-mon[32732]: from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:14:58.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:57 smithi040 ceph-mon[33094]: from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:14:58.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:57 smithi019 ceph-mon[29386]: from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:14:59.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:58 smithi059 ceph-mon[32732]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:14:59.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:58 smithi059 ceph-mon[32732]: from='client.? 172.21.15.59:0/2566644252' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a763a57a-067a-440c-afc8-dc4966bc4a34"} : dispatch 2024-03-25T09:14:59.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:58 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a763a57a-067a-440c-afc8-dc4966bc4a34"} : dispatch 2024-03-25T09:14:59.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:58 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a763a57a-067a-440c-afc8-dc4966bc4a34"}]': finished 2024-03-25T09:14:59.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:58 smithi059 ceph-mon[32732]: osdmap e35: 6 total, 5 up, 6 in 2024-03-25T09:14:59.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:58 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:14:59.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:58 smithi040 ceph-mon[33094]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:14:59.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:58 smithi040 ceph-mon[33094]: from='client.? 172.21.15.59:0/2566644252' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a763a57a-067a-440c-afc8-dc4966bc4a34"} : dispatch 2024-03-25T09:14:59.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:58 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a763a57a-067a-440c-afc8-dc4966bc4a34"} : dispatch 2024-03-25T09:14:59.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:58 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a763a57a-067a-440c-afc8-dc4966bc4a34"}]': finished 2024-03-25T09:14:59.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:58 smithi040 ceph-mon[33094]: osdmap e35: 6 total, 5 up, 6 in 2024-03-25T09:14:59.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:58 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:14:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:58 smithi019 ceph-mon[29386]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:14:59.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:58 smithi019 ceph-mon[29386]: from='client.? 172.21.15.59:0/2566644252' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a763a57a-067a-440c-afc8-dc4966bc4a34"} : dispatch 2024-03-25T09:14:59.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:58 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a763a57a-067a-440c-afc8-dc4966bc4a34"} : dispatch 2024-03-25T09:14:59.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:58 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a763a57a-067a-440c-afc8-dc4966bc4a34"}]': finished 2024-03-25T09:14:59.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:58 smithi019 ceph-mon[29386]: osdmap e35: 6 total, 5 up, 6 in 2024-03-25T09:14:59.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:58 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:00.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:14:59 smithi059 ceph-mon[32732]: from='client.? 172.21.15.59:0/2011008350' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:15:00.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:14:59 smithi040 ceph-mon[33094]: from='client.? 172.21.15.59:0/2011008350' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:15:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:14:59 smithi019 ceph-mon[29386]: from='client.? 172.21.15.59:0/2011008350' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:15:01.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:00 smithi059 ceph-mon[32732]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:00 smithi040 ceph-mon[33094]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:00 smithi019 ceph-mon[29386]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:03.131 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:02 smithi059 ceph-mon[32732]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:02 smithi040 ceph-mon[33094]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:03.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:02 smithi019 ceph-mon[29386]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:04.176 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:04 smithi059 ceph-mon[32732]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:04.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:04 smithi040 ceph-mon[33094]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:04 smithi019 ceph-mon[29386]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:05.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:05 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-03-25T09:15:05.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:05 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:05 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-03-25T09:15:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:05 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:05 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-03-25T09:15:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:05 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:06 smithi059 ceph-mon[32732]: Deploying daemon osd.5 on smithi059 2024-03-25T09:15:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:06 smithi059 ceph-mon[32732]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:06.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:06 smithi019 ceph-mon[29386]: Deploying daemon osd.5 on smithi059 2024-03-25T09:15:06.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:06 smithi019 ceph-mon[29386]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:06 smithi040 ceph-mon[33094]: Deploying daemon osd.5 on smithi059 2024-03-25T09:15:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:06 smithi040 ceph-mon[33094]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:08.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:07 smithi059 ceph-mon[32732]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:08.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:07 smithi040 ceph-mon[33094]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:07 smithi019 ceph-mon[29386]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:10.073 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:09 smithi059 ceph-mon[32732]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:10.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:09 smithi040 ceph-mon[33094]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:10.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:09 smithi019 ceph-mon[29386]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:11.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:11 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:11.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:11 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:11.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:11 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:11.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:11 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:11.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:11 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:11.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:11 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:11.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:11 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:11.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:11 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:11.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:11 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:12.323 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:12 smithi059 ceph-mon[32732]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:12.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:12 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:12.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:12 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:12.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:12 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:12.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:12 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:12.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:12 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:12 smithi040 ceph-mon[33094]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:12 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:12 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:12 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:12 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:12 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:12.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:12 smithi019 ceph-mon[29386]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:12.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:12 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:12.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:12 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:12.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:12 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:12.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:12 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:12.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:12 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:13.638 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:13 smithi059 ceph-mon[32732]: from='osd.5 [v2:172.21.15.59:6800/2143276076,v1:172.21.15.59:6801/2143276076]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-25T09:15:13.638 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:13 smithi059 ceph-mon[32732]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-25T09:15:13.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:13 smithi019 ceph-mon[29386]: from='osd.5 [v2:172.21.15.59:6800/2143276076,v1:172.21.15.59:6801/2143276076]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-25T09:15:13.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:13 smithi019 ceph-mon[29386]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-25T09:15:13.699 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 5 on host 'smithi059' 2024-03-25T09:15:13.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:13 smithi040 ceph-mon[33094]: from='osd.5 [v2:172.21.15.59:6800/2143276076,v1:172.21.15.59:6801/2143276076]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-25T09:15:13.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:13 smithi040 ceph-mon[33094]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-25T09:15:14.286 DEBUG:teuthology.orchestra.run.smithi059:osd.5> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.5.service 2024-03-25T09:15:14.328 INFO:tasks.cephadm:Deploying osd.6 on smithi059 with /dev/vg_nvme/lv_3... 2024-03-25T09:15:14.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-25T09:15:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-mon[32732]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-25T09:15:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-mon[32732]: from='osd.5 [v2:172.21.15.59:6800/2143276076,v1:172.21.15.59:6801/2143276076]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-mon[32732]: osdmap e36: 6 total, 5 up, 6 in 2024-03-25T09:15:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-mon[32732]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-mon[32732]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:14.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-mon[32732]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-03-25T09:15:14.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:14 smithi040 ceph-mon[33094]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-25T09:15:14.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:14 smithi040 ceph-mon[33094]: from='osd.5 [v2:172.21.15.59:6800/2143276076,v1:172.21.15.59:6801/2143276076]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:14.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:14 smithi040 ceph-mon[33094]: osdmap e36: 6 total, 5 up, 6 in 2024-03-25T09:15:14.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:14 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:14.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:14 smithi040 ceph-mon[33094]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:14.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:14 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:14.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:14 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:14.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:14 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:14.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:14 smithi040 ceph-mon[33094]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:14.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:14 smithi040 ceph-mon[33094]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-03-25T09:15:14.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:14 smithi019 ceph-mon[29386]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-25T09:15:14.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:14 smithi019 ceph-mon[29386]: from='osd.5 [v2:172.21.15.59:6800/2143276076,v1:172.21.15.59:6801/2143276076]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:14.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:14 smithi019 ceph-mon[29386]: osdmap e36: 6 total, 5 up, 6 in 2024-03-25T09:15:14.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:14 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:14.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:14 smithi019 ceph-mon[29386]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:14.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:14 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:14.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:14 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:14.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:14 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:14.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:14 smithi019 ceph-mon[29386]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-25T09:15:14.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:14 smithi019 ceph-mon[29386]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-03-25T09:15:15.261 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:15:14.832+0000 7f14e033d700 -1 osd.5 0 waiting for initial osdmap 2024-03-25T09:15:15.261 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:15:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:15:14.837+0000 7f14d8128700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T09:15:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.c/config 2024-03-25T09:15:15.684 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:15 smithi059 ceph-mon[32732]: osdmap e37: 6 total, 5 up, 6 in 2024-03-25T09:15:15.684 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:15 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:15.684 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:15 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:15.684 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:15 smithi059 ceph-mon[32732]: from='osd.5 ' entity='osd.5' 2024-03-25T09:15:15.684 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:15 smithi059 ceph-mon[32732]: osd.5 [v2:172.21.15.59:6800/2143276076,v1:172.21.15.59:6801/2143276076] boot 2024-03-25T09:15:15.685 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:15 smithi059 ceph-mon[32732]: osdmap e38: 6 total, 6 up, 6 in 2024-03-25T09:15:15.685 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:15 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:15 smithi040 ceph-mon[33094]: osdmap e37: 6 total, 5 up, 6 in 2024-03-25T09:15:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:15 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:15 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:15 smithi040 ceph-mon[33094]: from='osd.5 ' entity='osd.5' 2024-03-25T09:15:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:15 smithi040 ceph-mon[33094]: osd.5 [v2:172.21.15.59:6800/2143276076,v1:172.21.15.59:6801/2143276076] boot 2024-03-25T09:15:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:15 smithi040 ceph-mon[33094]: osdmap e38: 6 total, 6 up, 6 in 2024-03-25T09:15:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:15 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:15 smithi019 ceph-mon[29386]: osdmap e37: 6 total, 5 up, 6 in 2024-03-25T09:15:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:15 smithi019 ceph-mon[29386]: from='osd.5 ' entity='osd.5' 2024-03-25T09:15:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:15 smithi019 ceph-mon[29386]: osd.5 [v2:172.21.15.59:6800/2143276076,v1:172.21.15.59:6801/2143276076] boot 2024-03-25T09:15:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:15 smithi019 ceph-mon[29386]: osdmap e38: 6 total, 6 up, 6 in 2024-03-25T09:15:15.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:15 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-25T09:15:16.566 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:16 smithi059 ceph-mon[32732]: purged_snaps scrub starts 2024-03-25T09:15:16.566 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:16 smithi059 ceph-mon[32732]: purged_snaps scrub ok 2024-03-25T09:15:16.566 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:16 smithi059 ceph-mon[32732]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:16.567 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:16 smithi059 ceph-mon[32732]: osdmap e39: 6 total, 6 up, 6 in 2024-03-25T09:15:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:16 smithi040 ceph-mon[33094]: purged_snaps scrub starts 2024-03-25T09:15:16.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:16 smithi040 ceph-mon[33094]: purged_snaps scrub ok 2024-03-25T09:15:16.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:16 smithi040 ceph-mon[33094]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:16.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:16 smithi040 ceph-mon[33094]: osdmap e39: 6 total, 6 up, 6 in 2024-03-25T09:15:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:16 smithi019 ceph-mon[29386]: purged_snaps scrub starts 2024-03-25T09:15:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:16 smithi019 ceph-mon[29386]: purged_snaps scrub ok 2024-03-25T09:15:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:16 smithi019 ceph-mon[29386]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:16 smithi019 ceph-mon[29386]: osdmap e39: 6 total, 6 up, 6 in 2024-03-25T09:15:17.199 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-25T09:15:17.199 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-25T09:15:17.199 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2024-03-25T09:15:17.199 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2024-03-25T09:15:17.199 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0133416 s, 786 MB/s 2024-03-25T09:15:17.199 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2024-03-25T09:15:17.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi059:vg_nvme/lv_3 2024-03-25T09:15:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:18 smithi059 ceph-mon[32732]: osdmap e40: 6 total, 6 up, 6 in 2024-03-25T09:15:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:18 smithi059 ceph-mon[32732]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:18 smithi040 ceph-mon[33094]: osdmap e40: 6 total, 6 up, 6 in 2024-03-25T09:15:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:18 smithi040 ceph-mon[33094]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:18.589 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.c/config 2024-03-25T09:15:18.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:18 smithi019 ceph-mon[29386]: osdmap e40: 6 total, 6 up, 6 in 2024-03-25T09:15:18.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:18 smithi019 ceph-mon[29386]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:19.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:19 smithi059 ceph-mon[32732]: osdmap e41: 6 total, 6 up, 6 in 2024-03-25T09:15:19.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:19 smithi059 ceph-mon[32732]: Detected new or changed devices on smithi059 2024-03-25T09:15:19.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:19 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:19 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:19 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:15:19.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:19 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi059 to 21189M 2024-03-25T09:15:19.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:19 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:19 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:19.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:19 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:19.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:19 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:19 smithi040 ceph-mon[33094]: osdmap e41: 6 total, 6 up, 6 in 2024-03-25T09:15:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:19 smithi040 ceph-mon[33094]: Detected new or changed devices on smithi059 2024-03-25T09:15:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:19 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:19 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:19 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:15:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:19 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi059 to 21189M 2024-03-25T09:15:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:19 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:19 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:19 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:19.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:19 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:19 smithi019 ceph-mon[29386]: osdmap e41: 6 total, 6 up, 6 in 2024-03-25T09:15:19.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:19 smithi019 ceph-mon[29386]: Detected new or changed devices on smithi059 2024-03-25T09:15:19.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:19 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:19 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:19 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:15:19.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:19 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi059 to 21189M 2024-03-25T09:15:19.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:19 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:19.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:19 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:19.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:19 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:19.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:19 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:20 smithi059 ceph-mon[32732]: osdmap e42: 6 total, 6 up, 6 in 2024-03-25T09:15:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:20 smithi059 ceph-mon[32732]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:20 smithi040 ceph-mon[33094]: osdmap e42: 6 total, 6 up, 6 in 2024-03-25T09:15:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:20 smithi040 ceph-mon[33094]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:20.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:20 smithi019 ceph-mon[29386]: osdmap e42: 6 total, 6 up, 6 in 2024-03-25T09:15:20.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:20 smithi019 ceph-mon[29386]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:21 smithi059 ceph-mon[32732]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:15:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:21 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:15:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:21 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:15:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:21 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:21 smithi040 ceph-mon[33094]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:15:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:21 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:15:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:21 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:15:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:21 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:21.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:21 smithi019 ceph-mon[29386]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:15:21.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:21 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:15:21.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:21 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:15:21.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:21 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:22 smithi059 ceph-mon[32732]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-25T09:15:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:22 smithi040 ceph-mon[33094]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-25T09:15:22.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:22 smithi019 ceph-mon[29386]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-25T09:15:23.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:23 smithi059 ceph-mon[32732]: from='client.? 172.21.15.59:0/264169509' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5fa6b04c-c171-4566-911c-5dcf193bd24f"} : dispatch 2024-03-25T09:15:23.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:23 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5fa6b04c-c171-4566-911c-5dcf193bd24f"} : dispatch 2024-03-25T09:15:23.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:23 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5fa6b04c-c171-4566-911c-5dcf193bd24f"}]': finished 2024-03-25T09:15:23.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:23 smithi059 ceph-mon[32732]: osdmap e43: 7 total, 6 up, 7 in 2024-03-25T09:15:23.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:23 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:23.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:23 smithi040 ceph-mon[33094]: from='client.? 172.21.15.59:0/264169509' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5fa6b04c-c171-4566-911c-5dcf193bd24f"} : dispatch 2024-03-25T09:15:23.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:23 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5fa6b04c-c171-4566-911c-5dcf193bd24f"} : dispatch 2024-03-25T09:15:23.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:23 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5fa6b04c-c171-4566-911c-5dcf193bd24f"}]': finished 2024-03-25T09:15:23.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:23 smithi040 ceph-mon[33094]: osdmap e43: 7 total, 6 up, 7 in 2024-03-25T09:15:23.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:23 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:23.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:23 smithi019 ceph-mon[29386]: from='client.? 172.21.15.59:0/264169509' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5fa6b04c-c171-4566-911c-5dcf193bd24f"} : dispatch 2024-03-25T09:15:23.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:23 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5fa6b04c-c171-4566-911c-5dcf193bd24f"} : dispatch 2024-03-25T09:15:23.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:23 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5fa6b04c-c171-4566-911c-5dcf193bd24f"}]': finished 2024-03-25T09:15:23.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:23 smithi019 ceph-mon[29386]: osdmap e43: 7 total, 6 up, 7 in 2024-03-25T09:15:23.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:23 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:24.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:24 smithi059 ceph-mon[32732]: from='client.? 172.21.15.59:0/2546858299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:15:24.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:24 smithi059 ceph-mon[32732]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-25T09:15:24.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:24 smithi040 ceph-mon[33094]: from='client.? 172.21.15.59:0/2546858299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:15:24.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:24 smithi040 ceph-mon[33094]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-25T09:15:24.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:24 smithi019 ceph-mon[29386]: from='client.? 172.21.15.59:0/2546858299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:15:24.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:24 smithi019 ceph-mon[29386]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-25T09:15:26.108 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:25 smithi059 ceph-mon[32732]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-25T09:15:26.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:26 smithi040 ceph-mon[33094]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-25T09:15:26.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:25 smithi019 ceph-mon[29386]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-25T09:15:28.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:28 smithi059 ceph-mon[32732]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-03-25T09:15:28.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:28 smithi040 ceph-mon[33094]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-03-25T09:15:28.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:27 smithi019 ceph-mon[29386]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-03-25T09:15:29.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:29 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-03-25T09:15:29.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:29 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:29.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:29 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-03-25T09:15:29.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:29 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:29.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:29 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-03-25T09:15:29.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:29 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:30 smithi059 ceph-mon[32732]: Deploying daemon osd.6 on smithi059 2024-03-25T09:15:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:30 smithi059 ceph-mon[32732]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-25T09:15:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:30 smithi040 ceph-mon[33094]: Deploying daemon osd.6 on smithi059 2024-03-25T09:15:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:30 smithi040 ceph-mon[33094]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-25T09:15:30.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:30 smithi019 ceph-mon[29386]: Deploying daemon osd.6 on smithi059 2024-03-25T09:15:30.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:30 smithi019 ceph-mon[29386]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-25T09:15:32.208 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:32 smithi059 ceph-mon[32732]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:32.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:32 smithi040 ceph-mon[33094]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:32.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:32 smithi019 ceph-mon[29386]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:34.179 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:34 smithi059 ceph-mon[32732]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:34.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:34 smithi040 ceph-mon[33094]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:34.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:34 smithi019 ceph-mon[29386]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:35.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:35.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:35.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:35.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:35.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:35.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:35.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:35.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:35.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:36 smithi059 ceph-mon[32732]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:36.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:36 smithi040 ceph-mon[33094]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:36.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:36 smithi019 ceph-mon[29386]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:38.162 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 6 on host 'smithi059' 2024-03-25T09:15:38.464 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.464 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.464 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: from='osd.6 [v2:172.21.15.59:6808/3024560262,v1:172.21.15.59:6809/3024560262]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-03-25T09:15:38.464 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-03-25T09:15:38.464 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:38.464 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:38.464 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.464 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:38.464 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.464 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.465 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: from='osd.6 [v2:172.21.15.59:6808/3024560262,v1:172.21.15.59:6809/3024560262]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-03-25T09:15:38.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-03-25T09:15:38.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:38.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:38.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:38.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:38.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: from='osd.6 [v2:172.21.15.59:6808/3024560262,v1:172.21.15.59:6809/3024560262]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-03-25T09:15:38.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-03-25T09:15:38.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:38.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:38.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:38.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:38.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:15:38.775 DEBUG:teuthology.orchestra.run.smithi059:osd.6> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.6.service 2024-03-25T09:15:38.777 INFO:tasks.cephadm:Deploying osd.7 on smithi059 with /dev/vg_nvme/lv_2... 2024-03-25T09:15:38.777 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-25T09:15:39.401 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:39 smithi059 ceph-mon[32732]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-25T09:15:39.401 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:39 smithi059 ceph-mon[32732]: osdmap e44: 7 total, 6 up, 7 in 2024-03-25T09:15:39.401 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:39.401 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:39 smithi059 ceph-mon[32732]: from='osd.6 [v2:172.21.15.59:6808/3024560262,v1:172.21.15.59:6809/3024560262]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:39.401 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:39 smithi059 ceph-mon[32732]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:39.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:39 smithi040 ceph-mon[33094]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-25T09:15:39.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:39 smithi040 ceph-mon[33094]: osdmap e44: 7 total, 6 up, 7 in 2024-03-25T09:15:39.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:39.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:39 smithi040 ceph-mon[33094]: from='osd.6 [v2:172.21.15.59:6808/3024560262,v1:172.21.15.59:6809/3024560262]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:39.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:39 smithi040 ceph-mon[33094]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:39.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:39 smithi019 ceph-mon[29386]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-25T09:15:39.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:39 smithi019 ceph-mon[29386]: osdmap e44: 7 total, 6 up, 7 in 2024-03-25T09:15:39.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:39.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:39 smithi019 ceph-mon[29386]: from='osd.6 [v2:172.21.15.59:6808/3024560262,v1:172.21.15.59:6809/3024560262]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:39.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:39 smithi019 ceph-mon[29386]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:15:39.761 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:15:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:15:39.644+0000 7fcc5dd1a700 -1 osd.6 0 waiting for initial osdmap 2024-03-25T09:15:39.761 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:15:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:15:39.650+0000 7fcc55304700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T09:15:40.019 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.c/config 2024-03-25T09:15:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:40 smithi059 ceph-mon[32732]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-03-25T09:15:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:40 smithi059 ceph-mon[32732]: osdmap e45: 7 total, 6 up, 7 in 2024-03-25T09:15:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:40 smithi059 ceph-mon[32732]: from='osd.6 ' entity='osd.6' 2024-03-25T09:15:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:40 smithi059 ceph-mon[32732]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:40 smithi040 ceph-mon[33094]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-03-25T09:15:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:40 smithi040 ceph-mon[33094]: osdmap e45: 7 total, 6 up, 7 in 2024-03-25T09:15:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:40 smithi040 ceph-mon[33094]: from='osd.6 ' entity='osd.6' 2024-03-25T09:15:40.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:40 smithi040 ceph-mon[33094]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:40.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:40 smithi019 ceph-mon[29386]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-03-25T09:15:40.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:40 smithi019 ceph-mon[29386]: osdmap e45: 7 total, 6 up, 7 in 2024-03-25T09:15:40.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:40.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:40.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:40 smithi019 ceph-mon[29386]: from='osd.6 ' entity='osd.6' 2024-03-25T09:15:40.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:40 smithi019 ceph-mon[29386]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-03-25T09:15:41.388 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:41 smithi059 ceph-mon[32732]: purged_snaps scrub starts 2024-03-25T09:15:41.389 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:41 smithi059 ceph-mon[32732]: purged_snaps scrub ok 2024-03-25T09:15:41.389 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:41.389 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:41 smithi059 ceph-mon[32732]: osd.6 [v2:172.21.15.59:6808/3024560262,v1:172.21.15.59:6809/3024560262] boot 2024-03-25T09:15:41.389 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:41 smithi059 ceph-mon[32732]: osdmap e46: 7 total, 7 up, 7 in 2024-03-25T09:15:41.389 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:41.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:41 smithi040 ceph-mon[33094]: purged_snaps scrub starts 2024-03-25T09:15:41.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:41 smithi040 ceph-mon[33094]: purged_snaps scrub ok 2024-03-25T09:15:41.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:41.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:41 smithi040 ceph-mon[33094]: osd.6 [v2:172.21.15.59:6808/3024560262,v1:172.21.15.59:6809/3024560262] boot 2024-03-25T09:15:41.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:41 smithi040 ceph-mon[33094]: osdmap e46: 7 total, 7 up, 7 in 2024-03-25T09:15:41.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:41.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:41 smithi019 ceph-mon[29386]: purged_snaps scrub starts 2024-03-25T09:15:41.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:41 smithi019 ceph-mon[29386]: purged_snaps scrub ok 2024-03-25T09:15:41.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:41.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:41 smithi019 ceph-mon[29386]: osd.6 [v2:172.21.15.59:6808/3024560262,v1:172.21.15.59:6809/3024560262] boot 2024-03-25T09:15:41.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:41 smithi019 ceph-mon[29386]: osdmap e46: 7 total, 7 up, 7 in 2024-03-25T09:15:41.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-25T09:15:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-25T09:15:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-25T09:15:42.309 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2024-03-25T09:15:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2024-03-25T09:15:42.309 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0142501 s, 736 MB/s 2024-03-25T09:15:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2024-03-25T09:15:42.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:42 smithi059 ceph-mon[32732]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:42.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:42 smithi040 ceph-mon[33094]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:42.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:42 smithi019 ceph-mon[29386]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:42.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi059:vg_nvme/lv_2 2024-03-25T09:15:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.c/config 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: osdmap e47: 7 total, 7 up, 7 in 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: Detected new or changed devices on smithi059 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi059 to 10594M 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:43.502 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: osdmap e47: 7 total, 7 up, 7 in 2024-03-25T09:15:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: Detected new or changed devices on smithi059 2024-03-25T09:15:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:15:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-25T09:15:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi059 to 10594M 2024-03-25T09:15:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:43.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: osdmap e47: 7 total, 7 up, 7 in 2024-03-25T09:15:43.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: Detected new or changed devices on smithi059 2024-03-25T09:15:43.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:15:43.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-25T09:15:43.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi059 to 10594M 2024-03-25T09:15:43.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:43.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:43.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:15:43.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:15:44.332 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:44 smithi059 ceph-mon[32732]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:44.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:44 smithi040 ceph-mon[33094]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:44.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:44 smithi019 ceph-mon[29386]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:45.476 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:45 smithi059 ceph-mon[32732]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:15:45.476 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:15:45.476 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:15:45.476 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:45 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:45 smithi040 ceph-mon[33094]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:15:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:15:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:15:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:45 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:45.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:45 smithi019 ceph-mon[29386]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:15:45.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-25T09:15:45.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-25T09:15:45.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:45 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:46 smithi059 ceph-mon[32732]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:46 smithi040 ceph-mon[33094]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:46.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:46 smithi019 ceph-mon[29386]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:47.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:47 smithi019 ceph-mon[29386]: from='client.? 172.21.15.59:0/2854776373' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf"} : dispatch 2024-03-25T09:15:47.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:47 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf"} : dispatch 2024-03-25T09:15:47.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:47 smithi019 ceph-mon[29386]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf"}]': finished 2024-03-25T09:15:47.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:47 smithi019 ceph-mon[29386]: osdmap e48: 8 total, 7 up, 8 in 2024-03-25T09:15:47.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:47 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:15:47.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:47 smithi059 ceph-mon[32732]: from='client.? 172.21.15.59:0/2854776373' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf"} : dispatch 2024-03-25T09:15:47.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:47 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf"} : dispatch 2024-03-25T09:15:47.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:47 smithi059 ceph-mon[32732]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf"}]': finished 2024-03-25T09:15:47.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:47 smithi059 ceph-mon[32732]: osdmap e48: 8 total, 7 up, 8 in 2024-03-25T09:15:47.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:47 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:15:47.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:47 smithi040 ceph-mon[33094]: from='client.? 172.21.15.59:0/2854776373' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf"} : dispatch 2024-03-25T09:15:47.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:47 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf"} : dispatch 2024-03-25T09:15:47.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:47 smithi040 ceph-mon[33094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf"}]': finished 2024-03-25T09:15:47.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:47 smithi040 ceph-mon[33094]: osdmap e48: 8 total, 7 up, 8 in 2024-03-25T09:15:47.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:47 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:15:48.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:48 smithi019 ceph-mon[29386]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:48.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:48 smithi019 ceph-mon[29386]: from='client.? 172.21.15.59:0/1833630754' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:15:48.662 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:48 smithi059 ceph-mon[32732]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:48.663 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:48 smithi059 ceph-mon[32732]: from='client.? 172.21.15.59:0/1833630754' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:15:48.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:48 smithi040 ceph-mon[33094]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:48.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:48 smithi040 ceph-mon[33094]: from='client.? 172.21.15.59:0/1833630754' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-25T09:15:50.210 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:50 smithi059 ceph-mon[32732]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:50.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:50 smithi040 ceph-mon[33094]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:50.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:50 smithi019 ceph-mon[29386]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:52.094 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:52 smithi059 ceph-mon[32732]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:52 smithi040 ceph-mon[33094]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:52 smithi019 ceph-mon[29386]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:54.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:53 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-03-25T09:15:54.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:53 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:54.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:53 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-03-25T09:15:54.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:53 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:54.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:53 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-03-25T09:15:54.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:53 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:15:54.915 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:54 smithi059 ceph-mon[32732]: Deploying daemon osd.7 on smithi059 2024-03-25T09:15:54.915 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:54 smithi059 ceph-mon[32732]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:55.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:54 smithi040 ceph-mon[33094]: Deploying daemon osd.7 on smithi059 2024-03-25T09:15:55.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:54 smithi040 ceph-mon[33094]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:55.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:54 smithi019 ceph-mon[29386]: Deploying daemon osd.7 on smithi059 2024-03-25T09:15:55.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:54 smithi019 ceph-mon[29386]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:56 smithi059 ceph-mon[32732]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:56 smithi040 ceph-mon[33094]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:56.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:56 smithi019 ceph-mon[29386]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:58.172 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:15:58 smithi059 ceph-mon[32732]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:58.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:15:58 smithi040 ceph-mon[33094]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:15:58.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:15:58 smithi019 ceph-mon[29386]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:16:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:00 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:00 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:00 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:16:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:00 smithi019 ceph-mon[29386]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:16:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:00 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:00 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:00 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:16:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:00 smithi059 ceph-mon[32732]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:16:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:00 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:00 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:00.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:00 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:16:00.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:00 smithi040 ceph-mon[33094]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:16:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:02 smithi059 ceph-mon[32732]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:16:02.266 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:02 smithi040 ceph-mon[33094]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:16:02.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:02 smithi019 ceph-mon[29386]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:16:02.424 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 7 on host 'smithi059' 2024-03-25T09:16:03.037 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:03 smithi059 ceph-mon[32732]: from='osd.7 [v2:172.21.15.59:6816/1326183814,v1:172.21.15.59:6817/1326183814]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-25T09:16:03.037 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:03 smithi059 ceph-mon[32732]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-25T09:16:03.037 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:03 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.037 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:03 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.037 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:03 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.037 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:03 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.064 DEBUG:teuthology.orchestra.run.smithi059:osd.7> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.7.service 2024-03-25T09:16:03.067 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-03-25T09:16:03.068 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-25T09:16:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:03 smithi040 ceph-mon[33094]: from='osd.7 [v2:172.21.15.59:6816/1326183814,v1:172.21.15.59:6817/1326183814]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-25T09:16:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:03 smithi040 ceph-mon[33094]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-25T09:16:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:03 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:03 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:03 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:03 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.322 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:03.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:03 smithi019 ceph-mon[29386]: from='osd.7 [v2:172.21.15.59:6816/1326183814,v1:172.21.15.59:6817/1326183814]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-25T09:16:03.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:03 smithi019 ceph-mon[29386]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-25T09:16:03.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:03 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:03 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:03 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:03.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:03 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:04.320 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:04 smithi059 ceph-mon[32732]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-25T09:16:04.320 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:04 smithi059 ceph-mon[32732]: osdmap e49: 8 total, 7 up, 8 in 2024-03-25T09:16:04.320 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:04 smithi059 ceph-mon[32732]: from='osd.7 [v2:172.21.15.59:6816/1326183814,v1:172.21.15.59:6817/1326183814]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:16:04.320 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:04 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:04.320 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:04 smithi059 ceph-mon[32732]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:16:04.320 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:04 smithi059 ceph-mon[32732]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:16:04.320 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:16:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:16:04.018+0000 7fa0aa470700 -1 osd.7 0 waiting for initial osdmap 2024-03-25T09:16:04.320 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:16:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:16:04.024+0000 7fa0a6263700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T09:16:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:04 smithi019 ceph-mon[29386]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-25T09:16:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:04 smithi019 ceph-mon[29386]: osdmap e49: 8 total, 7 up, 8 in 2024-03-25T09:16:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:04 smithi019 ceph-mon[29386]: from='osd.7 [v2:172.21.15.59:6816/1326183814,v1:172.21.15.59:6817/1326183814]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:16:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:04 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:04.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:04 smithi019 ceph-mon[29386]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:16:04.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:04 smithi019 ceph-mon[29386]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:16:04.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:04 smithi040 ceph-mon[33094]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-25T09:16:04.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:04 smithi040 ceph-mon[33094]: osdmap e49: 8 total, 7 up, 8 in 2024-03-25T09:16:04.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:04 smithi040 ceph-mon[33094]: from='osd.7 [v2:172.21.15.59:6816/1326183814,v1:172.21.15.59:6817/1326183814]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:16:04.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:04 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:04.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:04 smithi040 ceph-mon[33094]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-03-25T09:16:04.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:04 smithi040 ceph-mon[33094]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-03-25T09:16:05.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:05 smithi019 ceph-mon[29386]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-03-25T09:16:05.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:05 smithi019 ceph-mon[29386]: osdmap e50: 8 total, 7 up, 8 in 2024-03-25T09:16:05.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:05 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:05.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:05 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:05.246 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:16:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:05 smithi059 ceph-mon[32732]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-03-25T09:16:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:05 smithi059 ceph-mon[32732]: osdmap e50: 8 total, 7 up, 8 in 2024-03-25T09:16:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:05 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:05 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:05 smithi040 ceph-mon[33094]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-03-25T09:16:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:05 smithi040 ceph-mon[33094]: osdmap e50: 8 total, 7 up, 8 in 2024-03-25T09:16:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:05 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:05 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1711358165,"num_in_osds":8,"osd_in_since":1711358147,"num_remapped_pgs":0} 2024-03-25T09:16:05.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd dump --format=json 2024-03-25T09:16:06.193 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: purged_snaps scrub starts 2024-03-25T09:16:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: purged_snaps scrub ok 2024-03-25T09:16:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: osd.7 [v2:172.21.15.59:6816/1326183814,v1:172.21.15.59:6817/1326183814] boot 2024-03-25T09:16:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: osdmap e51: 8 total, 8 up, 8 in 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/92807927' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: Detected new or changed devices on smithi059 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi059 to 7063M 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:16:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:06 smithi059 ceph-mon[32732]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:06.299 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: purged_snaps scrub starts 2024-03-25T09:16:06.299 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: purged_snaps scrub ok 2024-03-25T09:16:06.299 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: osd.7 [v2:172.21.15.59:6816/1326183814,v1:172.21.15.59:6817/1326183814] boot 2024-03-25T09:16:06.299 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: osdmap e51: 8 total, 8 up, 8 in 2024-03-25T09:16:06.299 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:06.299 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/92807927' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-03-25T09:16:06.299 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: Detected new or changed devices on smithi059 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi059 to 7063M 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:06 smithi019 ceph-mon[29386]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: purged_snaps scrub starts 2024-03-25T09:16:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: purged_snaps scrub ok 2024-03-25T09:16:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: osd.7 [v2:172.21.15.59:6816/1326183814,v1:172.21.15.59:6817/1326183814] boot 2024-03-25T09:16:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: osdmap e51: 8 total, 8 up, 8 in 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/92807927' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: Detected new or changed devices on smithi059 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi059 to 7063M 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:06.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:06 smithi040 ceph-mon[33094]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:07.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:07 smithi019 ceph-mon[29386]: osdmap e52: 8 total, 8 up, 8 in 2024-03-25T09:16:07.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:07 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:16:07.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:07 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:16:07.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:07 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:16:07.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:07 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:07 smithi059 ceph-mon[32732]: osdmap e52: 8 total, 8 up, 8 in 2024-03-25T09:16:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:07 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:16:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:07 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:16:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:07 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:16:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:07 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:07.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:07 smithi040 ceph-mon[33094]: osdmap e52: 8 total, 8 up, 8 in 2024-03-25T09:16:07.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:07 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:16:07.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:07 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:16:07.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:07 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:16:07.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:07 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:16:07.860 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:16:07.860 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":52,"fsid":"61da756e-ea87-11ee-95cd-87774f69a715","created":"2024-03-25T09:10:27.343036+0000","modified":"2024-03-25T09:16:06.019974+0000","last_up_change":"2024-03-25T09:16:05.014264+0000","last_in_change":"2024-03-25T09:15:47.305254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T09:14:02.212458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5abf7a61-63e0-4a7a-b7d9-fcb15988556f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6803","nonce":3324613073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6805","nonce":3324613073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6809","nonce":3324613073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6807","nonce":3324613073}]},"public_addr":"172.21.15.19:6803/3324613073","cluster_addr":"172.21.15.19:6805/3324613073","heartbeat_back_addr":"172.21.15.19:6809/3324613073","heartbeat_front_addr":"172.21.15.19:6807/3324613073","state":["exists","up"]},{"osd":1,"uuid":"169b654e-44fc-46af-ab9c-62e09de1b803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6811","nonce":266458651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6813","nonce":266458651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6817","nonce":266458651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6815","nonce":266458651}]},"public_addr":"172.21.15.19:6811/266458651","cluster_addr":"172.21.15.19:6813/266458651","heartbeat_back_addr":"172.21.15.19:6817/266458651","heartbeat_front_addr":"172.21.15.19:6815/266458651","state":["exists","up"]},{"osd":2,"uuid":"b55fe141-e42a-4d64-90c9-b91e13632a76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6801","nonce":1433104527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6803","nonce":1433104527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6807","nonce":1433104527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6805","nonce":1433104527}]},"public_addr":"172.21.15.40:6801/1433104527","cluster_addr":"172.21.15.40:6803/1433104527","heartbeat_back_addr":"172.21.15.40:6807/1433104527","heartbeat_front_addr":"172.21.15.40:6805/1433104527","state":["exists","up"]},{"osd":3,"uuid":"22630c5e-7f72-4e80-ae1d-518e90aaad9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6809","nonce":736915151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6811","nonce":736915151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6815","nonce":736915151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6813","nonce":736915151}]},"public_addr":"172.21.15.40:6809/736915151","cluster_addr":"172.21.15.40:6811/736915151","heartbeat_back_addr":"172.21.15.40:6815/736915151","heartbeat_front_addr":"172.21.15.40:6813/736915151","state":["exists","up"]},{"osd":4,"uuid":"1cd59332-94eb-4561-8087-35997ce9d39d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6817","nonce":3881244643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6819","nonce":3881244643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6823","nonce":3881244643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6821","nonce":3881244643}]},"public_addr":"172.21.15.40:6817/3881244643","cluster_addr":"172.21.15.40:6819/3881244643","heartbeat_back_addr":"172.21.15.40:6823/3881244643","heartbeat_front_addr":"172.21.15.40:6821/3881244643","state":["exists","up"]},{"osd":5,"uuid":"a763a57a-067a-440c-afc8-dc4966bc4a34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6801","nonce":2143276076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6803","nonce":2143276076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6807","nonce":2143276076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6805","nonce":2143276076}]},"public_addr":"172.21.15.59:6801/2143276076","cluster_addr":"172.21.15.59:6803/2143276076","heartbeat_back_addr":"172.21.15.59:6807/2143276076","heartbeat_front_addr":"172.21.15.59:6805/2143276076","state":["exists","up"]},{"osd":6,"uuid":"5fa6b04c-c171-4566-911c-5dcf193bd24f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6809","nonce":3024560262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6811","nonce":3024560262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6815","nonce":3024560262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6813","nonce":3024560262}]},"public_addr":"172.21.15.59:6809/3024560262","cluster_addr":"172.21.15.59:6811/3024560262","heartbeat_back_addr":"172.21.15.59:6815/3024560262","heartbeat_front_addr":"172.21.15.59:6813/3024560262","state":["exists","up"]},{"osd":7,"uuid":"ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6817","nonce":1326183814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6819","nonce":1326183814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6823","nonce":1326183814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6821","nonce":1326183814}]},"public_addr":"172.21.15.59:6817/1326183814","cluster_addr":"172.21.15.59:6819/1326183814","heartbeat_back_addr":"172.21.15.59:6823/1326183814","heartbeat_front_addr":"172.21.15.59:6821/1326183814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:13:11.355312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:13:36.680506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:13:59.790121+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:14:25.035588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:14:51.115152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:15:14.387983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:15:38.560901+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:16:03.117365+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/3828199631":"2024-03-26T09:11:27.874450+0000","172.21.15.19:0/1007239373":"2024-03-26T09:11:27.874450+0000","172.21.15.19:0/1046989000":"2024-03-26T09:11:27.874450+0000","172.21.15.19:6801/758887937":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/1188808785":"2024-03-26T09:11:27.874450+0000","172.21.15.19:6800/3828199631":"2024-03-26T09:11:27.874450+0000","172.21.15.19:6800/758887937":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/3783446823":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/1217144301":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/1291153985":"2024-03-26T09:11:00.797567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T09:16:08.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:08 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/3994138323' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-25T09:16:08.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:08 smithi019 ceph-mon[29386]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:08.436 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-25T09:14:02.212458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-25T09:16:08.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-25T09:16:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:08 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/3994138323' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-25T09:16:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:08 smithi059 ceph-mon[32732]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:08 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/3994138323' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-25T09:16:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:08 smithi040 ceph-mon[33094]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:10.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:10 smithi059 ceph-mon[32732]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:10.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:10 smithi040 ceph-mon[33094]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:10.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:10 smithi019 ceph-mon[29386]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:10.468 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-25T09:16:11.032 INFO:tasks.cephadm:Setting up client nodes... 2024-03-25T09:16:11.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-25T09:16:11.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:11 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/1225036496' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-03-25T09:16:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:11 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/1225036496' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-03-25T09:16:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:11 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/1225036496' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-03-25T09:16:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:12 smithi040 ceph-mon[33094]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:12.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:12 smithi019 ceph-mon[29386]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:12 smithi059 ceph-mon[32732]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:13.214 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-25T09:16:13.214 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDdQAFmFX2lDBAAVPfTWj+pwFqiZsVU+3QV2Q== 2024-03-25T09:16:13.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:13 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/758983' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:13.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:13 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/758983' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:13.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:13 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/758983' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:13.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:13 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/758983' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:13.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:13 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/758983' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:13.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:13 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/758983' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:13.906 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:16:13.906 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-25T09:16:13.906 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-25T09:16:13.950 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-25T09:16:14.200 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.b/config 2024-03-25T09:16:14.528 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:14 smithi040 ceph-mon[33094]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:14.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:14 smithi019 ceph-mon[29386]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:14.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:14 smithi059 ceph-mon[32732]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:16.139 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2024-03-25T09:16:16.139 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDgQAFmmLgdCBAArN7o3v9IYihprE1bPeuehQ== 2024-03-25T09:16:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:16 smithi059 ceph-mon[32732]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:16.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:16 smithi040 ceph-mon[33094]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:16.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:16 smithi019 ceph-mon[29386]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:16.838 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:16:16.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-25T09:16:16.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-25T09:16:16.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph auth get-or-create client.2 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-25T09:16:17.133 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.c/config 2024-03-25T09:16:17.254 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:17 smithi059 ceph-mon[32732]: from='client.? 172.21.15.40:0/3508207513' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:17.254 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:17 smithi059 ceph-mon[32732]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:17.254 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:17 smithi059 ceph-mon[32732]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:17 smithi040 ceph-mon[33094]: from='client.? 172.21.15.40:0/3508207513' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:17 smithi040 ceph-mon[33094]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:17 smithi040 ceph-mon[33094]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:17.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:17 smithi019 ceph-mon[29386]: from='client.? 172.21.15.40:0/3508207513' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:17.513 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:17 smithi019 ceph-mon[29386]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:17.513 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:17 smithi019 ceph-mon[29386]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:18.270 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:18 smithi059 ceph-mon[32732]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:18.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:18 smithi019 ceph-mon[29386]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:18 smithi040 ceph-mon[33094]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:18.925 INFO:teuthology.orchestra.run.smithi059.stdout:[client.2] 2024-03-25T09:16:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDiQAFmNFzkNhAAYCk8QfcVCJiPLvBMa6nIiw== 2024-03-25T09:16:19.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:19 smithi059 ceph-mon[32732]: from='client.? 172.21.15.59:0/487658729' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:19.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:19 smithi059 ceph-mon[32732]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:19.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:19 smithi059 ceph-mon[32732]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:19.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:19 smithi019 ceph-mon[29386]: from='client.? 172.21.15.59:0/487658729' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:19.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:19 smithi019 ceph-mon[29386]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:19.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:19 smithi019 ceph-mon[29386]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:19 smithi040 ceph-mon[33094]: from='client.? 172.21.15.59:0/487658729' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:19 smithi040 ceph-mon[33094]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:19 smithi040 ceph-mon[33094]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:19.523 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:16:19.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.2.keyring 2024-03-25T09:16:19.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-25T09:16:19.568 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph auth get-or-create client.3 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-25T09:16:19.810 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-25T09:16:20.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:20 smithi059 ceph-mon[32732]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:20.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:20 smithi019 ceph-mon[29386]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:20.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:20 smithi040 ceph-mon[33094]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:21.718 INFO:teuthology.orchestra.run.smithi129.stdout:[client.3] 2024-03-25T09:16:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQDlQAFmNpmzKhAAcyQLFvmgoMn6/MNiZS826w== 2024-03-25T09:16:22.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:21 smithi019 ceph-mon[29386]: from='client.? 172.21.15.129:0/713542237' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:22.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:21 smithi019 ceph-mon[29386]: from='client.? 172.21.15.129:0/713542237' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:22.261 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:16:22.261 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.client.3.keyring 2024-03-25T09:16:22.261 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-25T09:16:22.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:21 smithi059 ceph-mon[32732]: from='client.? 172.21.15.129:0/713542237' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:22.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:21 smithi059 ceph-mon[32732]: from='client.? 172.21.15.129:0/713542237' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:21 smithi040 ceph-mon[33094]: from='client.? 172.21.15.129:0/713542237' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-25T09:16:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:21 smithi040 ceph-mon[33094]: from='client.? 172.21.15.129:0/713542237' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-25T09:16:22.338 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-25T09:16:22.339 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-25T09:16:22.339 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph mgr dump --format=json 2024-03-25T09:16:22.590 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:22.986 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:22 smithi019 ceph-mon[29386]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:22 smithi059 ceph-mon[32732]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:23.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:22 smithi040 ceph-mon[33094]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:24.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:24 smithi059 ceph-mon[32732]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:24 smithi040 ceph-mon[33094]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:24.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:24 smithi019 ceph-mon[29386]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:24.516 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:16:25.122 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:25 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2224191814' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-03-25T09:16:25.149 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":1207737961},{"type":"v1","addr":"172.21.15.19:6801","nonce":1207737961}]},"active_addr":"172.21.15.19:6801/1207737961","active_change":"2024-03-25T09:11:27.874566+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.19:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2843406060}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":3941928260}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":3591909683}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":248572455}]}]} 2024-03-25T09:16:25.151 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-25T09:16:25.152 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-25T09:16:25.152 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd dump --format=json 2024-03-25T09:16:25.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:25 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2224191814' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-03-25T09:16:25.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:25 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2224191814' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-03-25T09:16:25.392 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:26.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:26 smithi019 ceph-mon[29386]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:26 smithi059 ceph-mon[32732]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:26 smithi040 ceph-mon[33094]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:27.230 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:16:27.230 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":52,"fsid":"61da756e-ea87-11ee-95cd-87774f69a715","created":"2024-03-25T09:10:27.343036+0000","modified":"2024-03-25T09:16:06.019974+0000","last_up_change":"2024-03-25T09:16:05.014264+0000","last_in_change":"2024-03-25T09:15:47.305254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T09:14:02.212458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5abf7a61-63e0-4a7a-b7d9-fcb15988556f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6803","nonce":3324613073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6805","nonce":3324613073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6809","nonce":3324613073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6807","nonce":3324613073}]},"public_addr":"172.21.15.19:6803/3324613073","cluster_addr":"172.21.15.19:6805/3324613073","heartbeat_back_addr":"172.21.15.19:6809/3324613073","heartbeat_front_addr":"172.21.15.19:6807/3324613073","state":["exists","up"]},{"osd":1,"uuid":"169b654e-44fc-46af-ab9c-62e09de1b803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6811","nonce":266458651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6813","nonce":266458651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6817","nonce":266458651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6815","nonce":266458651}]},"public_addr":"172.21.15.19:6811/266458651","cluster_addr":"172.21.15.19:6813/266458651","heartbeat_back_addr":"172.21.15.19:6817/266458651","heartbeat_front_addr":"172.21.15.19:6815/266458651","state":["exists","up"]},{"osd":2,"uuid":"b55fe141-e42a-4d64-90c9-b91e13632a76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6801","nonce":1433104527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6803","nonce":1433104527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6807","nonce":1433104527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6805","nonce":1433104527}]},"public_addr":"172.21.15.40:6801/1433104527","cluster_addr":"172.21.15.40:6803/1433104527","heartbeat_back_addr":"172.21.15.40:6807/1433104527","heartbeat_front_addr":"172.21.15.40:6805/1433104527","state":["exists","up"]},{"osd":3,"uuid":"22630c5e-7f72-4e80-ae1d-518e90aaad9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6809","nonce":736915151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6811","nonce":736915151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6815","nonce":736915151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6813","nonce":736915151}]},"public_addr":"172.21.15.40:6809/736915151","cluster_addr":"172.21.15.40:6811/736915151","heartbeat_back_addr":"172.21.15.40:6815/736915151","heartbeat_front_addr":"172.21.15.40:6813/736915151","state":["exists","up"]},{"osd":4,"uuid":"1cd59332-94eb-4561-8087-35997ce9d39d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6817","nonce":3881244643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6819","nonce":3881244643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6823","nonce":3881244643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6821","nonce":3881244643}]},"public_addr":"172.21.15.40:6817/3881244643","cluster_addr":"172.21.15.40:6819/3881244643","heartbeat_back_addr":"172.21.15.40:6823/3881244643","heartbeat_front_addr":"172.21.15.40:6821/3881244643","state":["exists","up"]},{"osd":5,"uuid":"a763a57a-067a-440c-afc8-dc4966bc4a34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6801","nonce":2143276076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6803","nonce":2143276076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6807","nonce":2143276076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6805","nonce":2143276076}]},"public_addr":"172.21.15.59:6801/2143276076","cluster_addr":"172.21.15.59:6803/2143276076","heartbeat_back_addr":"172.21.15.59:6807/2143276076","heartbeat_front_addr":"172.21.15.59:6805/2143276076","state":["exists","up"]},{"osd":6,"uuid":"5fa6b04c-c171-4566-911c-5dcf193bd24f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6809","nonce":3024560262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6811","nonce":3024560262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6815","nonce":3024560262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6813","nonce":3024560262}]},"public_addr":"172.21.15.59:6809/3024560262","cluster_addr":"172.21.15.59:6811/3024560262","heartbeat_back_addr":"172.21.15.59:6815/3024560262","heartbeat_front_addr":"172.21.15.59:6813/3024560262","state":["exists","up"]},{"osd":7,"uuid":"ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6817","nonce":1326183814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6819","nonce":1326183814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6823","nonce":1326183814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6821","nonce":1326183814}]},"public_addr":"172.21.15.59:6817/1326183814","cluster_addr":"172.21.15.59:6819/1326183814","heartbeat_back_addr":"172.21.15.59:6823/1326183814","heartbeat_front_addr":"172.21.15.59:6821/1326183814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:13:11.355312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:13:36.680506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:13:59.790121+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:14:25.035588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:14:51.115152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:15:14.387983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:15:38.560901+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:16:03.117365+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/3828199631":"2024-03-26T09:11:27.874450+0000","172.21.15.19:0/1007239373":"2024-03-26T09:11:27.874450+0000","172.21.15.19:0/1046989000":"2024-03-26T09:11:27.874450+0000","172.21.15.19:6801/758887937":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/1188808785":"2024-03-26T09:11:27.874450+0000","172.21.15.19:6800/3828199631":"2024-03-26T09:11:27.874450+0000","172.21.15.19:6800/758887937":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/3783446823":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/1217144301":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/1291153985":"2024-03-26T09:11:00.797567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T09:16:27.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:27 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/1438628942' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-25T09:16:27.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:27 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/1438628942' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-25T09:16:27.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:27 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/1438628942' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-25T09:16:27.833 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-25T09:16:27.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd dump --format=json 2024-03-25T09:16:28.075 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:28.482 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:28 smithi019 ceph-mon[29386]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:28.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:28 smithi059 ceph-mon[32732]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:28.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:28 smithi040 ceph-mon[33094]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:16:29.935 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":52,"fsid":"61da756e-ea87-11ee-95cd-87774f69a715","created":"2024-03-25T09:10:27.343036+0000","modified":"2024-03-25T09:16:06.019974+0000","last_up_change":"2024-03-25T09:16:05.014264+0000","last_in_change":"2024-03-25T09:15:47.305254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T09:14:02.212458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5abf7a61-63e0-4a7a-b7d9-fcb15988556f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6803","nonce":3324613073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6805","nonce":3324613073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6809","nonce":3324613073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3324613073},{"type":"v1","addr":"172.21.15.19:6807","nonce":3324613073}]},"public_addr":"172.21.15.19:6803/3324613073","cluster_addr":"172.21.15.19:6805/3324613073","heartbeat_back_addr":"172.21.15.19:6809/3324613073","heartbeat_front_addr":"172.21.15.19:6807/3324613073","state":["exists","up"]},{"osd":1,"uuid":"169b654e-44fc-46af-ab9c-62e09de1b803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6811","nonce":266458651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6813","nonce":266458651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6817","nonce":266458651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":266458651},{"type":"v1","addr":"172.21.15.19:6815","nonce":266458651}]},"public_addr":"172.21.15.19:6811/266458651","cluster_addr":"172.21.15.19:6813/266458651","heartbeat_back_addr":"172.21.15.19:6817/266458651","heartbeat_front_addr":"172.21.15.19:6815/266458651","state":["exists","up"]},{"osd":2,"uuid":"b55fe141-e42a-4d64-90c9-b91e13632a76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6801","nonce":1433104527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6803","nonce":1433104527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6807","nonce":1433104527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1433104527},{"type":"v1","addr":"172.21.15.40:6805","nonce":1433104527}]},"public_addr":"172.21.15.40:6801/1433104527","cluster_addr":"172.21.15.40:6803/1433104527","heartbeat_back_addr":"172.21.15.40:6807/1433104527","heartbeat_front_addr":"172.21.15.40:6805/1433104527","state":["exists","up"]},{"osd":3,"uuid":"22630c5e-7f72-4e80-ae1d-518e90aaad9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6809","nonce":736915151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6811","nonce":736915151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6815","nonce":736915151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":736915151},{"type":"v1","addr":"172.21.15.40:6813","nonce":736915151}]},"public_addr":"172.21.15.40:6809/736915151","cluster_addr":"172.21.15.40:6811/736915151","heartbeat_back_addr":"172.21.15.40:6815/736915151","heartbeat_front_addr":"172.21.15.40:6813/736915151","state":["exists","up"]},{"osd":4,"uuid":"1cd59332-94eb-4561-8087-35997ce9d39d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6817","nonce":3881244643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6819","nonce":3881244643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6823","nonce":3881244643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3881244643},{"type":"v1","addr":"172.21.15.40:6821","nonce":3881244643}]},"public_addr":"172.21.15.40:6817/3881244643","cluster_addr":"172.21.15.40:6819/3881244643","heartbeat_back_addr":"172.21.15.40:6823/3881244643","heartbeat_front_addr":"172.21.15.40:6821/3881244643","state":["exists","up"]},{"osd":5,"uuid":"a763a57a-067a-440c-afc8-dc4966bc4a34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6801","nonce":2143276076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6803","nonce":2143276076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6807","nonce":2143276076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2143276076},{"type":"v1","addr":"172.21.15.59:6805","nonce":2143276076}]},"public_addr":"172.21.15.59:6801/2143276076","cluster_addr":"172.21.15.59:6803/2143276076","heartbeat_back_addr":"172.21.15.59:6807/2143276076","heartbeat_front_addr":"172.21.15.59:6805/2143276076","state":["exists","up"]},{"osd":6,"uuid":"5fa6b04c-c171-4566-911c-5dcf193bd24f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6809","nonce":3024560262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6811","nonce":3024560262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6815","nonce":3024560262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3024560262},{"type":"v1","addr":"172.21.15.59:6813","nonce":3024560262}]},"public_addr":"172.21.15.59:6809/3024560262","cluster_addr":"172.21.15.59:6811/3024560262","heartbeat_back_addr":"172.21.15.59:6815/3024560262","heartbeat_front_addr":"172.21.15.59:6813/3024560262","state":["exists","up"]},{"osd":7,"uuid":"ce2fdc79-d4b8-42b7-b7f1-74cbe54852cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6817","nonce":1326183814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6819","nonce":1326183814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6823","nonce":1326183814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1326183814},{"type":"v1","addr":"172.21.15.59:6821","nonce":1326183814}]},"public_addr":"172.21.15.59:6817/1326183814","cluster_addr":"172.21.15.59:6819/1326183814","heartbeat_back_addr":"172.21.15.59:6823/1326183814","heartbeat_front_addr":"172.21.15.59:6821/1326183814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:13:11.355312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:13:36.680506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:13:59.790121+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:14:25.035588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:14:51.115152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:15:14.387983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:15:38.560901+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T09:16:03.117365+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/3828199631":"2024-03-26T09:11:27.874450+0000","172.21.15.19:0/1007239373":"2024-03-26T09:11:27.874450+0000","172.21.15.19:0/1046989000":"2024-03-26T09:11:27.874450+0000","172.21.15.19:6801/758887937":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/1188808785":"2024-03-26T09:11:27.874450+0000","172.21.15.19:6800/3828199631":"2024-03-26T09:11:27.874450+0000","172.21.15.19:6800/758887937":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/3783446823":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/1217144301":"2024-03-26T09:11:00.797567+0000","172.21.15.19:0/1291153985":"2024-03-26T09:11:00.797567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T09:16:30.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:29 smithi059 ceph-mon[32732]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:30.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:29 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2299966886' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-25T09:16:30.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:29 smithi019 ceph-mon[29386]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:30.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:29 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2299966886' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-25T09:16:30.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:29 smithi040 ceph-mon[33094]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:30.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:29 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2299966886' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-25T09:16:30.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-25T09:16:30.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-25T09:16:30.631 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-25T09:16:30.631 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-25T09:16:30.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-25T09:16:30.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-25T09:16:30.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-25T09:16:30.633 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-25T09:16:31.073 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:31.073 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:31.075 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:31.096 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:31.134 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:31.141 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:31.142 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:31.143 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:32.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:32 smithi059 ceph-mon[32732]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:32.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:32 smithi040 ceph-mon[33094]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:32.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:32 smithi019 ceph-mon[29386]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:34.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:34 smithi019 ceph-mon[29386]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:34.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:34 smithi059 ceph-mon[32732]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:34.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:34 smithi040 ceph-mon[33094]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:36 smithi019 ceph-mon[29386]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:36 smithi059 ceph-mon[32732]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:36 smithi040 ceph-mon[33094]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:37.448 INFO:teuthology.orchestra.run.smithi019.stdout:141733920792 2024-03-25T09:16:37.449 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-25T09:16:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:38 smithi059 ceph-mon[32732]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:38.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:38 smithi040 ceph-mon[33094]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:38.304 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:38 smithi019 ceph-mon[29386]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:40 smithi059 ceph-mon[32732]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:40.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:40 smithi040 ceph-mon[33094]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:40 smithi019 ceph-mon[29386]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:40.912 INFO:teuthology.orchestra.run.smithi019.stdout:219043332104 2024-03-25T09:16:40.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-25T09:16:42.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:42 smithi019 ceph-mon[29386]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:42 smithi040 ceph-mon[33094]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:42.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:42 smithi059 ceph-mon[32732]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:43.654 INFO:teuthology.orchestra.run.smithi019.stdout:55834574888 2024-03-25T09:16:43.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-25T09:16:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:44 smithi040 ceph-mon[33094]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:44 smithi019 ceph-mon[29386]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:44.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:44 smithi059 ceph-mon[32732]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:44.524 INFO:teuthology.orchestra.run.smithi019.stdout:163208757268 2024-03-25T09:16:44.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-25T09:16:45.234 INFO:teuthology.orchestra.run.smithi019.stdout:77309411364 2024-03-25T09:16:45.234 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-25T09:16:46.215 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:46 smithi019 ceph-mon[29386]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:46 smithi040 ceph-mon[33094]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:46 smithi059 ceph-mon[32732]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:46.632 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:47.418 INFO:teuthology.orchestra.run.smithi019.stdout:197568495632 2024-03-25T09:16:47.418 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-25T09:16:48.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:48 smithi040 ceph-mon[33094]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:48.313 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:48 smithi059 ceph-mon[32732]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:48.715 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:48 smithi019 ceph-mon[29386]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:48.976 INFO:teuthology.orchestra.run.smithi019.stdout:107374182430 2024-03-25T09:16:48.977 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-25T09:16:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:49.618 INFO:teuthology.orchestra.run.smithi019.stdout:34359738413 2024-03-25T09:16:49.619 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-25T09:16:49.866 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:50.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:50 smithi019 ceph-mon[29386]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:50.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:50 smithi040 ceph-mon[33094]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:50.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:50 smithi059 ceph-mon[32732]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:52.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:52 smithi019 ceph-mon[29386]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:52 smithi040 ceph-mon[33094]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:52 smithi059 ceph-mon[32732]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:53.769 INFO:teuthology.orchestra.run.smithi019.stdout:141733920795 2024-03-25T09:16:54.006 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:53 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/877058101' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-03-25T09:16:54.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:53 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/877058101' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-03-25T09:16:54.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:53 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/877058101' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-03-25T09:16:55.085 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:54 smithi019 ceph-mon[29386]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:55.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:54 smithi059 ceph-mon[32732]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:55.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:54 smithi040 ceph-mon[33094]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:55.661 INFO:teuthology.orchestra.run.smithi019.stdout:55834574890 2024-03-25T09:16:55.789 INFO:teuthology.orchestra.run.smithi019.stdout:163208757270 2024-03-25T09:16:55.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:55 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2944335047' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-03-25T09:16:55.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:55 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2033347998' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-03-25T09:16:56.192 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574888 got 55834574890 for osd.1 2024-03-25T09:16:56.193 DEBUG:teuthology.parallel:result is None 2024-03-25T09:16:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:55 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2944335047' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-03-25T09:16:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:55 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2033347998' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-03-25T09:16:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:55 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2944335047' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-03-25T09:16:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:55 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2033347998' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-03-25T09:16:57.001 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920792 got 141733920795 for osd.4 2024-03-25T09:16:57.002 DEBUG:teuthology.parallel:result is None 2024-03-25T09:16:57.104 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:56 smithi019 ceph-mon[29386]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:57.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:56 smithi059 ceph-mon[32732]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:57.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:56 smithi040 ceph-mon[33094]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:57.668 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:16:57.748 INFO:teuthology.orchestra.run.smithi019.stdout:197568495634 2024-03-25T09:16:57.909 INFO:teuthology.orchestra.run.smithi019.stdout:219043332108 2024-03-25T09:16:58.091 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:57 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2826602779' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-03-25T09:16:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:57 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2826602779' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-03-25T09:16:58.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:57 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2826602779' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-03-25T09:16:58.669 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332104 got 219043332108 for osd.7 2024-03-25T09:16:58.669 DEBUG:teuthology.parallel:result is None 2024-03-25T09:16:58.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:58 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/768992437' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-03-25T09:16:58.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:16:58 smithi019 ceph-mon[29386]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:59.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:58 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/768992437' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-03-25T09:16:59.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:16:58 smithi059 ceph-mon[32732]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:59.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:58 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/768992437' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-03-25T09:16:59.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:16:58 smithi040 ceph-mon[33094]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:16:59.586 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:00.032 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:00 smithi019 ceph-mon[29386]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:00.066 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757268 got 163208757270 for osd.5 2024-03-25T09:17:00.066 DEBUG:teuthology.parallel:result is None 2024-03-25T09:17:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:00 smithi059 ceph-mon[32732]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:00 smithi040 ceph-mon[33094]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:01.737 INFO:teuthology.orchestra.run.smithi019.stdout:107374182433 2024-03-25T09:17:02.114 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:01 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2287850576' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-03-25T09:17:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:01 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2287850576' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-03-25T09:17:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:01 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2287850576' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-03-25T09:17:02.534 INFO:teuthology.orchestra.run.smithi019.stdout:77309411367 2024-03-25T09:17:03.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:02 smithi019 ceph-mon[29386]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:03.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:02 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/4047127274' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-03-25T09:17:03.223 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411364 got 77309411367 for osd.2 2024-03-25T09:17:03.223 DEBUG:teuthology.parallel:result is None 2024-03-25T09:17:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:02 smithi059 ceph-mon[32732]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:02 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/4047127274' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-03-25T09:17:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:02 smithi040 ceph-mon[33094]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:02 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/4047127274' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-03-25T09:17:03.615 INFO:teuthology.orchestra.run.smithi019.stdout:34359738416 2024-03-25T09:17:03.825 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495632 got 197568495634 for osd.6 2024-03-25T09:17:03.825 DEBUG:teuthology.parallel:result is None 2024-03-25T09:17:04.081 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:03 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/3546695915' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-03-25T09:17:04.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:03 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/3546695915' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-03-25T09:17:04.264 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:03 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/3546695915' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-03-25T09:17:04.663 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182430 got 107374182433 for osd.3 2024-03-25T09:17:04.664 DEBUG:teuthology.parallel:result is None 2024-03-25T09:17:04.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:04 smithi019 ceph-mon[29386]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:05.050 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738413 got 34359738416 for osd.0 2024-03-25T09:17:05.050 DEBUG:teuthology.parallel:result is None 2024-03-25T09:17:05.050 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-25T09:17:05.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph pg dump --format=json 2024-03-25T09:17:05.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:04 smithi059 ceph-mon[32732]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:05.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:04 smithi040 ceph-mon[33094]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:06.306 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:06 smithi019 ceph-mon[29386]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:06 smithi059 ceph-mon[32732]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:06 smithi040 ceph-mon[33094]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:07.053 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:17:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-25T09:17:07.320 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:07 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:17:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:07 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:17:07.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:07 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:17:07.691 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-03-25T09:17:05.936606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":230132,"kb_used_data":5644,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":749731084,"statfs":{"total":767960285184,"available":767724630016,"internally_reserved":0,"allocated":5779456,"data_stored":3398144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002466"},"pg_stats":[{"pgid":"1.0","version":"21'137","reported_seq":261,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-03-25T09:16:06.808145+0000","last_change":"2024-03-25T09:15:19.220133+0000","last_active":"2024-03-25T09:16:06.808145+0000","last_peered":"2024-03-25T09:16:06.808145+0000","last_clean":"2024-03-25T09:16:06.808145+0000","last_became_active":"2024-03-25T09:15:19.219617+0000","last_became_peered":"2024-03-25T09:15:19.219617+0000","last_unstale":"2024-03-25T09:16:06.808145+0000","last_undegraded":"2024-03-25T09:16:06.808145+0000","last_fullsized":"2024-03-25T09:16:06.808145+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T09:14:02.495608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T09:14:02.495608+0000","last_clean_scrub_stamp":"2024-03-25T09:14:02.495608+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:23.913014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":5}],"osd_stats":[{"osd":7,"up_from":51,"seq":219043332110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495636,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31668,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713484,"statfs":{"total":95995035648,"available":95962607616,"internally_reserved":0,"allocated":499712,"data_stored":203380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411368,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1093632,"data_stored":793748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182434,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":793748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757273,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1093632,"data_stored":793748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T09:17:07.693 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph pg dump --format=json 2024-03-25T09:17:07.940 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:08.307 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:08 smithi019 ceph-mon[29386]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:17:08.307 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:08.307 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:17:08.308 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:08 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:08.308 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:08 smithi019 ceph-mon[29386]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:08 smithi059 ceph-mon[32732]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:17:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:17:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:08 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:08 smithi059 ceph-mon[32732]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:08 smithi040 ceph-mon[33094]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:17:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:17:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:08 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:08 smithi040 ceph-mon[33094]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:09.766 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:17:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-25T09:17:10.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:10 smithi019 ceph-mon[29386]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:17:10.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:10 smithi019 ceph-mon[29386]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:10 smithi059 ceph-mon[32732]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:17:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:10 smithi059 ceph-mon[32732]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:10.512 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-03-25T09:17:07.937060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":230132,"kb_used_data":5644,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":749731084,"statfs":{"total":767960285184,"available":767724630016,"internally_reserved":0,"allocated":5779456,"data_stored":3398144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002485"},"pg_stats":[{"pgid":"1.0","version":"21'137","reported_seq":261,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-03-25T09:16:06.808145+0000","last_change":"2024-03-25T09:15:19.220133+0000","last_active":"2024-03-25T09:16:06.808145+0000","last_peered":"2024-03-25T09:16:06.808145+0000","last_clean":"2024-03-25T09:16:06.808145+0000","last_became_active":"2024-03-25T09:15:19.219617+0000","last_became_peered":"2024-03-25T09:15:19.219617+0000","last_unstale":"2024-03-25T09:16:06.808145+0000","last_undegraded":"2024-03-25T09:16:06.808145+0000","last_fullsized":"2024-03-25T09:16:06.808145+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T09:14:02.495608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T09:14:02.495608+0000","last_clean_scrub_stamp":"2024-03-25T09:14:02.495608+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:23.913014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":5}],"osd_stats":[{"osd":7,"up_from":51,"seq":219043332110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31668,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713484,"statfs":{"total":95995035648,"available":95962607616,"internally_reserved":0,"allocated":499712,"data_stored":203380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411369,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1093632,"data_stored":793748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182435,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":793748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757273,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1093632,"data_stored":793748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T09:17:10.513 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-25T09:17:10.513 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-25T09:17:10.513 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-25T09:17:10.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph health --format=json 2024-03-25T09:17:10.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:10 smithi040 ceph-mon[33094]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:17:10.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:10 smithi040 ceph-mon[33094]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:10.756 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:12.119 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:12 smithi019 ceph-mon[29386]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:12 smithi059 ceph-mon[32732]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:12 smithi040 ceph-mon[33094]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:12.619 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:17:12.619 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-25T09:17:13.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:13 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/83058019' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-03-25T09:17:13.462 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-25T09:17:13.463 INFO:tasks.cephadm:Setup complete, yielding 2024-03-25T09:17:13.463 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-25T09:17:13.472 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi019.front.sepia.ceph.com 2024-03-25T09:17:13.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- bash -c 'ceph orch status' 2024-03-25T09:17:13.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:13 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/83058019' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-03-25T09:17:13.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:13 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/83058019' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-03-25T09:17:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:14.144 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:14 smithi019 ceph-mon[29386]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:14 smithi059 ceph-mon[32732]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:14.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:14 smithi040 ceph-mon[33094]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:15.464 INFO:teuthology.orchestra.run.smithi019.stdout:Backend: cephadm 2024-03-25T09:17:15.464 INFO:teuthology.orchestra.run.smithi019.stdout:Available: Yes 2024-03-25T09:17:15.464 INFO:teuthology.orchestra.run.smithi019.stdout:Paused: No 2024-03-25T09:17:16.194 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-25T09:17:16.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:16 smithi019 ceph-mon[29386]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:16.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:16 smithi019 ceph-mon[29386]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:16.441 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:16.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:16 smithi059 ceph-mon[32732]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:16.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:16 smithi059 ceph-mon[32732]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:16.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:16 smithi040 ceph-mon[33094]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:16.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:16 smithi040 ceph-mon[33094]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:18.237 INFO:teuthology.orchestra.run.smithi019.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-25T09:17:18.237 INFO:teuthology.orchestra.run.smithi019.stdout:mgr.x smithi019 *:9283,8765 running (6m) 3m ago 6m 494M - 19.0.0-1997-g47ea673a 57d5a95370c2 c5caafa6dd4b 2024-03-25T09:17:18.237 INFO:teuthology.orchestra.run.smithi019.stdout:mon.a smithi019 running (6m) 3m ago 6m 37.0M 2048M 19.0.0-1997-g47ea673a 57d5a95370c2 a34efeb6eefd 2024-03-25T09:17:18.237 INFO:teuthology.orchestra.run.smithi019.stdout:mon.b smithi040 running (4m) 2m ago 4m 35.0M 2048M 19.0.0-1997-g47ea673a 57d5a95370c2 726d19e6d672 2024-03-25T09:17:18.237 INFO:teuthology.orchestra.run.smithi019.stdout:mon.c smithi059 running (4m) 75s ago 4m 36.5M 2048M 19.0.0-1997-g47ea673a 57d5a95370c2 f17d31bfc7ad 2024-03-25T09:17:18.237 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 smithi019 running (4m) 3m ago 4m 27.5M 8546M 19.0.0-1997-g47ea673a 57d5a95370c2 723f431e898b 2024-03-25T09:17:18.238 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 smithi019 running (3m) 3m ago 3m 15.0M 8546M 19.0.0-1997-g47ea673a 57d5a95370c2 6451e7299b07 2024-03-25T09:17:18.238 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 smithi040 running (3m) 2m ago 3m 45.0M 7063M 19.0.0-1997-g47ea673a 57d5a95370c2 af48004ed4a8 2024-03-25T09:17:18.238 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3 smithi040 running (2m) 2m ago 2m 39.8M 7063M 19.0.0-1997-g47ea673a 57d5a95370c2 e8e9e51fefda 2024-03-25T09:17:18.238 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4 smithi040 running (2m) 2m ago 2m 15.0M 7063M 19.0.0-1997-g47ea673a 57d5a95370c2 b861261698c6 2024-03-25T09:17:18.238 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5 smithi059 running (2m) 75s ago 2m 41.9M 7063M 19.0.0-1997-g47ea673a 57d5a95370c2 4bf36b477766 2024-03-25T09:17:18.238 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6 smithi059 running (104s) 75s ago 103s 37.4M 7063M 19.0.0-1997-g47ea673a 57d5a95370c2 43c6358c8615 2024-03-25T09:17:18.238 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7 smithi059 running (79s) 75s ago 79s 12.2M 7063M 19.0.0-1997-g47ea673a 57d5a95370c2 216e80d878e1 2024-03-25T09:17:18.313 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:18 smithi059 ceph-mon[32732]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:18.367 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:18 smithi019 ceph-mon[29386]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:18 smithi040 ceph-mon[33094]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:18.878 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-25T09:17:19.118 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:19.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:19 smithi019 ceph-mon[29386]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:19.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:19 smithi059 ceph-mon[32732]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:19 smithi040 ceph-mon[33094]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:20.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:20 smithi019 ceph-mon[29386]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:20.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:20 smithi040 ceph-mon[33094]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:20 smithi059 ceph-mon[32732]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:20.912 INFO:teuthology.orchestra.run.smithi019.stdout:HOST ADDR LABELS STATUS 2024-03-25T09:17:20.913 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019 172.21.15.19 2024-03-25T09:17:20.913 INFO:teuthology.orchestra.run.smithi019.stdout:smithi040 172.21.15.40 2024-03-25T09:17:20.913 INFO:teuthology.orchestra.run.smithi019.stdout:smithi059 172.21.15.59 2024-03-25T09:17:20.913 INFO:teuthology.orchestra.run.smithi019.stdout:smithi129 172.21.15.129 2024-03-25T09:17:20.913 INFO:teuthology.orchestra.run.smithi019.stdout:4 hosts in cluster 2024-03-25T09:17:21.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:21 smithi019 ceph-mon[29386]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:21 smithi059 ceph-mon[32732]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:21 smithi040 ceph-mon[33094]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:21.524 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-25T09:17:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:22.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:22 smithi019 ceph-mon[29386]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:22 smithi059 ceph-mon[32732]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:22 smithi040 ceph-mon[33094]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:23.492 INFO:teuthology.orchestra.run.smithi019.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-25T09:17:23.492 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330002G400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-03-25T09:17:23.492 INFO:teuthology.orchestra.run.smithi019.stdout:smithi040 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009J400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-03-25T09:17:23.492 INFO:teuthology.orchestra.run.smithi019.stdout:smithi059 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009L400BGN 372G No 77s ago Has a FileSystem, LVM detected 2024-03-25T09:17:23.492 INFO:teuthology.orchestra.run.smithi019.stdout:smithi129 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300HY400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-03-25T09:17:24.072 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- bash -c 'ceph osd lspools' 2024-03-25T09:17:24.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:24 smithi019 ceph-mon[29386]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:24.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:24 smithi019 ceph-mon[29386]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:24.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:24 smithi059 ceph-mon[32732]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:24.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:24 smithi059 ceph-mon[32732]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:24.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:24 smithi040 ceph-mon[33094]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:24.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:24 smithi040 ceph-mon[33094]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:26.085 INFO:teuthology.orchestra.run.smithi019.stdout:1 .mgr 2024-03-25T09:17:26.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:26 smithi019 ceph-mon[29386]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:26 smithi059 ceph-mon[32732]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:26 smithi040 ceph-mon[33094]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:26.756 INFO:teuthology.run_tasks:Running task nvmeof... 2024-03-25T09:17:26.771 INFO:tasks.nvmeof:[nvmeof]: deploying nvmeof gateway... 2024-03-25T09:17:26.771 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.a on smithi019 2024-03-25T09:17:26.771 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.b on smithi040 2024-03-25T09:17:26.772 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.c on smithi059 2024-03-25T09:17:26.772 INFO:tasks.nvmeof:[nvmeof]: ceph config set mgr mgr/cephadm/container_image_nvmeof quay.io/ceph/nvmeof:1.1.0 2024-03-25T09:17:26.772 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph config set mgr mgr/cephadm/container_image_nvmeof quay.io/ceph/nvmeof:1.1.0 2024-03-25T09:17:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:27.334 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:27 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/471376924' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2024-03-25T09:17:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:27 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/471376924' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2024-03-25T09:17:27.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:27 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/471376924' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2024-03-25T09:17:28.188 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:28 smithi019 ceph-mon[29386]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:28.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:28 smithi059 ceph-mon[32732]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:28.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:28 smithi040 ceph-mon[33094]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:29.330 INFO:tasks.nvmeof:[nvmeof]: ceph osd pool create mypool 2024-03-25T09:17:29.331 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph osd pool create mypool 2024-03-25T09:17:29.573 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:29.980 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:29 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2424361430' entity='client.admin' 2024-03-25T09:17:29.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:29 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:17:29.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:29 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:29.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:29 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:17:29.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:29 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:30.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:29 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2424361430' entity='client.admin' 2024-03-25T09:17:30.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:29 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:17:30.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:29 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:30.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:29 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:17:30.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:29 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:29 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2424361430' entity='client.admin' 2024-03-25T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:29 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:29 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:29 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:29 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:30.877 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:30 smithi019 ceph-mon[29386]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:31.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:30 smithi059 ceph-mon[32732]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:31.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:30 smithi040 ceph-mon[33094]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:31.757 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'mypool' created 2024-03-25T09:17:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:31 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2792126410' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2024-03-25T09:17:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:31 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2792126410' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2024-03-25T09:17:32.076 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:31 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2792126410' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2024-03-25T09:17:32.359 INFO:tasks.nvmeof:[nvmeof]: rbd pool init mypool 2024-03-25T09:17:32.359 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd pool init mypool 2024-03-25T09:17:32.605 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:33.004 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:32 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2792126410' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2024-03-25T09:17:33.005 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:32 smithi019 ceph-mon[29386]: osdmap e53: 8 total, 8 up, 8 in 2024-03-25T09:17:33.005 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:32 smithi019 ceph-mon[29386]: pgmap v225: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:33.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:32 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2792126410' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2024-03-25T09:17:33.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:32 smithi059 ceph-mon[32732]: osdmap e53: 8 total, 8 up, 8 in 2024-03-25T09:17:33.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:32 smithi059 ceph-mon[32732]: pgmap v225: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:33.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:32 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2792126410' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2024-03-25T09:17:33.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:32 smithi040 ceph-mon[33094]: osdmap e53: 8 total, 8 up, 8 in 2024-03-25T09:17:33.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:32 smithi040 ceph-mon[33094]: pgmap v225: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:34.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:33 smithi059 ceph-mon[32732]: osdmap e54: 8 total, 8 up, 8 in 2024-03-25T09:17:34.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:33 smithi040 ceph-mon[33094]: osdmap e54: 8 total, 8 up, 8 in 2024-03-25T09:17:34.015 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:33 smithi019 ceph-mon[29386]: osdmap e54: 8 total, 8 up, 8 in 2024-03-25T09:17:35.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:34 smithi019 ceph-mon[29386]: osdmap e55: 8 total, 8 up, 8 in 2024-03-25T09:17:35.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:34 smithi019 ceph-mon[29386]: pgmap v228: 33 pgs: 3 creating+peering, 4 active+clean, 26 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:35.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:34 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/1011877891' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2024-03-25T09:17:35.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:34 smithi059 ceph-mon[32732]: osdmap e55: 8 total, 8 up, 8 in 2024-03-25T09:17:35.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:34 smithi059 ceph-mon[32732]: pgmap v228: 33 pgs: 3 creating+peering, 4 active+clean, 26 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:35.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:34 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/1011877891' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2024-03-25T09:17:35.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:34 smithi040 ceph-mon[33094]: osdmap e55: 8 total, 8 up, 8 in 2024-03-25T09:17:35.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:34 smithi040 ceph-mon[33094]: pgmap v228: 33 pgs: 3 creating+peering, 4 active+clean, 26 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:35.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:34 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/1011877891' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2024-03-25T09:17:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:35 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/1011877891' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2024-03-25T09:17:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:35 smithi019 ceph-mon[29386]: osdmap e56: 8 total, 8 up, 8 in 2024-03-25T09:17:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:35 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/1011877891' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2024-03-25T09:17:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:35 smithi059 ceph-mon[32732]: osdmap e56: 8 total, 8 up, 8 in 2024-03-25T09:17:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:35 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/1011877891' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2024-03-25T09:17:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:35 smithi040 ceph-mon[33094]: osdmap e56: 8 total, 8 up, 8 in 2024-03-25T09:17:37.108 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:36 smithi019 ceph-mon[29386]: osdmap e57: 8 total, 8 up, 8 in 2024-03-25T09:17:37.108 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:36 smithi019 ceph-mon[29386]: pgmap v231: 33 pgs: 3 creating+peering, 22 active+clean, 8 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:36 smithi059 ceph-mon[32732]: osdmap e57: 8 total, 8 up, 8 in 2024-03-25T09:17:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:36 smithi059 ceph-mon[32732]: pgmap v231: 33 pgs: 3 creating+peering, 22 active+clean, 8 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:36 smithi040 ceph-mon[33094]: osdmap e57: 8 total, 8 up, 8 in 2024-03-25T09:17:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:36 smithi040 ceph-mon[33094]: pgmap v231: 33 pgs: 3 creating+peering, 22 active+clean, 8 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-03-25T09:17:37.402 INFO:tasks.nvmeof:[nvmeof]: ceph orch apply nvmeof mypool 2024-03-25T09:17:37.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch apply nvmeof mypool --placement '3;smithi019=nvmeof.a;smithi040=nvmeof.b;smithi059=nvmeof.c' 2024-03-25T09:17:37.650 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:38.095 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:37 smithi019 ceph-mon[29386]: osdmap e58: 8 total, 8 up, 8 in 2024-03-25T09:17:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:37 smithi059 ceph-mon[32732]: osdmap e58: 8 total, 8 up, 8 in 2024-03-25T09:17:38.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:37 smithi040 ceph-mon[33094]: osdmap e58: 8 total, 8 up, 8 in 2024-03-25T09:17:39.044 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:38 smithi019 ceph-mon[29386]: pgmap v233: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 245 B/s wr, 0 op/s 2024-03-25T09:17:39.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:38 smithi059 ceph-mon[32732]: pgmap v233: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 245 B/s wr, 0 op/s 2024-03-25T09:17:39.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:38 smithi040 ceph-mon[33094]: pgmap v233: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 245 B/s wr, 0 op/s 2024-03-25T09:17:39.491 INFO:teuthology.orchestra.run.smithi019.stdout:Scheduled nvmeof.mypool update... 2024-03-25T09:17:40.185 INFO:tasks.nvmeof:[nvmeof]: creating 20 images 2024-03-25T09:17:40.186 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage1 --size 8192 2024-03-25T09:17:40.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage1 --size 8192 2024-03-25T09:17:40.436 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:40.742 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "placement": "3;smithi019=nvmeof.a;smithi040=nvmeof.b;smithi059=nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:40.742 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: Saving service nvmeof.mypool spec with placement smithi019=nvmeof.a;smithi040=nvmeof.b;smithi059=nvmeof.c;count:3 2024-03-25T09:17:40.742 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:40.742 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:17:40.742 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:40.742 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:17:40.743 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:40.743 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-25T09:17:40.743 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-25T09:17:40.743 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:40.743 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"} : dispatch 2024-03-25T09:17:40.743 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"}]': finished 2024-03-25T09:17:40.743 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: Deploying daemon nvmeof.nvmeof.c on smithi059 2024-03-25T09:17:40.743 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:40 smithi059 ceph-mon[32732]: pgmap v234: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-03-25T09:17:40.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "placement": "3;smithi019=nvmeof.a;smithi040=nvmeof.b;smithi059=nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:40.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: Saving service nvmeof.mypool spec with placement smithi019=nvmeof.a;smithi040=nvmeof.b;smithi059=nvmeof.c;count:3 2024-03-25T09:17:40.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:40.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:17:40.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:40.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:17:40.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:40.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-25T09:17:40.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-25T09:17:40.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:40.767 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"} : dispatch 2024-03-25T09:17:40.768 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"}]': finished 2024-03-25T09:17:40.768 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: Deploying daemon nvmeof.nvmeof.c on smithi059 2024-03-25T09:17:40.768 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:40 smithi040 ceph-mon[33094]: pgmap v234: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-03-25T09:17:40.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "placement": "3;smithi019=nvmeof.a;smithi040=nvmeof.b;smithi059=nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-25T09:17:40.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: Saving service nvmeof.mypool spec with placement smithi019=nvmeof.a;smithi040=nvmeof.b;smithi059=nvmeof.c;count:3 2024-03-25T09:17:40.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:40.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:17:40.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:40.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:17:40.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:40.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-25T09:17:40.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-25T09:17:40.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:40.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"} : dispatch 2024-03-25T09:17:40.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"}]': finished 2024-03-25T09:17:40.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: Deploying daemon nvmeof.nvmeof.c on smithi059 2024-03-25T09:17:40.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:40 smithi019 ceph-mon[29386]: pgmap v234: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-03-25T09:17:42.260 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:42 smithi019 ceph-mon[29386]: pgmap v235: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 285 B/s wr, 0 op/s 2024-03-25T09:17:42.340 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:42 smithi059 ceph-mon[32732]: pgmap v235: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 285 B/s wr, 0 op/s 2024-03-25T09:17:42.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:42 smithi040 ceph-mon[33094]: pgmap v235: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 285 B/s wr, 0 op/s 2024-03-25T09:17:42.520 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage2 --size 8192 2024-03-25T09:17:42.521 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage2 --size 8192 2024-03-25T09:17:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:44.210 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:44 smithi019 ceph-mon[29386]: pgmap v236: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 250 B/s wr, 0 op/s 2024-03-25T09:17:44.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:44 smithi059 ceph-mon[32732]: pgmap v236: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 250 B/s wr, 0 op/s 2024-03-25T09:17:44.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:44 smithi040 ceph-mon[33094]: pgmap v236: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 250 B/s wr, 0 op/s 2024-03-25T09:17:44.961 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage3 --size 8192 2024-03-25T09:17:44.961 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage3 --size 8192 2024-03-25T09:17:45.202 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:46.380 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:46 smithi019 ceph-mon[29386]: osdmap e59: 8 total, 8 up, 8 in 2024-03-25T09:17:46.381 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:46 smithi019 ceph-mon[29386]: pgmap v238: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 670 B/s wr, 1 op/s 2024-03-25T09:17:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:46 smithi059 ceph-mon[32732]: osdmap e59: 8 total, 8 up, 8 in 2024-03-25T09:17:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:46 smithi059 ceph-mon[32732]: pgmap v238: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 670 B/s wr, 1 op/s 2024-03-25T09:17:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:46 smithi040 ceph-mon[33094]: osdmap e59: 8 total, 8 up, 8 in 2024-03-25T09:17:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:46 smithi040 ceph-mon[33094]: pgmap v238: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 670 B/s wr, 1 op/s 2024-03-25T09:17:47.504 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage4 --size 8192 2024-03-25T09:17:47.504 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage4 --size 8192 2024-03-25T09:17:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:48.124 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:48 smithi019 ceph-mon[29386]: pgmap v239: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 819 B/s wr, 2 op/s 2024-03-25T09:17:48.312 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:48 smithi059 ceph-mon[32732]: pgmap v239: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 819 B/s wr, 2 op/s 2024-03-25T09:17:48.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:48 smithi040 ceph-mon[33094]: pgmap v239: 33 pgs: 33 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 819 B/s wr, 2 op/s 2024-03-25T09:17:49.956 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage5 --size 8192 2024-03-25T09:17:49.956 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage5 --size 8192 2024-03-25T09:17:50.185 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:50 smithi059 ceph-mon[32732]: pgmap v240: 33 pgs: 33 active+clean; 578 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-25T09:17:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:50.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:50 smithi040 ceph-mon[33094]: pgmap v240: 33 pgs: 33 active+clean; 578 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-25T09:17:50.324 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:50 smithi019 ceph-mon[29386]: pgmap v240: 33 pgs: 33 active+clean; 578 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-25T09:17:51.300 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:51 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:51.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:51 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:51.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:51 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:51.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:51 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-25T09:17:51.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:51 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-25T09:17:51.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:51 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:51.339 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:51 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"} : dispatch 2024-03-25T09:17:51.339 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:51 smithi019 ceph-mon[29386]: from='client.? 172.21.15.59:0/2759271820' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2024-03-25T09:17:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:51 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:51 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:51 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:51 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-25T09:17:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:51 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-25T09:17:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:51 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:51 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"} : dispatch 2024-03-25T09:17:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:51 smithi059 ceph-mon[32732]: from='client.? 172.21.15.59:0/2759271820' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2024-03-25T09:17:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:51 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:51 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:51 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:17:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:51 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-25T09:17:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:51 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-25T09:17:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:51 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:17:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:51 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"} : dispatch 2024-03-25T09:17:51.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:51 smithi040 ceph-mon[33094]: from='client.? 172.21.15.59:0/2759271820' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2024-03-25T09:17:52.306 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage6 --size 8192 2024-03-25T09:17:52.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage6 --size 8192 2024-03-25T09:17:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:52 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"}]': finished 2024-03-25T09:17:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:52 smithi019 ceph-mon[29386]: Deploying daemon nvmeof.nvmeof.b on smithi040 2024-03-25T09:17:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:52 smithi019 ceph-mon[29386]: pgmap v241: 33 pgs: 33 active+clean; 578 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-25T09:17:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:52 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"}]': finished 2024-03-25T09:17:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:52 smithi059 ceph-mon[32732]: Deploying daemon nvmeof.nvmeof.b on smithi040 2024-03-25T09:17:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:52 smithi059 ceph-mon[32732]: pgmap v241: 33 pgs: 33 active+clean; 578 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-25T09:17:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:52 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"}]': finished 2024-03-25T09:17:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:52 smithi040 ceph-mon[33094]: Deploying daemon nvmeof.nvmeof.b on smithi040 2024-03-25T09:17:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:52 smithi040 ceph-mon[33094]: pgmap v241: 33 pgs: 33 active+clean; 578 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-25T09:17:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:54 smithi019 ceph-mon[29386]: pgmap v242: 33 pgs: 33 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-03-25T09:17:54.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:54 smithi059 ceph-mon[32732]: pgmap v242: 33 pgs: 33 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-03-25T09:17:54.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:54 smithi040 ceph-mon[33094]: pgmap v242: 33 pgs: 33 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-03-25T09:17:54.728 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage7 --size 8192 2024-03-25T09:17:54.728 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage7 --size 8192 2024-03-25T09:17:54.976 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:56.375 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:56 smithi019 ceph-mon[29386]: pgmap v243: 33 pgs: 33 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-25T09:17:56.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:56 smithi059 ceph-mon[32732]: pgmap v243: 33 pgs: 33 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-25T09:17:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:56 smithi040 ceph-mon[33094]: pgmap v243: 33 pgs: 33 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-25T09:17:57.163 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage8 --size 8192 2024-03-25T09:17:57.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage8 --size 8192 2024-03-25T09:17:57.409 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:17:58.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:17:58 smithi019 ceph-mon[29386]: pgmap v244: 33 pgs: 33 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-03-25T09:17:58.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:17:58 smithi059 ceph-mon[32732]: pgmap v244: 33 pgs: 33 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-03-25T09:17:58.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:17:58 smithi040 ceph-mon[33094]: pgmap v244: 33 pgs: 33 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-03-25T09:17:59.571 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage9 --size 8192 2024-03-25T09:17:59.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage9 --size 8192 2024-03-25T09:17:59.818 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:00.265 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:00 smithi019 ceph-mon[29386]: pgmap v245: 33 pgs: 33 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-03-25T09:18:00.291 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:00 smithi040 ceph-mon[33094]: pgmap v245: 33 pgs: 33 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-03-25T09:18:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:00 smithi059 ceph-mon[32732]: pgmap v245: 33 pgs: 33 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-03-25T09:18:02.047 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage10 --size 8192 2024-03-25T09:18:02.047 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage10 --size 8192 2024-03-25T09:18:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:02.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:02 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:02.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:02 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:02.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:02 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:02.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:02 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-25T09:18:02.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:02 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-25T09:18:02.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:02 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:18:02.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:02 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"} : dispatch 2024-03-25T09:18:02.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:02 smithi019 ceph-mon[29386]: from='client.? 172.21.15.40:0/1553745463' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2024-03-25T09:18:02.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:02 smithi019 ceph-mon[29386]: pgmap v246: 33 pgs: 33 active+clean; 581 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-03-25T09:18:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:02 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:02 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:02 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:02 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-25T09:18:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:02 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-25T09:18:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:02 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:18:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:02 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"} : dispatch 2024-03-25T09:18:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:02 smithi059 ceph-mon[32732]: from='client.? 172.21.15.40:0/1553745463' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2024-03-25T09:18:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:02 smithi059 ceph-mon[32732]: pgmap v246: 33 pgs: 33 active+clean; 581 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-03-25T09:18:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:02 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:02 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:02 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:02 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-25T09:18:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:02 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-25T09:18:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:02 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:18:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:02 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"} : dispatch 2024-03-25T09:18:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:02 smithi040 ceph-mon[33094]: from='client.? 172.21.15.40:0/1553745463' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2024-03-25T09:18:02.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:02 smithi040 ceph-mon[33094]: pgmap v246: 33 pgs: 33 active+clean; 581 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-03-25T09:18:03.407 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:03 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"}]': finished 2024-03-25T09:18:03.407 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:03 smithi019 ceph-mon[29386]: Deploying daemon nvmeof.nvmeof.a on smithi019 2024-03-25T09:18:03.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:03 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"}]': finished 2024-03-25T09:18:03.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:03 smithi059 ceph-mon[32732]: Deploying daemon nvmeof.nvmeof.a on smithi019 2024-03-25T09:18:03.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:03 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"}]': finished 2024-03-25T09:18:03.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:03 smithi040 ceph-mon[33094]: Deploying daemon nvmeof.nvmeof.a on smithi019 2024-03-25T09:18:04.331 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:04 smithi019 ceph-mon[29386]: pgmap v247: 33 pgs: 33 active+clean; 581 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-25T09:18:04.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:04 smithi059 ceph-mon[32732]: pgmap v247: 33 pgs: 33 active+clean; 581 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-25T09:18:04.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:04 smithi040 ceph-mon[33094]: pgmap v247: 33 pgs: 33 active+clean; 581 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-25T09:18:04.809 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage11 --size 8192 2024-03-25T09:18:04.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage11 --size 8192 2024-03-25T09:18:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:06.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:06 smithi019 ceph-mon[29386]: pgmap v248: 33 pgs: 33 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-03-25T09:18:06.297 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:06 smithi059 ceph-mon[32732]: pgmap v248: 33 pgs: 33 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-03-25T09:18:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:06 smithi040 ceph-mon[33094]: pgmap v248: 33 pgs: 33 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-03-25T09:18:08.084 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage12 --size 8192 2024-03-25T09:18:08.084 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage12 --size 8192 2024-03-25T09:18:08.305 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:08 smithi059 ceph-mon[32732]: pgmap v249: 33 pgs: 33 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-25T09:18:08.400 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:08.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:08 smithi019 ceph-mon[29386]: pgmap v249: 33 pgs: 33 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-25T09:18:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:08 smithi040 ceph-mon[33094]: pgmap v249: 33 pgs: 33 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-25T09:18:10.313 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:10 smithi059 ceph-mon[32732]: pgmap v250: 33 pgs: 33 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-03-25T09:18:10.364 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:10 smithi019 ceph-mon[29386]: pgmap v250: 33 pgs: 33 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-03-25T09:18:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:10 smithi040 ceph-mon[33094]: pgmap v250: 33 pgs: 33 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-03-25T09:18:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:12 smithi040 ceph-mon[33094]: pgmap v251: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-03-25T09:18:12.321 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:12 smithi059 ceph-mon[32732]: pgmap v251: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-03-25T09:18:12.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:12 smithi019 ceph-mon[29386]: pgmap v251: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-03-25T09:18:14.329 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:14 smithi059 ceph-mon[32732]: pgmap v252: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-03-25T09:18:14.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:14 smithi019 ceph-mon[29386]: pgmap v252: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-03-25T09:18:14.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:14 smithi040 ceph-mon[33094]: pgmap v252: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-03-25T09:18:16.020 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage13 --size 8192 2024-03-25T09:18:16.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage13 --size 8192 2024-03-25T09:18:16.190 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:16 smithi019 ceph-mon[29386]: pgmap v253: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-25T09:18:16.337 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:16 smithi059 ceph-mon[32732]: pgmap v253: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-25T09:18:16.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:16 smithi040 ceph-mon[33094]: pgmap v253: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-25T09:18:16.519 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:17.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:17.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:17.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:17.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:17 smithi040 ceph-mon[33094]: Checking pool "mypool" exists for service nvmeof.mypool 2024-03-25T09:18:17.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:17.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:17 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:18:17.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:17 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/3286355962' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2024-03-25T09:18:17.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:17.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:17.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:17.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:17 smithi019 ceph-mon[29386]: Checking pool "mypool" exists for service nvmeof.mypool 2024-03-25T09:18:17.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:17.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:17 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:18:17.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:17 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/3286355962' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2024-03-25T09:18:18.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:18.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:18.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:18.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:17 smithi059 ceph-mon[32732]: Checking pool "mypool" exists for service nvmeof.mypool 2024-03-25T09:18:18.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:18.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:17 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:18:18.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:17 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/3286355962' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2024-03-25T09:18:18.848 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage14 --size 8192 2024-03-25T09:18:18.849 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage14 --size 8192 2024-03-25T09:18:19.248 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:18 smithi019 ceph-mon[29386]: pgmap v254: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 3 op/s 2024-03-25T09:18:19.248 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.248 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.249 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.249 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.249 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:18 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:18 smithi059 ceph-mon[32732]: pgmap v254: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 3 op/s 2024-03-25T09:18:19.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:18 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:18 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:18 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:18 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:18 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:18 smithi040 ceph-mon[33094]: pgmap v254: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 3 op/s 2024-03-25T09:18:19.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:18 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:18 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:18 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:18 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:19.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:18 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:20.042 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:20.473 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:20 smithi019 ceph-mon[29386]: mgrmap e15: x(active, since 6m) 2024-03-25T09:18:20.473 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:20 smithi019 ceph-mon[29386]: pgmap v255: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 682 B/s wr, 4 op/s 2024-03-25T09:18:20.664 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:20 smithi040 ceph-mon[33094]: mgrmap e15: x(active, since 6m) 2024-03-25T09:18:20.664 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:20 smithi040 ceph-mon[33094]: pgmap v255: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 682 B/s wr, 4 op/s 2024-03-25T09:18:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:20 smithi059 ceph-mon[32732]: mgrmap e15: x(active, since 6m) 2024-03-25T09:18:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:20 smithi059 ceph-mon[32732]: pgmap v255: 33 pgs: 33 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 682 B/s wr, 4 op/s 2024-03-25T09:18:22.213 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage15 --size 8192 2024-03-25T09:18:22.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage15 --size 8192 2024-03-25T09:18:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:23.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: pgmap v256: 33 pgs: 33 active+clean; 584 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 4 op/s 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi019"} : dispatch 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi040"} : dispatch 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi059"} : dispatch 2024-03-25T09:18:23.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:18:23.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:18:23.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:18:23.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:22 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: pgmap v256: 33 pgs: 33 active+clean; 584 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 4 op/s 2024-03-25T09:18:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:18:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi019"} : dispatch 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi040"} : dispatch 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi059"} : dispatch 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:18:23.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:18:23.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:22 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: pgmap v256: 33 pgs: 33 active+clean; 584 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 4 op/s 2024-03-25T09:18:23.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:18:23.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:18:23.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi019"} : dispatch 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi040"} : dispatch 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi059"} : dispatch 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:18:23.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:22 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:18:24.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:23 smithi019 ceph-mon[29386]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2024-03-25T09:18:24.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:23 smithi019 ceph-mon[29386]: Adding NVMeoF gateway 172.21.15.19:5500 to Dashboard 2024-03-25T09:18:24.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:23 smithi019 ceph-mon[29386]: Adding NVMeoF gateway 172.21.15.40:5500 to Dashboard 2024-03-25T09:18:24.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:23 smithi019 ceph-mon[29386]: Adding NVMeoF gateway 172.21.15.59:5500 to Dashboard 2024-03-25T09:18:24.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:23 smithi019 ceph-mon[29386]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi019"}]: dispatch 2024-03-25T09:18:24.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:23 smithi019 ceph-mon[29386]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi040"}]: dispatch 2024-03-25T09:18:24.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:23 smithi019 ceph-mon[29386]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi059"}]: dispatch 2024-03-25T09:18:24.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:23 smithi059 ceph-mon[32732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2024-03-25T09:18:24.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:23 smithi059 ceph-mon[32732]: Adding NVMeoF gateway 172.21.15.19:5500 to Dashboard 2024-03-25T09:18:24.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:23 smithi059 ceph-mon[32732]: Adding NVMeoF gateway 172.21.15.40:5500 to Dashboard 2024-03-25T09:18:24.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:23 smithi059 ceph-mon[32732]: Adding NVMeoF gateway 172.21.15.59:5500 to Dashboard 2024-03-25T09:18:24.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:23 smithi059 ceph-mon[32732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi019"}]: dispatch 2024-03-25T09:18:24.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:23 smithi059 ceph-mon[32732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi040"}]: dispatch 2024-03-25T09:18:24.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:23 smithi059 ceph-mon[32732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi059"}]: dispatch 2024-03-25T09:18:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:23 smithi040 ceph-mon[33094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2024-03-25T09:18:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:23 smithi040 ceph-mon[33094]: Adding NVMeoF gateway 172.21.15.19:5500 to Dashboard 2024-03-25T09:18:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:23 smithi040 ceph-mon[33094]: Adding NVMeoF gateway 172.21.15.40:5500 to Dashboard 2024-03-25T09:18:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:23 smithi040 ceph-mon[33094]: Adding NVMeoF gateway 172.21.15.59:5500 to Dashboard 2024-03-25T09:18:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:23 smithi040 ceph-mon[33094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi019"}]: dispatch 2024-03-25T09:18:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:23 smithi040 ceph-mon[33094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi040"}]: dispatch 2024-03-25T09:18:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:23 smithi040 ceph-mon[33094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi059"}]: dispatch 2024-03-25T09:18:24.634 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage16 --size 8192 2024-03-25T09:18:24.634 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage16 --size 8192 2024-03-25T09:18:24.874 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:25.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:24 smithi019 ceph-mon[29386]: pgmap v257: 33 pgs: 33 active+clean; 584 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 853 B/s wr, 4 op/s 2024-03-25T09:18:25.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:24 smithi059 ceph-mon[32732]: pgmap v257: 33 pgs: 33 active+clean; 584 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 853 B/s wr, 4 op/s 2024-03-25T09:18:25.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:24 smithi040 ceph-mon[33094]: pgmap v257: 33 pgs: 33 active+clean; 584 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 853 B/s wr, 4 op/s 2024-03-25T09:18:26.262 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:26 smithi019 ceph-mon[29386]: pgmap v258: 33 pgs: 33 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:18:26.377 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:26 smithi059 ceph-mon[32732]: pgmap v258: 33 pgs: 33 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:18:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:26 smithi040 ceph-mon[33094]: pgmap v258: 33 pgs: 33 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:18:27.157 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage17 --size 8192 2024-03-25T09:18:27.158 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage17 --size 8192 2024-03-25T09:18:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:28.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:28 smithi019 ceph-mon[29386]: pgmap v259: 33 pgs: 33 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:18:28.385 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:28 smithi059 ceph-mon[32732]: pgmap v259: 33 pgs: 33 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:18:28.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:28 smithi040 ceph-mon[33094]: pgmap v259: 33 pgs: 33 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:18:29.604 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage18 --size 8192 2024-03-25T09:18:29.605 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage18 --size 8192 2024-03-25T09:18:29.847 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:30.207 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:30 smithi019 ceph-mon[29386]: pgmap v260: 33 pgs: 33 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-03-25T09:18:30.393 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:30 smithi059 ceph-mon[32732]: pgmap v260: 33 pgs: 33 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-03-25T09:18:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:30 smithi040 ceph-mon[33094]: pgmap v260: 33 pgs: 33 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-03-25T09:18:32.045 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage19 --size 8192 2024-03-25T09:18:32.046 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage19 --size 8192 2024-03-25T09:18:32.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:32 smithi040 ceph-mon[33094]: pgmap v261: 33 pgs: 33 active+clean; 586 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:18:32.288 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:32.386 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:32 smithi019 ceph-mon[29386]: pgmap v261: 33 pgs: 33 active+clean; 586 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:18:32.401 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:32 smithi059 ceph-mon[32732]: pgmap v261: 33 pgs: 33 active+clean; 586 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:18:34.375 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:34 smithi019 ceph-mon[29386]: pgmap v262: 33 pgs: 33 active+clean; 586 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-25T09:18:34.403 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage20 --size 8192 2024-03-25T09:18:34.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage20 --size 8192 2024-03-25T09:18:34.409 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:34 smithi059 ceph-mon[32732]: pgmap v262: 33 pgs: 33 active+clean; 586 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-25T09:18:34.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:34 smithi040 ceph-mon[33094]: pgmap v262: 33 pgs: 33 active+clean; 586 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-25T09:18:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:36.150 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:36 smithi019 ceph-mon[29386]: pgmap v263: 33 pgs: 33 active+clean; 586 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:18:36.417 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:36 smithi059 ceph-mon[32732]: pgmap v263: 33 pgs: 33 active+clean; 586 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:18:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:36 smithi040 ceph-mon[33094]: pgmap v263: 33 pgs: 33 active+clean; 586 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:18:37.093 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage21 --size 8192 2024-03-25T09:18:37.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage21 --size 8192 2024-03-25T09:18:37.342 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:38.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:38 smithi019 ceph-mon[29386]: pgmap v264: 33 pgs: 33 active+clean; 587 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:18:38.425 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:38 smithi059 ceph-mon[32732]: pgmap v264: 33 pgs: 33 active+clean; 587 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:18:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:38 smithi040 ceph-mon[33094]: pgmap v264: 33 pgs: 33 active+clean; 587 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:18:39.482 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage22 --size 8192 2024-03-25T09:18:39.482 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage22 --size 8192 2024-03-25T09:18:39.738 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:40 smithi019 ceph-mon[29386]: pgmap v265: 33 pgs: 33 active+clean; 587 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:18:40.433 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:40 smithi059 ceph-mon[32732]: pgmap v265: 33 pgs: 33 active+clean; 587 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:18:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:40 smithi040 ceph-mon[33094]: pgmap v265: 33 pgs: 33 active+clean; 587 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:18:42.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:42 smithi019 ceph-mon[29386]: pgmap v266: 33 pgs: 33 active+clean; 588 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:18:42.441 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:42 smithi059 ceph-mon[32732]: pgmap v266: 33 pgs: 33 active+clean; 588 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:18:42.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:42 smithi040 ceph-mon[33094]: pgmap v266: 33 pgs: 33 active+clean; 588 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:18:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:44 smithi019 ceph-mon[29386]: pgmap v267: 33 pgs: 33 active+clean; 588 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-25T09:18:44.450 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:44 smithi059 ceph-mon[32732]: pgmap v267: 33 pgs: 33 active+clean; 588 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-25T09:18:44.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:44 smithi040 ceph-mon[33094]: pgmap v267: 33 pgs: 33 active+clean; 588 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-25T09:18:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:46 smithi019 ceph-mon[29386]: pgmap v268: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:18:46.457 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:46 smithi059 ceph-mon[32732]: pgmap v268: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:18:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:46 smithi040 ceph-mon[33094]: pgmap v268: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:18:47.012 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage23 --size 8192 2024-03-25T09:18:47.013 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage23 --size 8192 2024-03-25T09:18:47.255 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:48.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:48 smithi019 ceph-mon[29386]: pgmap v269: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-25T09:18:48.465 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:48 smithi059 ceph-mon[32732]: pgmap v269: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-25T09:18:48.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:48 smithi040 ceph-mon[33094]: pgmap v269: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-25T09:18:49.208 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage24 --size 8192 2024-03-25T09:18:49.208 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage24 --size 8192 2024-03-25T09:18:49.453 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:50.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:50 smithi019 ceph-mon[29386]: pgmap v270: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:18:50.473 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:50 smithi059 ceph-mon[32732]: pgmap v270: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:18:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:50 smithi040 ceph-mon[33094]: pgmap v270: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:18:51.464 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage25 --size 8192 2024-03-25T09:18:51.464 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage25 --size 8192 2024-03-25T09:18:51.706 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:52 smithi019 ceph-mon[29386]: pgmap v271: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-25T09:18:52.481 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:52 smithi059 ceph-mon[32732]: pgmap v271: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-25T09:18:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:52 smithi040 ceph-mon[33094]: pgmap v271: 33 pgs: 33 active+clean; 589 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-25T09:18:53.856 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage26 --size 8192 2024-03-25T09:18:53.856 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage26 --size 8192 2024-03-25T09:18:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:54.329 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:54 smithi019 ceph-mon[29386]: pgmap v272: 33 pgs: 33 active+clean; 590 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-25T09:18:54.489 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:54 smithi059 ceph-mon[32732]: pgmap v272: 33 pgs: 33 active+clean; 590 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-25T09:18:54.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:54 smithi040 ceph-mon[33094]: pgmap v272: 33 pgs: 33 active+clean; 590 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-25T09:18:56.203 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:56 smithi019 ceph-mon[29386]: pgmap v273: 33 pgs: 33 active+clean; 590 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:18:56.228 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage27 --size 8192 2024-03-25T09:18:56.228 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage27 --size 8192 2024-03-25T09:18:56.474 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:18:56.497 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:56 smithi059 ceph-mon[32732]: pgmap v273: 33 pgs: 33 active+clean; 590 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:18:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:56 smithi040 ceph-mon[33094]: pgmap v273: 33 pgs: 33 active+clean; 590 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:18:58.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:18:58 smithi019 ceph-mon[29386]: pgmap v274: 33 pgs: 33 active+clean; 591 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-25T09:18:58.505 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:18:58 smithi059 ceph-mon[32732]: pgmap v274: 33 pgs: 33 active+clean; 591 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-25T09:18:58.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:18:58 smithi040 ceph-mon[33094]: pgmap v274: 33 pgs: 33 active+clean; 591 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-25T09:18:58.616 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage28 --size 8192 2024-03-25T09:18:58.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage28 --size 8192 2024-03-25T09:18:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:00 smithi019 ceph-mon[29386]: pgmap v275: 33 pgs: 33 active+clean; 591 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:19:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:00 smithi059 ceph-mon[32732]: pgmap v275: 33 pgs: 33 active+clean; 591 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:19:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:00 smithi040 ceph-mon[33094]: pgmap v275: 33 pgs: 33 active+clean; 591 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:19:00.821 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage29 --size 8192 2024-03-25T09:19:00.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage29 --size 8192 2024-03-25T09:19:01.067 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:02.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:02 smithi019 ceph-mon[29386]: pgmap v276: 33 pgs: 33 active+clean; 592 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:02 smithi059 ceph-mon[32732]: pgmap v276: 33 pgs: 33 active+clean; 592 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:02 smithi040 ceph-mon[33094]: pgmap v276: 33 pgs: 33 active+clean; 592 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:03.261 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage30 --size 8192 2024-03-25T09:19:03.262 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage30 --size 8192 2024-03-25T09:19:03.504 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:04.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:04 smithi019 ceph-mon[29386]: pgmap v277: 33 pgs: 33 active+clean; 592 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-25T09:19:04.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:04 smithi059 ceph-mon[32732]: pgmap v277: 33 pgs: 33 active+clean; 592 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-25T09:19:04.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:04 smithi040 ceph-mon[33094]: pgmap v277: 33 pgs: 33 active+clean; 592 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-25T09:19:05.540 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage31 --size 8192 2024-03-25T09:19:05.541 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage31 --size 8192 2024-03-25T09:19:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:06.176 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:06 smithi019 ceph-mon[29386]: pgmap v278: 33 pgs: 33 active+clean; 592 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-25T09:19:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:06 smithi059 ceph-mon[32732]: pgmap v278: 33 pgs: 33 active+clean; 592 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-25T09:19:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:06 smithi040 ceph-mon[33094]: pgmap v278: 33 pgs: 33 active+clean; 592 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-25T09:19:08.004 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage32 --size 8192 2024-03-25T09:19:08.005 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage32 --size 8192 2024-03-25T09:19:08.251 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:08.373 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:08 smithi019 ceph-mon[29386]: pgmap v279: 33 pgs: 33 active+clean; 593 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:08 smithi059 ceph-mon[32732]: pgmap v279: 33 pgs: 33 active+clean; 593 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:08 smithi040 ceph-mon[33094]: pgmap v279: 33 pgs: 33 active+clean; 593 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:10.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:10 smithi019 ceph-mon[29386]: pgmap v280: 33 pgs: 33 active+clean; 593 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:19:10.404 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage33 --size 8192 2024-03-25T09:19:10.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage33 --size 8192 2024-03-25T09:19:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:10 smithi059 ceph-mon[32732]: pgmap v280: 33 pgs: 33 active+clean; 593 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:19:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:10 smithi040 ceph-mon[33094]: pgmap v280: 33 pgs: 33 active+clean; 593 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:19:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:12.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:12 smithi019 ceph-mon[29386]: pgmap v281: 33 pgs: 33 active+clean; 594 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:19:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:12 smithi059 ceph-mon[32732]: pgmap v281: 33 pgs: 33 active+clean; 594 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:19:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:12 smithi040 ceph-mon[33094]: pgmap v281: 33 pgs: 33 active+clean; 594 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:19:12.756 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage34 --size 8192 2024-03-25T09:19:12.757 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage34 --size 8192 2024-03-25T09:19:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:14.281 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:14 smithi019 ceph-mon[29386]: pgmap v282: 33 pgs: 33 active+clean; 594 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:19:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:14 smithi059 ceph-mon[32732]: pgmap v282: 33 pgs: 33 active+clean; 594 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:19:14.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:14 smithi040 ceph-mon[33094]: pgmap v282: 33 pgs: 33 active+clean; 594 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:19:15.086 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage35 --size 8192 2024-03-25T09:19:15.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage35 --size 8192 2024-03-25T09:19:15.331 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:16.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:16 smithi019 ceph-mon[29386]: pgmap v283: 33 pgs: 33 active+clean; 595 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-25T09:19:16.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:16 smithi059 ceph-mon[32732]: pgmap v283: 33 pgs: 33 active+clean; 595 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-25T09:19:16.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:16 smithi040 ceph-mon[33094]: pgmap v283: 33 pgs: 33 active+clean; 595 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-25T09:19:17.500 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage36 --size 8192 2024-03-25T09:19:17.500 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage36 --size 8192 2024-03-25T09:19:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:18.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:18 smithi019 ceph-mon[29386]: pgmap v284: 33 pgs: 33 active+clean; 595 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-25T09:19:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:18 smithi059 ceph-mon[32732]: pgmap v284: 33 pgs: 33 active+clean; 595 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-25T09:19:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:18 smithi040 ceph-mon[33094]: pgmap v284: 33 pgs: 33 active+clean; 595 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-25T09:19:19.654 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage37 --size 8192 2024-03-25T09:19:19.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage37 --size 8192 2024-03-25T09:19:19.899 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:20.323 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:20 smithi019 ceph-mon[29386]: pgmap v285: 33 pgs: 33 active+clean; 596 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:19:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:20 smithi059 ceph-mon[32732]: pgmap v285: 33 pgs: 33 active+clean; 596 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:19:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:20 smithi040 ceph-mon[33094]: pgmap v285: 33 pgs: 33 active+clean; 596 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:19:22.076 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:22 smithi019 ceph-mon[29386]: pgmap v286: 33 pgs: 33 active+clean; 596 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-03-25T09:19:22.104 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage38 --size 8192 2024-03-25T09:19:22.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage38 --size 8192 2024-03-25T09:19:22.356 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:22 smithi059 ceph-mon[32732]: pgmap v286: 33 pgs: 33 active+clean; 596 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-03-25T09:19:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:22 smithi040 ceph-mon[33094]: pgmap v286: 33 pgs: 33 active+clean; 596 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-03-25T09:19:23.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:23 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:19:23.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:23 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:19:23.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:23 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:19:24.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:19:24.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:19:24.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:19:24.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:24 smithi019 ceph-mon[29386]: pgmap v287: 33 pgs: 33 active+clean; 596 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-25T09:19:24.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:19:24.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:19:24.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:19:24.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:24 smithi059 ceph-mon[32732]: pgmap v287: 33 pgs: 33 active+clean; 596 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-25T09:19:24.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:19:24.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:19:24.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:19:24.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:24 smithi040 ceph-mon[33094]: pgmap v287: 33 pgs: 33 active+clean; 596 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-25T09:19:24.590 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage39 --size 8192 2024-03-25T09:19:24.590 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage39 --size 8192 2024-03-25T09:19:24.834 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:26.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:26 smithi019 ceph-mon[29386]: pgmap v288: 33 pgs: 33 active+clean; 597 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-25T09:19:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:26 smithi059 ceph-mon[32732]: pgmap v288: 33 pgs: 33 active+clean; 597 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-25T09:19:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:26 smithi040 ceph-mon[33094]: pgmap v288: 33 pgs: 33 active+clean; 597 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-25T09:19:27.020 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage40 --size 8192 2024-03-25T09:19:27.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage40 --size 8192 2024-03-25T09:19:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:28.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:28 smithi019 ceph-mon[29386]: pgmap v289: 33 pgs: 33 active+clean; 597 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-25T09:19:28.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:28 smithi059 ceph-mon[32732]: pgmap v289: 33 pgs: 33 active+clean; 597 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-25T09:19:28.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:28 smithi040 ceph-mon[33094]: pgmap v289: 33 pgs: 33 active+clean; 597 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-25T09:19:29.419 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage41 --size 8192 2024-03-25T09:19:29.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage41 --size 8192 2024-03-25T09:19:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:30.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:30 smithi019 ceph-mon[29386]: pgmap v290: 33 pgs: 33 active+clean; 598 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:30 smithi059 ceph-mon[32732]: pgmap v290: 33 pgs: 33 active+clean; 598 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:30 smithi040 ceph-mon[33094]: pgmap v290: 33 pgs: 33 active+clean; 598 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:31.888 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage42 --size 8192 2024-03-25T09:19:31.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage42 --size 8192 2024-03-25T09:19:32.138 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:32.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:32 smithi019 ceph-mon[29386]: pgmap v291: 33 pgs: 33 active+clean; 599 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:19:32.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:32 smithi059 ceph-mon[32732]: pgmap v291: 33 pgs: 33 active+clean; 599 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:19:32.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:32 smithi040 ceph-mon[33094]: pgmap v291: 33 pgs: 33 active+clean; 599 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:19:34.268 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:34 smithi019 ceph-mon[29386]: pgmap v292: 33 pgs: 33 active+clean; 599 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-25T09:19:34.294 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage43 --size 8192 2024-03-25T09:19:34.294 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage43 --size 8192 2024-03-25T09:19:34.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:34 smithi059 ceph-mon[32732]: pgmap v292: 33 pgs: 33 active+clean; 599 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-25T09:19:34.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:34 smithi040 ceph-mon[33094]: pgmap v292: 33 pgs: 33 active+clean; 599 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-25T09:19:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:36 smithi019 ceph-mon[29386]: pgmap v293: 33 pgs: 33 active+clean; 599 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:36 smithi059 ceph-mon[32732]: pgmap v293: 33 pgs: 33 active+clean; 599 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:36 smithi040 ceph-mon[33094]: pgmap v293: 33 pgs: 33 active+clean; 599 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:36.681 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage44 --size 8192 2024-03-25T09:19:36.681 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage44 --size 8192 2024-03-25T09:19:36.930 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:38.108 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:38 smithi019 ceph-mon[29386]: pgmap v294: 33 pgs: 33 active+clean; 600 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:19:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:38 smithi059 ceph-mon[32732]: pgmap v294: 33 pgs: 33 active+clean; 600 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:19:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:38 smithi040 ceph-mon[33094]: pgmap v294: 33 pgs: 33 active+clean; 600 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:19:39.145 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage45 --size 8192 2024-03-25T09:19:39.146 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage45 --size 8192 2024-03-25T09:19:39.395 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:40.327 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:40 smithi019 ceph-mon[29386]: pgmap v295: 33 pgs: 33 active+clean; 600 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:40 smithi059 ceph-mon[32732]: pgmap v295: 33 pgs: 33 active+clean; 600 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:40 smithi040 ceph-mon[33094]: pgmap v295: 33 pgs: 33 active+clean; 600 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:41.425 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage46 --size 8192 2024-03-25T09:19:41.425 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage46 --size 8192 2024-03-25T09:19:41.667 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:42.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:42 smithi019 ceph-mon[29386]: pgmap v296: 33 pgs: 33 active+clean; 601 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:19:42.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:42 smithi059 ceph-mon[32732]: pgmap v296: 33 pgs: 33 active+clean; 601 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:19:42.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:42 smithi040 ceph-mon[33094]: pgmap v296: 33 pgs: 33 active+clean; 601 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:19:43.756 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage47 --size 8192 2024-03-25T09:19:43.756 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage47 --size 8192 2024-03-25T09:19:44.002 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:44.315 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:44 smithi019 ceph-mon[29386]: pgmap v297: 33 pgs: 33 active+clean; 601 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-25T09:19:44.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:44 smithi059 ceph-mon[32732]: pgmap v297: 33 pgs: 33 active+clean; 601 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-25T09:19:44.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:44 smithi040 ceph-mon[33094]: pgmap v297: 33 pgs: 33 active+clean; 601 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-25T09:19:46.102 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage48 --size 8192 2024-03-25T09:19:46.103 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage48 --size 8192 2024-03-25T09:19:46.347 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:46 smithi019 ceph-mon[29386]: pgmap v298: 33 pgs: 33 active+clean; 602 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-25T09:19:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:46 smithi059 ceph-mon[32732]: pgmap v298: 33 pgs: 33 active+clean; 602 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-25T09:19:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:46 smithi040 ceph-mon[33094]: pgmap v298: 33 pgs: 33 active+clean; 602 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-25T09:19:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:48 smithi019 ceph-mon[29386]: pgmap v299: 33 pgs: 33 active+clean; 602 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:48.461 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage49 --size 8192 2024-03-25T09:19:48.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage49 --size 8192 2024-03-25T09:19:48.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:48 smithi059 ceph-mon[32732]: pgmap v299: 33 pgs: 33 active+clean; 602 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:48.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:48 smithi040 ceph-mon[33094]: pgmap v299: 33 pgs: 33 active+clean; 602 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:50.120 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:50 smithi019 ceph-mon[29386]: pgmap v300: 33 pgs: 33 active+clean; 603 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:19:50.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:50 smithi059 ceph-mon[32732]: pgmap v300: 33 pgs: 33 active+clean; 603 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:19:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:50 smithi040 ceph-mon[33094]: pgmap v300: 33 pgs: 33 active+clean; 603 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-25T09:19:51.030 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage50 --size 8192 2024-03-25T09:19:51.030 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage50 --size 8192 2024-03-25T09:19:51.276 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:52 smithi040 ceph-mon[33094]: pgmap v301: 33 pgs: 33 active+clean; 603 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-25T09:19:52.344 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:52 smithi019 ceph-mon[29386]: pgmap v301: 33 pgs: 33 active+clean; 603 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-25T09:19:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:52 smithi059 ceph-mon[32732]: pgmap v301: 33 pgs: 33 active+clean; 603 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-25T09:19:53.518 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage51 --size 8192 2024-03-25T09:19:53.518 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage51 --size 8192 2024-03-25T09:19:53.775 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:54.154 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:54 smithi019 ceph-mon[29386]: pgmap v302: 33 pgs: 33 active+clean; 603 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:19:54.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:54 smithi040 ceph-mon[33094]: pgmap v302: 33 pgs: 33 active+clean; 603 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:19:54.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:54 smithi059 ceph-mon[32732]: pgmap v302: 33 pgs: 33 active+clean; 603 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:19:55.974 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage52 --size 8192 2024-03-25T09:19:55.975 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage52 --size 8192 2024-03-25T09:19:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:19:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:56 smithi040 ceph-mon[33094]: pgmap v303: 33 pgs: 33 active+clean; 604 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-25T09:19:56.344 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:56 smithi019 ceph-mon[29386]: pgmap v303: 33 pgs: 33 active+clean; 604 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-25T09:19:56.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:56 smithi059 ceph-mon[32732]: pgmap v303: 33 pgs: 33 active+clean; 604 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-25T09:19:58.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:19:58 smithi040 ceph-mon[33094]: pgmap v304: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:58.346 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:19:58 smithi019 ceph-mon[29386]: pgmap v304: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:58.382 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage53 --size 8192 2024-03-25T09:19:58.382 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage53 --size 8192 2024-03-25T09:19:58.513 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:19:58 smithi059 ceph-mon[32732]: pgmap v304: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:19:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:20:00.097 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:00 smithi019 ceph-mon[29386]: pgmap v305: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-25T09:20:00.097 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:00 smithi019 ceph-mon[29386]: overall HEALTH_OK 2024-03-25T09:20:00.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:00 smithi040 ceph-mon[33094]: pgmap v305: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-25T09:20:00.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:00 smithi040 ceph-mon[33094]: overall HEALTH_OK 2024-03-25T09:20:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:00 smithi059 ceph-mon[32732]: pgmap v305: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-25T09:20:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:00 smithi059 ceph-mon[32732]: overall HEALTH_OK 2024-03-25T09:20:00.760 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage54 --size 8192 2024-03-25T09:20:00.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage54 --size 8192 2024-03-25T09:20:01.007 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:20:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:02 smithi040 ceph-mon[33094]: pgmap v306: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:20:02.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:02 smithi019 ceph-mon[29386]: pgmap v306: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:20:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:02 smithi059 ceph-mon[32732]: pgmap v306: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-25T09:20:03.098 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage55 --size 8192 2024-03-25T09:20:03.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage55 --size 8192 2024-03-25T09:20:03.350 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:20:04.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:04 smithi040 ceph-mon[33094]: pgmap v307: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-25T09:20:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:04 smithi019 ceph-mon[29386]: pgmap v307: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-25T09:20:04.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:04 smithi059 ceph-mon[32732]: pgmap v307: 33 pgs: 33 active+clean; 605 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-25T09:20:05.525 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage56 --size 8192 2024-03-25T09:20:05.526 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage56 --size 8192 2024-03-25T09:20:05.773 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:20:06.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:06 smithi019 ceph-mon[29386]: pgmap v308: 33 pgs: 33 active+clean; 606 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-25T09:20:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:06 smithi040 ceph-mon[33094]: pgmap v308: 33 pgs: 33 active+clean; 606 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-25T09:20:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:06 smithi059 ceph-mon[32732]: pgmap v308: 33 pgs: 33 active+clean; 606 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-25T09:20:08.065 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage57 --size 8192 2024-03-25T09:20:08.066 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage57 --size 8192 2024-03-25T09:20:08.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:08 smithi040 ceph-mon[33094]: pgmap v309: 33 pgs: 33 active+clean; 606 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:20:08.309 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:20:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:08 smithi019 ceph-mon[29386]: pgmap v309: 33 pgs: 33 active+clean; 606 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:20:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:08 smithi059 ceph-mon[32732]: pgmap v309: 33 pgs: 33 active+clean; 606 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-25T09:20:10.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:10 smithi040 ceph-mon[33094]: pgmap v310: 33 pgs: 33 active+clean; 607 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-03-25T09:20:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:10 smithi019 ceph-mon[29386]: pgmap v310: 33 pgs: 33 active+clean; 607 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-03-25T09:20:10.507 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage58 --size 8192 2024-03-25T09:20:10.508 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage58 --size 8192 2024-03-25T09:20:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:10 smithi059 ceph-mon[32732]: pgmap v310: 33 pgs: 33 active+clean; 607 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-03-25T09:20:10.759 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:20:12.241 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:12 smithi019 ceph-mon[29386]: pgmap v311: 33 pgs: 33 active+clean; 608 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-25T09:20:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:12 smithi040 ceph-mon[33094]: pgmap v311: 33 pgs: 33 active+clean; 608 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-25T09:20:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:12 smithi059 ceph-mon[32732]: pgmap v311: 33 pgs: 33 active+clean; 608 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-25T09:20:12.970 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage59 --size 8192 2024-03-25T09:20:12.970 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage59 --size 8192 2024-03-25T09:20:13.220 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:20:14.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:14 smithi040 ceph-mon[33094]: pgmap v312: 33 pgs: 33 active+clean; 608 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:20:14.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:14 smithi019 ceph-mon[29386]: pgmap v312: 33 pgs: 33 active+clean; 608 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:20:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:14 smithi059 ceph-mon[32732]: pgmap v312: 33 pgs: 33 active+clean; 608 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-25T09:20:15.270 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage60 --size 8192 2024-03-25T09:20:15.271 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- rbd create mypool/myimage60 --size 8192 2024-03-25T09:20:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:20:16.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:16 smithi019 ceph-mon[29386]: pgmap v313: 33 pgs: 33 active+clean; 608 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-25T09:20:16.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:16 smithi040 ceph-mon[33094]: pgmap v313: 33 pgs: 33 active+clean; 608 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-25T09:20:16.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:16 smithi059 ceph-mon[32732]: pgmap v313: 33 pgs: 33 active+clean; 608 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-25T09:20:17.721 DEBUG:teuthology.orchestra.run.smithi019:nvmeof.nvmeof.a> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.a.service 2024-03-25T09:20:17.723 DEBUG:teuthology.orchestra.run.smithi040:nvmeof.nvmeof.b> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.b.service 2024-03-25T09:20:17.726 DEBUG:teuthology.orchestra.run.smithi059:nvmeof.nvmeof.c> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.c.service 2024-03-25T09:20:17.728 INFO:tasks.nvmeof:[nvmeof]: executed deploy_nvmeof successfully! 2024-03-25T09:20:17.728 INFO:tasks.nvmeof:[nvmeof]: running set_gateway_cfg... 2024-03-25T09:20:17.729 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-25T09:20:17.729 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/nvmeof.env 2024-03-25T09:20:17.791 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-03-25T09:20:17.791 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/nvmeof.env 2024-03-25T09:20:17.818 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-25T09:20:17.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/nvmeof.env 2024-03-25T09:20:17.845 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:20:17.845 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/nvmeof.env 2024-03-25T09:20:17.879 INFO:tasks.nvmeof:[nvmeof]: executed set_gateway_cfg successfully! 2024-03-25T09:20:17.879 INFO:teuthology.run_tasks:Running task cephadm.wait_for_service... 2024-03-25T09:20:17.890 INFO:tasks.cephadm:Waiting for ceph service nvmeof.mypool to start (timeout 300)... 2024-03-25T09:20:17.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61da756e-ea87-11ee-95cd-87774f69a715 -- ceph orch ls -f json 2024-03-25T09:20:18.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:18.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:17] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/mon.a/config 2024-03-25T09:20:18.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:18 smithi019 ceph-mon[29386]: pgmap v314: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:20:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:18 smithi059 ceph-mon[32732]: pgmap v314: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:20:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:18 smithi040 ceph-mon[33094]: pgmap v314: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-25T09:20:19.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:18 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:19.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:18 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:18] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:19.365 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:19.365 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:19] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:19.791 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-25T09:20:19.791 INFO:teuthology.orchestra.run.smithi019.stdout:[{"events": ["2024-03-25T09:12:46.271614Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi019=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2024-03-25T09:12:44.573292Z", "last_refresh": "2024-03-25T09:18:21.877854Z", "running": 1, "size": 1}}, {"events": ["2024-03-25T09:12:36.780285Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["smithi019:172.21.15.19=a", "smithi040:172.21.15.40=b", "smithi059:172.21.15.59=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2024-03-25T09:12:18.239127Z", "last_refresh": "2024-03-25T09:18:18.254529Z", "running": 3, "size": 3}}, {"events": ["2024-03-25T09:18:16.575147Z service:nvmeof.mypool [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["smithi019=nvmeof.a", "smithi040=nvmeof.b", "smithi059=nvmeof.c"]}, "service_id": "mypool", "service_name": "nvmeof.mypool", "service_type": "nvmeof", "spec": {"client_cert": "./client.crt", "client_key": "./client.key", "conn_retries": 10, "max_controller_id": "65519", "min_controller_id": "1", "pool": "mypool", "port": 5500, "server_cert": "./server.crt", "server_key": "./server.key", "spdk_path": "/usr/local/bin/nvmf_tgt", "tgt_path": "/usr/local/bin/nvmf_tgt", "timeout": 60, "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp"}, "status": {"created": "2024-03-25T09:17:39.488455Z", "last_refresh": "2024-03-25T09:18:18.254871Z", "ports": [5500, 4420, 8009], "running": 3, "size": 3}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca", "last_refresh": "2024-03-25T09:18:18.254630Z", "running": 8, "size": 8}, "unmanaged": true}] 2024-03-25T09:20:20.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:20 smithi040 ceph-mon[33094]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:20:20.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:20 smithi040 ceph-mon[33094]: pgmap v315: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-25T09:20:20.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:20.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:19] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:20.349 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:20 smithi019 ceph-mon[29386]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:20:20.349 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:20 smithi019 ceph-mon[29386]: pgmap v315: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-25T09:20:20.413 INFO:tasks.cephadm:nvmeof.mypool has 3/3 2024-03-25T09:20:20.413 INFO:teuthology.run_tasks:Running task workunit... 2024-03-25T09:20:20.469 INFO:tasks.workunit:Pulling workunits from ref fb51d73931124de2f09457eaa7f1219e2aeb2c0d 2024-03-25T09:20:20.469 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-25T09:20:20.470 DEBUG:teuthology.orchestra.run.smithi129:> stat -- /home/ubuntu/cephtest/mnt.3 2024-03-25T09:20:20.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:20:20.488 INFO:teuthology.orchestra.run.smithi129.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-25T09:20:20.488 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -- /home/ubuntu/cephtest/mnt.3 2024-03-25T09:20:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:20 smithi059 ceph-mon[32732]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-25T09:20:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:20 smithi059 ceph-mon[32732]: pgmap v315: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-25T09:20:20.546 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.3 2024-03-25T09:20:20.546 DEBUG:teuthology.orchestra.run.smithi129:> cd -- /home/ubuntu/cephtest/mnt.3 && mkdir -- client.3 2024-03-25T09:20:20.604 INFO:tasks.workunit:timeout=3h 2024-03-25T09:20:20.604 INFO:tasks.workunit:cleanup=True 2024-03-25T09:20:20.605 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf /home/ubuntu/cephtest/clone.client.3 && git clone https://github.com/vallariag/ceph.git /home/ubuntu/cephtest/clone.client.3 && cd /home/ubuntu/cephtest/clone.client.3 && git checkout fb51d73931124de2f09457eaa7f1219e2aeb2c0d 2024-03-25T09:20:20.662 INFO:tasks.workunit.client.3.smithi129.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.3'... 2024-03-25T09:20:21.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:21.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:21] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:21.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:21.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:20] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:22 smithi040 ceph-mon[33094]: pgmap v316: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-25T09:20:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:21] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:22 smithi019 ceph-mon[29386]: pgmap v316: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-25T09:20:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:22 smithi059 ceph-mon[32732]: pgmap v316: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-25T09:20:23.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:23.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:22] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:23.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:23.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:23] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:24.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:23 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:20:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:23 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:20:24.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:24.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:23] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:24.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:23 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:20:25.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:24 smithi019 ceph-mon[29386]: pgmap v317: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-25T09:20:25.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:20:25.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:20:25.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:24 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:20:25.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:24 smithi059 ceph-mon[32732]: pgmap v317: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-25T09:20:25.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:20:25.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:20:25.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:24 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:20:25.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:24 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:25.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:24 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:24] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:25.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:24 smithi040 ceph-mon[33094]: pgmap v317: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-25T09:20:25.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:20:25.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:20:25.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:24 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:20:25.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:25.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:25] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:26.251 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:26.251 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:25] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:26 smithi059 ceph-mon[32732]: pgmap v318: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-03-25T09:20:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:26 smithi040 ceph-mon[33094]: pgmap v318: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-03-25T09:20:26.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:26 smithi019 ceph-mon[29386]: pgmap v318: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-03-25T09:20:27.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:27.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:26] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:27.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:27.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:27] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:28.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:28 smithi040 ceph-mon[33094]: pgmap v319: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-25T09:20:28.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:28.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:27] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:28.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:28 smithi019 ceph-mon[29386]: pgmap v319: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-25T09:20:28.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:28 smithi059 ceph-mon[32732]: pgmap v319: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-25T09:20:29.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:28 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:29.421 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:28 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:28] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:29.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:29.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:29] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:30.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:30 smithi040 ceph-mon[33094]: pgmap v320: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-03-25T09:20:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:29] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:30.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:30 smithi019 ceph-mon[29386]: pgmap v320: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-03-25T09:20:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:30 smithi059 ceph-mon[32732]: pgmap v320: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-03-25T09:20:31.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:30 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:31.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:30 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:30] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:31.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:31.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:31] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:32.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:32 smithi040 ceph-mon[33094]: pgmap v321: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-25T09:20:32.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:32.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:31] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:32.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:32 smithi019 ceph-mon[29386]: pgmap v321: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-25T09:20:32.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:32 smithi059 ceph-mon[32732]: pgmap v321: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-25T09:20:33.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:33.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:32] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:33.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:33.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:33] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:34.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:34 smithi040 ceph-mon[33094]: pgmap v322: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:33] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:34.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:34 smithi019 ceph-mon[29386]: pgmap v322: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:34.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:34 smithi059 ceph-mon[32732]: pgmap v322: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:35.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:35.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:34] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:35.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:35.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:35] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:36 smithi040 ceph-mon[33094]: pgmap v323: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:36.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:36.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:35] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:36.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:36 smithi019 ceph-mon[29386]: pgmap v323: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:36 smithi059 ceph-mon[32732]: pgmap v323: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:37.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:37.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:36] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:37.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:37.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:37] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:38.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:38 smithi040 ceph-mon[33094]: pgmap v324: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:38.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:38.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:37] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:38.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:38 smithi019 ceph-mon[29386]: pgmap v324: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:38 smithi059 ceph-mon[32732]: pgmap v324: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:39.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:39.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:38] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:39.629 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:39.629 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:39] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:40.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:40 smithi040 ceph-mon[33094]: pgmap v325: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:39] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:40 smithi019 ceph-mon[29386]: pgmap v325: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:40 smithi059 ceph-mon[32732]: pgmap v325: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:41.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:40 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:41.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:40 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:40] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:41.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:41.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:41] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:42 smithi040 ceph-mon[33094]: pgmap v326: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:42.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:42.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:42] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:42.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:42 smithi019 ceph-mon[29386]: pgmap v326: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:42.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:42 smithi059 ceph-mon[32732]: pgmap v326: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:42] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:43.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:43.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:43] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:44 smithi040 ceph-mon[33094]: pgmap v327: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:44.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:44.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:44] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:44 smithi019 ceph-mon[29386]: pgmap v327: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:44.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:44 smithi059 ceph-mon[32732]: pgmap v327: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:45.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:45.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:44] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:45.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:45.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:45] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:46 smithi019 ceph-mon[29386]: pgmap v328: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:46 smithi059 ceph-mon[32732]: pgmap v328: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:46 smithi040 ceph-mon[33094]: pgmap v328: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:46.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:46.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:46] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:47.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:47.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:46] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:47.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:47.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:47] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:48 smithi019 ceph-mon[29386]: pgmap v329: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:48.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:48 smithi059 ceph-mon[32732]: pgmap v329: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:48.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:48 smithi040 ceph-mon[33094]: pgmap v329: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:48.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:48.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:48] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:49.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:48 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:49.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:48 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:48] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:49.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:49.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:49] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:50.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:50 smithi040 ceph-mon[33094]: pgmap v330: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:50.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:50.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:50] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:50.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:50 smithi019 ceph-mon[29386]: pgmap v330: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:50.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:50 smithi059 ceph-mon[32732]: pgmap v330: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:51.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:50 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:51.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:50 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:50] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:51.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:51.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:51] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:52 smithi019 ceph-mon[29386]: pgmap v331: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:52 smithi059 ceph-mon[32732]: pgmap v331: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:52 smithi040 ceph-mon[33094]: pgmap v331: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:52.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:52.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:52] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:53.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:53.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:52] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:53.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:53.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:53] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:54 smithi019 ceph-mon[29386]: pgmap v332: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:54.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:54 smithi059 ceph-mon[32732]: pgmap v332: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:54.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:54 smithi040 ceph-mon[33094]: pgmap v332: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:54.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:54.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:54] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:55.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:55.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:54] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:55.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:55.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:55] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:56.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:56 smithi019 ceph-mon[29386]: pgmap v333: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:56.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:56 smithi059 ceph-mon[32732]: pgmap v333: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:56 smithi040 ceph-mon[33094]: pgmap v333: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:20:56.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:56.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:56] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:57.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:57.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:56] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:57.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:57.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:57] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:58.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:20:58 smithi019 ceph-mon[29386]: pgmap v334: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:58.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:20:58 smithi059 ceph-mon[32732]: pgmap v334: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:58.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:20:58 smithi040 ceph-mon[33094]: pgmap v334: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:20:58.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:58.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:20:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:20:58] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:58.716 INFO:tasks.workunit.client.3.smithi129.stderr:Note: switching to 'fb51d73931124de2f09457eaa7f1219e2aeb2c0d'. 2024-03-25T09:20:58.716 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:20:58.716 INFO:tasks.workunit.client.3.smithi129.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-25T09:20:58.716 INFO:tasks.workunit.client.3.smithi129.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-25T09:20:58.716 INFO:tasks.workunit.client.3.smithi129.stderr:state without impacting any branches by switching back to a branch. 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr: git switch -c 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr:Or undo this operation with: 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr: git switch - 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:20:58.717 INFO:tasks.workunit.client.3.smithi129.stderr:HEAD is now at fb51d739311 thrasher: convert contextmanager func task to 'Task' subclass 2024-03-25T09:20:58.720 DEBUG:teuthology.orchestra.run.smithi129:> cd -- /home/ubuntu/cephtest/clone.client.3/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.3 2024-03-25T09:20:58.782 INFO:tasks.workunit.client.3.smithi129.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-25T09:20:58.784 INFO:tasks.workunit.client.3.smithi129.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2024-03-25T09:20:58.784 INFO:tasks.workunit.client.3.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-25T09:20:59.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:59.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:20:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:20:58] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:59.524 INFO:tasks.workunit.client.3.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-25T09:20:59.605 INFO:tasks.workunit.client.3.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-25T09:20:59.646 INFO:tasks.workunit.client.3.smithi129.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2024-03-25T09:20:59.647 INFO:tasks.workunit.client.3.smithi129.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2024-03-25T09:20:59.647 INFO:tasks.workunit.client.3.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-25T09:20:59.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:20:59.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:20:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:20:59] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:20:59.687 INFO:tasks.workunit.client.3.smithi129.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2024-03-25T09:20:59.693 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:20:59.693 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/home/ubuntu/cephtest/workunits.list.client.3 of=/dev/stdout 2024-03-25T09:20:59.747 INFO:tasks.workunit:Running workunits matching rbd/nvmeof_setup_subsystem.sh on client.3... 2024-03-25T09:20:59.748 INFO:tasks.workunit:Running workunit rbd/nvmeof_setup_subsystem.sh... 2024-03-25T09:20:59.748 DEBUG:teuthology.orchestra.run.smithi129:workunit test rbd/nvmeof_setup_subsystem.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fb51d73931124de2f09457eaa7f1219e2aeb2c0d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 RBD_IMAGE_PREFIX=myimage RBD_POOL=mypool timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/rbd/nvmeof_setup_subsystem.sh 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:+ source /etc/ceph/nvmeof.env 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_GATEWAY_IP_ADDRESSES=172.21.15.19,172.21.15.40,172.21.15.59 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_GATEWAY_NAMES=nvmeof.nvmeof.a,nvmeof.nvmeof.b,nvmeof.nvmeof.c 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_DEFAULT_GATEWAY_IP_ADDRESS=172.21.15.19 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_CLI_IMAGE=quay.io/ceph/nvmeof-cli:1.1.0 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_SUBSYSTEMS_PREFIX=nqn.2016-06.io.spdk:cnode 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_SUBSYSTEMS_COUNT=3 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_NAMESPACES_COUNT=20 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_PORT=4420 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_SRPORT=5500 2024-03-25T09:20:59.804 INFO:tasks.workunit.client.3.smithi129.stderr:+ RBD_POOL=mypool 2024-03-25T09:20:59.805 INFO:tasks.workunit.client.3.smithi129.stderr:+ RBD_IMAGE_PREFIX=myimage 2024-03-25T09:20:59.805 INFO:tasks.workunit.client.3.smithi129.stderr:++ hostname 2024-03-25T09:20:59.805 INFO:tasks.workunit.client.3.smithi129.stderr:+ HOSTNAME=smithi129 2024-03-25T09:20:59.805 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman images 2024-03-25T09:20:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:REPOSITORY TAG IMAGE ID CREATED SIZE 2024-03-25T09:20:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph 47ea673ae9ebf51b2ebc505093bd7272422045e4 57d5a95370c2 13 days ago 1.32 GB 2024-03-25T09:20:59.840 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman ps 2024-03-25T09:20:59.872 INFO:tasks.workunit.client.3.smithi129.stdout:CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2024-03-25T09:20:59.875 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 --format json subsystem list 2024-03-25T09:20:59.906 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:20:59Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:20:59.983 INFO:tasks.workunit.client.3.smithi129.stderr:Trying to pull quay.io/ceph/nvmeof-cli:1.1.0... 2024-03-25T09:21:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:00 smithi019 ceph-mon[29386]: pgmap v335: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:00 smithi059 ceph-mon[32732]: pgmap v335: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:00 smithi040 ceph-mon[33094]: pgmap v335: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:00.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:00.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:00] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:00.520 INFO:tasks.workunit.client.3.smithi129.stderr:Getting image source signatures 2024-03-25T09:21:00.520 INFO:tasks.workunit.client.3.smithi129.stderr:Copying blob sha256:3fe2db45efbf64a6563d1fc66d988237ce4c513398a676de4af24a3575700901 2024-03-25T09:21:00.520 INFO:tasks.workunit.client.3.smithi129.stderr:Copying blob sha256:99a7ec374c4d4af5f9b9ad281068affa7961aad432aba4efc963785a5a350f8d 2024-03-25T09:21:00.520 INFO:tasks.workunit.client.3.smithi129.stderr:Copying blob sha256:9f1f681330db1bda691335b8a99850905f3f45e4138f1bc22963e5e092a0b734 2024-03-25T09:21:00.520 INFO:tasks.workunit.client.3.smithi129.stderr:Copying blob sha256:21a02085b7c27c1b4a3560f376ddc420e9e2d03a9b77dc2523a7bc830d7f7568 2024-03-25T09:21:01.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:01.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:01] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:01.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:01.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:01] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:02.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:02 smithi019 ceph-mon[29386]: pgmap v336: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:02 smithi059 ceph-mon[32732]: pgmap v336: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:02 smithi040 ceph-mon[33094]: pgmap v336: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:02.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:02.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:02] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:03.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:03.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:03] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:03.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:03.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:03] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:04 smithi019 ceph-mon[29386]: pgmap v337: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:04.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:04 smithi059 ceph-mon[32732]: pgmap v337: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:04.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:04 smithi040 ceph-mon[33094]: pgmap v337: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:04.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:04.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:04] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:05.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:05.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:05] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:05.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:05.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:05] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:06.397 INFO:tasks.workunit.client.3.smithi129.stderr:Copying config sha256:8565e0c679b30770d7729f67dfb6f9e8a41758bba584d8b7bd6b4cdfec4259b1 2024-03-25T09:21:06.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:06 smithi019 ceph-mon[29386]: pgmap v338: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:06 smithi059 ceph-mon[32732]: pgmap v338: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:06 smithi040 ceph-mon[33094]: pgmap v338: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:06.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:06.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:06] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:06.544 INFO:tasks.workunit.client.3.smithi129.stderr:Writing manifest to image destination 2024-03-25T09:21:07.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:07.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:07] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:07.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:07.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:07] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:07.921 INFO:tasks.workunit.client.3.smithi129.stdout:{ 2024-03-25T09:21:07.921 INFO:tasks.workunit.client.3.smithi129.stdout: "error_message": "Success", 2024-03-25T09:21:07.921 INFO:tasks.workunit.client.3.smithi129.stdout: "status": 0, 2024-03-25T09:21:07.921 INFO:tasks.workunit.client.3.smithi129.stdout: "subsystems": [] 2024-03-25T09:21:07.921 INFO:tasks.workunit.client.3.smithi129.stdout:} 2024-03-25T09:21:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:08 smithi019 ceph-mon[29386]: pgmap v339: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:08.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:07] INFO grpc.py:2200: Received request to list the subsystem, context: 2024-03-25T09:21:08.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:07] INFO grpc.py:2208: list_subsystems: [] 2024-03-25T09:21:08.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:08 smithi059 ceph-mon[32732]: pgmap v339: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:08.515 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:08 smithi040 ceph-mon[33094]: pgmap v339: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:08.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:08.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:08] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:09.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:09.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:09] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:09.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:09.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:09] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:10.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:10 smithi019 ceph-mon[29386]: pgmap v340: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:10 smithi059 ceph-mon[32732]: pgmap v340: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:10 smithi040 ceph-mon[33094]: pgmap v340: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:10] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:11.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:11.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:11] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:11.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:11.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:11] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:12.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:12 smithi019 ceph-mon[29386]: pgmap v341: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:12 smithi059 ceph-mon[32732]: pgmap v341: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:12 smithi040 ceph-mon[33094]: pgmap v341: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:12.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:12.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:12] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:12.730 INFO:tasks.workunit.client.3.smithi129.stderr:+ IFS=, 2024-03-25T09:21:12.730 INFO:tasks.workunit.client.3.smithi129.stderr:+ read -ra gateway_ips 2024-03-25T09:21:12.730 INFO:tasks.workunit.client.3.smithi129.stderr:+ IFS=, 2024-03-25T09:21:12.730 INFO:tasks.workunit.client.3.smithi129.stderr:+ read -ra gateway_names 2024-03-25T09:21:12.731 INFO:tasks.workunit.client.3.smithi129.stderr:++ echo 172.21.15.19,172.21.15.40,172.21.15.59 2024-03-25T09:21:12.731 INFO:tasks.workunit.client.3.smithi129.stderr:++ tr -cd , 2024-03-25T09:21:12.731 INFO:tasks.workunit.client.3.smithi129.stderr:++ wc -c 2024-03-25T09:21:12.738 INFO:tasks.workunit.client.3.smithi129.stderr:+ gateways_count=3 2024-03-25T09:21:12.738 INFO:tasks.workunit.client.3.smithi129.stderr:+ list_subsystems 2024-03-25T09:21:12.738 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:21:12.739 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.19 2024-03-25T09:21:12.739 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 --format json subsystem list 2024-03-25T09:21:12.807 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:12Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:13.505 INFO:tasks.workunit.client.3.smithi129.stdout:{ 2024-03-25T09:21:13.505 INFO:tasks.workunit.client.3.smithi129.stdout: "error_message": "Success", 2024-03-25T09:21:13.505 INFO:tasks.workunit.client.3.smithi129.stdout: "status": 0, 2024-03-25T09:21:13.505 INFO:tasks.workunit.client.3.smithi129.stdout: "subsystems": [] 2024-03-25T09:21:13.505 INFO:tasks.workunit.client.3.smithi129.stdout:} 2024-03-25T09:21:13.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:13.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:13] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:13.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:13.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:13] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:13.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:13] INFO grpc.py:2200: Received request to list the subsystem, context: 2024-03-25T09:21:13.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:13] INFO grpc.py:2208: list_subsystems: [] 2024-03-25T09:21:14.388 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:21:14.388 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.40 2024-03-25T09:21:14.388 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.40 --server-port 5500 --format json subsystem list 2024-03-25T09:21:14.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:14 smithi019 ceph-mon[29386]: pgmap v342: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:14 smithi059 ceph-mon[32732]: pgmap v342: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:14.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:14 smithi040 ceph-mon[33094]: pgmap v342: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:14.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:14.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:14] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:14.893 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:14Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:15.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:15.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:15] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:15.546 INFO:tasks.workunit.client.3.smithi129.stdout:{ 2024-03-25T09:21:15.546 INFO:tasks.workunit.client.3.smithi129.stdout: "error_message": "Success", 2024-03-25T09:21:15.546 INFO:tasks.workunit.client.3.smithi129.stdout: "status": 0, 2024-03-25T09:21:15.546 INFO:tasks.workunit.client.3.smithi129.stdout: "subsystems": [] 2024-03-25T09:21:15.546 INFO:tasks.workunit.client.3.smithi129.stdout:} 2024-03-25T09:21:15.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:15.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:15] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:16.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:15] INFO grpc.py:2200: Received request to list the subsystem, context: 2024-03-25T09:21:16.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:15] INFO grpc.py:2208: list_subsystems: [] 2024-03-25T09:21:16.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:16 smithi019 ceph-mon[29386]: pgmap v343: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:16.505 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:21:16.505 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.59 2024-03-25T09:21:16.505 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.59 --server-port 5500 --format json subsystem list 2024-03-25T09:21:16.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:16 smithi059 ceph-mon[32732]: pgmap v343: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:16.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:16 smithi040 ceph-mon[33094]: pgmap v343: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-25T09:21:16.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:16.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:16] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:16.602 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:16Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:17.308 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:17.309 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:17] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:17.309 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:17] INFO grpc.py:2200: Received request to list the subsystem, context: 2024-03-25T09:21:17.313 INFO:tasks.workunit.client.3.smithi129.stdout:{ 2024-03-25T09:21:17.313 INFO:tasks.workunit.client.3.smithi129.stdout: "error_message": "Success", 2024-03-25T09:21:17.314 INFO:tasks.workunit.client.3.smithi129.stdout: "status": 0, 2024-03-25T09:21:17.314 INFO:tasks.workunit.client.3.smithi129.stdout: "subsystems": [] 2024-03-25T09:21:17.314 INFO:tasks.workunit.client.3.smithi129.stdout:} 2024-03-25T09:21:17.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:17] INFO grpc.py:2208: list_subsystems: [] 2024-03-25T09:21:17.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:17.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:17] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:18.174 INFO:tasks.workunit.client.3.smithi129.stderr:++ seq 1 3 2024-03-25T09:21:18.178 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:18.178 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-25T09:21:18.178 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode1 --enable-ha 2024-03-25T09:21:18.258 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:18Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:18.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:18 smithi019 ceph-mon[29386]: pgmap v344: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:18 smithi059 ceph-mon[32732]: pgmap v344: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:18 smithi040 ceph-mon[33094]: pgmap v344: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-25T09:21:18.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:18.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:18] INFO grpc.py:2248: get_subsystems: [] 2024-03-25T09:21:19.017 INFO:tasks.workunit.client.3.smithi129.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode1: Successful 2024-03-25T09:21:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:19] INFO grpc.py:460: Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, context: 2024-03-25T09:21:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:19] INFO grpc.py:489: No serial number specified for nqn.2016-06.io.spdk:cnode1, will use Ceph48566432277082 2024-03-25T09:21:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:19] INFO grpc.py:520: create_subsystem nqn.2016-06.io.spdk:cnode1: True 2024-03-25T09:21:19.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:19] INFO grpc.py:460: Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, context: None 2024-03-25T09:21:19.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:19] INFO grpc.py:520: create_subsystem nqn.2016-06.io.spdk:cnode1: True 2024-03-25T09:21:19.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:19.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:19.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:19] INFO grpc.py:460: Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, context: None 2024-03-25T09:21:19.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:19] INFO grpc.py:520: create_subsystem nqn.2016-06.io.spdk:cnode1: True 2024-03-25T09:21:19.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:19.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:19.752 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:19.752 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-25T09:21:19.752 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode2 --enable-ha 2024-03-25T09:21:19.844 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:19Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:20.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-mon[29386]: pgmap v345: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-03-25T09:21:20.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:20] INFO grpc.py:765: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 1 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 2 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 3 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: OPTIMIZED 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 4 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 5 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 6 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 7 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 8 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 9 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 10 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 11 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 12 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 13 2024-03-25T09:21:20.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 14 2024-03-25T09:21:20.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 15 2024-03-25T09:21:20.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:21:20.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 16 2024-03-25T09:21:20.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:21:20.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:21:20.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: ] 2024-03-25T09:21:20.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:20] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:21:20.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:20] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode1' prefix='listener_nqn.2016-06.io.spdk:cnode1_client.nvmeof.nvmeof.a_' listener_keys=[] 2024-03-25T09:21:20.416 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:20 smithi040 ceph-mon[33094]: pgmap v345: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-03-25T09:21:20.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:20.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:20 smithi059 ceph-mon[32732]: pgmap v345: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-03-25T09:21:20.590 INFO:tasks.workunit.client.3.smithi129.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode2: Successful 2024-03-25T09:21:20.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:20] INFO grpc.py:460: Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, context: None 2024-03-25T09:21:20.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:20] INFO grpc.py:520: create_subsystem nqn.2016-06.io.spdk:cnode2: True 2024-03-25T09:21:20.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:20] INFO grpc.py:460: Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, context: 2024-03-25T09:21:20.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:20] INFO grpc.py:489: No serial number specified for nqn.2016-06.io.spdk:cnode2, will use Ceph21611557036653 2024-03-25T09:21:20.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:20] INFO grpc.py:520: create_subsystem nqn.2016-06.io.spdk:cnode2: True 2024-03-25T09:21:21.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:20] INFO grpc.py:460: Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, context: None 2024-03-25T09:21:21.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:20] INFO grpc.py:520: create_subsystem nqn.2016-06.io.spdk:cnode2: True 2024-03-25T09:21:21.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:21.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:21.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:21] INFO grpc.py:765: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 1 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: OPTIMIZED 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 2 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 3 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 4 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 5 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 6 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 7 2024-03-25T09:21:21.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 8 2024-03-25T09:21:21.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 9 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 10 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 11 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 12 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 13 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 14 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 15 2024-03-25T09:21:21.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:21.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 16 2024-03-25T09:21:21.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:21.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:21.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: ] 2024-03-25T09:21:21.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:21] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:21:21.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:21] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode1' prefix='listener_nqn.2016-06.io.spdk:cnode1_client.nvmeof.nvmeof.c_' listener_keys=[] 2024-03-25T09:21:21.536 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:21.536 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-25T09:21:21.536 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode3 --enable-ha 2024-03-25T09:21:21.624 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:21Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:21.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:21.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:22.306 INFO:tasks.workunit.client.3.smithi129.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode3: Successful 2024-03-25T09:21:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:22 smithi019 ceph-mon[29386]: pgmap v346: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-03-25T09:21:22.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:22] INFO grpc.py:460: Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, context: 2024-03-25T09:21:22.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:22] INFO grpc.py:489: No serial number specified for nqn.2016-06.io.spdk:cnode3, will use Ceph70543347611932 2024-03-25T09:21:22.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:22] INFO grpc.py:520: create_subsystem nqn.2016-06.io.spdk:cnode3: True 2024-03-25T09:21:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-mon[32732]: pgmap v346: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-03-25T09:21:22.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:22] INFO grpc.py:460: Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, context: None 2024-03-25T09:21:22.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:22] INFO grpc.py:520: create_subsystem nqn.2016-06.io.spdk:cnode3: True 2024-03-25T09:21:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-mon[33094]: pgmap v346: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-03-25T09:21:22.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:22] INFO grpc.py:765: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 1 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 2 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: OPTIMIZED 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 3 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 4 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 5 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 6 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 7 2024-03-25T09:21:22.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 8 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 9 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 10 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 11 2024-03-25T09:21:22.517 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 12 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 13 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 14 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.518 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 15 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 16 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: ] 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:22] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:22] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode1' prefix='listener_nqn.2016-06.io.spdk:cnode1_client.nvmeof.nvmeof.b_' listener_keys=[] 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:22] INFO grpc.py:460: Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, context: None 2024-03-25T09:21:22.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:22] INFO grpc.py:520: create_subsystem nqn.2016-06.io.spdk:cnode3: True 2024-03-25T09:21:23.079 INFO:tasks.workunit.client.3.smithi129.stderr:+ list_subsystems 2024-03-25T09:21:23.079 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:21:23.080 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.19 2024-03-25T09:21:23.080 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 --format json subsystem list 2024-03-25T09:21:23.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:22] INFO grpc.py:765: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:23.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 1 2024-03-25T09:21:23.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: OPTIMIZED 2024-03-25T09:21:23.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 2 2024-03-25T09:21:23.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 3 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 4 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 5 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 6 2024-03-25T09:21:23.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 7 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 8 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 9 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 10 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 11 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 12 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 13 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 14 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 15 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 16 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:21:23.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:21:23.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: ] 2024-03-25T09:21:23.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:22] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:21:23.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:22] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode2' prefix='listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.c_' listener_keys=[] 2024-03-25T09:21:23.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:23.167 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:23Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:23.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:23.870 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:23.870 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:23.870 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:23] INFO grpc.py:2200: Received request to list the subsystem, context: 2024-03-25T09:21:23.878 INFO:tasks.workunit.client.3.smithi129.stdout:{ 2024-03-25T09:21:23.878 INFO:tasks.workunit.client.3.smithi129.stdout: "error_message": "Success", 2024-03-25T09:21:23.878 INFO:tasks.workunit.client.3.smithi129.stdout: "subsystems": [ 2024-03-25T09:21:23.878 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:21:23.878 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-25T09:21:23.878 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:21:23.878 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph48566432277082", 2024-03-25T09:21:23.878 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:21:23.878 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 4081, 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 6120, 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256, 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 0 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph21611557036653", 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 4081, 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 6120, 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256, 2024-03-25T09:21:23.879 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 0 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph70543347611932", 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 4081, 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 6120, 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256, 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 0 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: } 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: ], 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout: "status": 0 2024-03-25T09:21:23.880 INFO:tasks.workunit.client.3.smithi129.stdout:} 2024-03-25T09:21:24.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:24 smithi019 ceph-mon[29386]: pgmap v347: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-03-25T09:21:24.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:23] INFO grpc.py:2208: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:24.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:23] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:21:24.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:23] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:21:24.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:23] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:21:24.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:24 smithi059 ceph-mon[32732]: pgmap v347: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-03-25T09:21:24.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:24 smithi040 ceph-mon[33094]: pgmap v347: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-03-25T09:21:24.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:24.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:24.731 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:21:24.732 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.40 2024-03-25T09:21:24.732 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.40 --server-port 5500 --format json subsystem list 2024-03-25T09:21:24.833 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:24Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:25.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:25 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:21:25.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:25 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:21:25.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:25.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:25.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:25 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout:{ 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: "error_message": "Success", 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: "subsystems": [ 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph48566432277082", 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 2041, 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 4080, 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:21:25.568 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256, 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 0 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph21611557036653", 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 2041, 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 4080, 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256, 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 0 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-25T09:21:25.569 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph70543347611932", 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 2041, 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 4080, 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256, 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 0 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout: } 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout: ], 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout: "status": 0 2024-03-25T09:21:25.570 INFO:tasks.workunit.client.3.smithi129.stdout:} 2024-03-25T09:21:25.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:25.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:26.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:25] INFO grpc.py:2200: Received request to list the subsystem, context: 2024-03-25T09:21:26.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:25] INFO grpc.py:2208: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:26.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:25] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:21:26.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:25] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:21:26.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:25] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:21:26.407 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:21:26.407 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.59 2024-03-25T09:21:26.407 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.59 --server-port 5500 --format json subsystem list 2024-03-25T09:21:26.495 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:26 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:21:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:26 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:21:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:26 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:21:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:26 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:21:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:26 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:21:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:26 smithi059 ceph-mon[32732]: pgmap v348: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-25T09:21:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:26 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:21:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:26 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:21:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:26 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:21:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:26 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:21:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:26 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:21:26.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:26 smithi040 ceph-mon[33094]: pgmap v348: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-25T09:21:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:26.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:26 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:21:26.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:26 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:21:26.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:26 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:21:26.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:26 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:21:26.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:26 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:21:26.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:26 smithi019 ceph-mon[29386]: pgmap v348: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-25T09:21:27.279 INFO:tasks.workunit.client.3.smithi129.stdout:{ 2024-03-25T09:21:27.279 INFO:tasks.workunit.client.3.smithi129.stdout: "error_message": "Success", 2024-03-25T09:21:27.279 INFO:tasks.workunit.client.3.smithi129.stdout: "subsystems": [ 2024-03-25T09:21:27.279 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:21:27.279 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-25T09:21:27.279 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:21:27.279 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph48566432277082", 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 1, 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 2040, 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256, 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 0 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph21611557036653", 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 1, 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 2040, 2024-03-25T09:21:27.280 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256, 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 0 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph70543347611932", 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 1, 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 2040, 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256, 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 0 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: } 2024-03-25T09:21:27.281 INFO:tasks.workunit.client.3.smithi129.stdout: ], 2024-03-25T09:21:27.282 INFO:tasks.workunit.client.3.smithi129.stdout: "status": 0 2024-03-25T09:21:27.282 INFO:tasks.workunit.client.3.smithi129.stdout:} 2024-03-25T09:21:27.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:27.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:27.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:27] INFO grpc.py:2200: Received request to list the subsystem, context: 2024-03-25T09:21:27.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:27] INFO grpc.py:2208: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:27.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:27] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:21:27.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:27] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:21:27.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:27] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:21:27.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:27.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:28.133 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:21:28.133 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.19 2024-03-25T09:21:28.133 INFO:tasks.workunit.client.3.smithi129.stderr:+ name=nvmeof.nvmeof.a 2024-03-25T09:21:28.133 INFO:tasks.workunit.client.3.smithi129.stderr:++ seq 1 3 2024-03-25T09:21:28.134 INFO:tasks.workunit.client.3.smithi129.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:28.134 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-25T09:21:28.134 INFO:tasks.workunit.client.3.smithi129.stdout:Adding gateway listener with IP 172.21.15.19 and name nvmeof.nvmeof.a 2024-03-25T09:21:28.135 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Adding gateway listener with IP 172.21.15.19 and name nvmeof.nvmeof.a' 2024-03-25T09:21:28.135 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --gateway-name client.nvmeof.nvmeof.a --traddr 172.21.15.19 --trsvcid 4420 2024-03-25T09:21:28.225 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:28.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-mon[29386]: pgmap v349: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-25T09:21:28.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:28 smithi059 ceph-mon[32732]: pgmap v349: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-25T09:21:28.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:28 smithi040 ceph-mon[33094]: pgmap v349: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-25T09:21:28.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:28.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:29.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.a TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.19:4420, context: 2024-03-25T09:21:29.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:21:28.944608] tcp.c: 850:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 172.21.15.19 port 4420 *** 2024-03-25T09:21:29.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2001: create_listener: True 2024-03-25T09:21:29.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:21:29.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 1 2024-03-25T09:21:29.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=1 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 2 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=2 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : optimized for group : 3 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='optimized' anagrpid=3 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 4 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=4 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 5 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=5 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 6 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=6 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 7 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:28] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=7 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 8 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=8 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 9 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=9 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 10 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=10 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 11 2024-03-25T09:21:29.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=11 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 12 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=12 2024-03-25T09:21:29.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 13 2024-03-25T09:21:29.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=13 2024-03-25T09:21:29.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 14 2024-03-25T09:21:29.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=14 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 15 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=15 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 16 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=16 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 17 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=17 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 18 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=18 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 19 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=19 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 20 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=20 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 21 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=21 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 22 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=22 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 23 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=23 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 24 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=24 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 25 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=25 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 26 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=26 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 27 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=27 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 28 2024-03-25T09:21:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=28 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 29 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=29 2024-03-25T09:21:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 30 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=30 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 31 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=31 2024-03-25T09:21:29.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 32 2024-03-25T09:21:29.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=32 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 33 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=33 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 34 2024-03-25T09:21:29.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=34 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 35 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=35 2024-03-25T09:21:29.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 36 2024-03-25T09:21:29.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=36 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 37 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=37 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 38 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=38 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 39 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=39 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 40 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=40 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 41 2024-03-25T09:21:29.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=41 2024-03-25T09:21:29.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 42 2024-03-25T09:21:29.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=42 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 43 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=43 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 44 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=44 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 45 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.461 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=45 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 46 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=46 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 47 2024-03-25T09:21:29.462 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=47 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 48 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=48 2024-03-25T09:21:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 49 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=49 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 50 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=50 2024-03-25T09:21:29.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 51 2024-03-25T09:21:29.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=51 2024-03-25T09:21:29.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 52 2024-03-25T09:21:29.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=52 2024-03-25T09:21:29.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 53 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=53 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 54 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=54 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 55 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=55 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 56 2024-03-25T09:21:29.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=56 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 57 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=57 2024-03-25T09:21:29.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 58 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=58 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 59 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=59 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 60 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=60 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 61 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=61 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 62 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=62 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 63 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=63 2024-03-25T09:21:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 64 2024-03-25T09:21:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=64 2024-03-25T09:21:29.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:29.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 65 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=65 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 66 2024-03-25T09:21:29.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=66 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 67 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=67 2024-03-25T09:21:29.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 68 2024-03-25T09:21:29.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=68 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 69 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=69 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 70 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=70 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 71 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=71 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 72 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=72 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 73 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=73 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 74 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=74 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 75 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=75 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 76 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=76 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 77 2024-03-25T09:21:29.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=77 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 78 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=78 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.717 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 79 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=79 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 80 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.718 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=80 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 81 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=81 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 82 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.719 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=82 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 83 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=83 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.720 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 84 2024-03-25T09:21:29.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=84 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 85 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=85 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 86 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=86 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 87 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=87 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 88 2024-03-25T09:21:29.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=88 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 89 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=89 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 90 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=90 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 91 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=91 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 92 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=92 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 93 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=93 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 94 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=94 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 95 2024-03-25T09:21:29.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=95 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 96 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=96 2024-03-25T09:21:29.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 97 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=97 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 98 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=98 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 99 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=99 2024-03-25T09:21:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 100 2024-03-25T09:21:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=100 2024-03-25T09:21:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 101 2024-03-25T09:21:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=101 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 102 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=102 2024-03-25T09:21:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 103 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=103 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 104 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=104 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 105 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=105 2024-03-25T09:21:29.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 106 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=106 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 107 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=107 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 108 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=108 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 109 2024-03-25T09:21:29.973 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=109 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 110 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=110 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 111 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=111 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 112 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=112 2024-03-25T09:21:29.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 113 2024-03-25T09:21:29.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=113 2024-03-25T09:21:29.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 114 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=114 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 115 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=115 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 116 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=116 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 117 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.978 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=117 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 118 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=118 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 119 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.979 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.980 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.980 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.980 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.980 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=119 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 120 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=120 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 121 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=121 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 122 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=122 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 123 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=123 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 124 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=124 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 125 2024-03-25T09:21:29.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=125 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 126 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=126 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 127 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=127 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 128 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:29.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:29.986 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=128 2024-03-25T09:21:30.220 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-mon[29386]: pgmap v350: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 129 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=129 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 130 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=130 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 131 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=131 2024-03-25T09:21:30.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 132 2024-03-25T09:21:30.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:29] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=132 2024-03-25T09:21:30.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 133 2024-03-25T09:21:30.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=133 2024-03-25T09:21:30.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 134 2024-03-25T09:21:30.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=134 2024-03-25T09:21:30.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 135 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=135 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 136 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=136 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 137 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=137 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 138 2024-03-25T09:21:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=138 2024-03-25T09:21:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 139 2024-03-25T09:21:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=139 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 140 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=140 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 141 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=141 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 142 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=142 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 143 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=143 2024-03-25T09:21:30.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 144 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=144 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 145 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=145 2024-03-25T09:21:30.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 146 2024-03-25T09:21:30.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.235 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.235 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.235 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=146 2024-03-25T09:21:30.235 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.235 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 147 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=147 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 148 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=148 2024-03-25T09:21:30.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 149 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=149 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 150 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=150 2024-03-25T09:21:30.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 151 2024-03-25T09:21:30.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=151 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 152 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=152 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 153 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=153 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 154 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=154 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 155 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=155 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 156 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=156 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 157 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=157 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 158 2024-03-25T09:21:30.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=158 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 159 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=159 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 160 2024-03-25T09:21:30.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=160 2024-03-25T09:21:30.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 161 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=161 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 162 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=162 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 163 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=163 2024-03-25T09:21:30.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 164 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=164 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 165 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=165 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 166 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=166 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 167 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=167 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 168 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=168 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 169 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=169 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 170 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=170 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 171 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=171 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 172 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=172 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 173 2024-03-25T09:21:30.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=173 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 174 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=174 2024-03-25T09:21:30.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 175 2024-03-25T09:21:30.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=175 2024-03-25T09:21:30.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 176 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=176 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 177 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=177 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 178 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=178 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 179 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=179 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 180 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=180 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 181 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=181 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 182 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=182 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 183 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=183 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 184 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=184 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 185 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=185 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 186 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=186 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 187 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=187 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 188 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=188 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 189 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=189 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 190 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=190 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 191 2024-03-25T09:21:30.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=191 2024-03-25T09:21:30.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 192 2024-03-25T09:21:30.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=192 2024-03-25T09:21:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:30 smithi059 ceph-mon[32732]: pgmap v350: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-25T09:21:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:30 smithi040 ceph-mon[33094]: pgmap v350: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-25T09:21:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:30.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 193 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=193 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 194 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=194 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 195 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=195 2024-03-25T09:21:30.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 196 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=196 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 197 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=197 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 198 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=198 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 199 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=199 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 200 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=200 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 201 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=201 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 202 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=202 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 203 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=203 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 204 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=204 2024-03-25T09:21:30.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 205 2024-03-25T09:21:30.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=205 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 206 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=206 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 207 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=207 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 208 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=208 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 209 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=209 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 210 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=210 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 211 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=211 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 212 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=212 2024-03-25T09:21:30.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 213 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=213 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 214 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=214 2024-03-25T09:21:30.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 215 2024-03-25T09:21:30.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=215 2024-03-25T09:21:30.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 216 2024-03-25T09:21:30.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=216 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 217 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=217 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 218 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=218 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 219 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=219 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 220 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=220 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 221 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=221 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 222 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=222 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 223 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=223 2024-03-25T09:21:30.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 224 2024-03-25T09:21:30.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=224 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 225 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=225 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 226 2024-03-25T09:21:30.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=226 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 227 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=227 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 228 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=228 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 229 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=229 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 230 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=230 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 231 2024-03-25T09:21:30.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=231 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 232 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=232 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 233 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=233 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 234 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=234 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 235 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=235 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 236 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=236 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 237 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=237 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 238 2024-03-25T09:21:30.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=238 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 239 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=239 2024-03-25T09:21:30.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 240 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=240 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 241 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:30.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=241 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 242 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=242 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 243 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=243 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 244 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=244 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 245 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=245 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 246 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=246 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 247 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=247 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 248 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=248 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 249 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=249 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 250 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=250 2024-03-25T09:21:31.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 251 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=251 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 252 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=252 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 253 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=253 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 254 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=254 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 255 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=255 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 256 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:31.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:31.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:31.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:31.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=256 2024-03-25T09:21:31.008 INFO:tasks.workunit.client.3.smithi129.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 172.21.15.19:4420: Successful 2024-03-25T09:21:31.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:31] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.a TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.19:4420, context: None 2024-03-25T09:21:31.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:31] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.c differs from requested gateway client.nvmeof.nvmeof.a 2024-03-25T09:21:31.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:31.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:31.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:31] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.a TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.19:4420, context: None 2024-03-25T09:21:31.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:31] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.b differs from requested gateway client.nvmeof.nvmeof.a 2024-03-25T09:21:31.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:30] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:31.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:31.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:31.910 INFO:tasks.workunit.client.3.smithi129.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:31.910 INFO:tasks.workunit.client.3.smithi129.stdout:Adding gateway listener with IP 172.21.15.19 and name nvmeof.nvmeof.a 2024-03-25T09:21:31.911 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-25T09:21:31.911 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Adding gateway listener with IP 172.21.15.19 and name nvmeof.nvmeof.a' 2024-03-25T09:21:31.911 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --gateway-name client.nvmeof.nvmeof.a --traddr 172.21.15.19 --trsvcid 4420 2024-03-25T09:21:32.000 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:32Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:32.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-mon[29386]: pgmap v351: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-25T09:21:32.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:32 smithi059 ceph-mon[32732]: pgmap v351: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-25T09:21:32.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:32 smithi040 ceph-mon[33094]: pgmap v351: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-25T09:21:32.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:32.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:32.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.a TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.19:4420, context: 2024-03-25T09:21:32.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2001: create_listener: True 2024-03-25T09:21:32.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:21:32.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=1 2024-03-25T09:21:32.981 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=2 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=3 2024-03-25T09:21:32.982 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=4 2024-03-25T09:21:32.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=5 2024-03-25T09:21:32.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=6 2024-03-25T09:21:32.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.986 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.986 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.986 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.986 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.986 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.986 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=7 2024-03-25T09:21:32.986 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.986 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.987 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.987 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.987 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.987 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.987 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=8 2024-03-25T09:21:32.987 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.987 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.988 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.988 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.988 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.988 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=9 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=10 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=11 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=12 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.990 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=13 2024-03-25T09:21:32.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.991 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=14 2024-03-25T09:21:32.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=15 2024-03-25T09:21:32.992 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=16 2024-03-25T09:21:32.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=17 2024-03-25T09:21:32.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=18 2024-03-25T09:21:32.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=19 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=20 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=21 2024-03-25T09:21:32.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=22 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:32.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=23 2024-03-25T09:21:33.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=24 2024-03-25T09:21:33.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=25 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=26 2024-03-25T09:21:33.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=27 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=28 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=29 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=30 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=31 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=32 2024-03-25T09:21:33.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=33 2024-03-25T09:21:33.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:32] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=34 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=35 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.235 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.235 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.235 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.235 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.235 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=36 2024-03-25T09:21:33.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=37 2024-03-25T09:21:33.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=38 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=39 2024-03-25T09:21:33.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=40 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=41 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=42 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=43 2024-03-25T09:21:33.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=44 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=45 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=46 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=47 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=48 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=49 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=50 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=51 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=52 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=53 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=54 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=55 2024-03-25T09:21:33.245 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.246 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.246 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.246 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.246 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.246 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.246 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=56 2024-03-25T09:21:33.246 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=57 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=58 2024-03-25T09:21:33.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=59 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=60 2024-03-25T09:21:33.248 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=61 2024-03-25T09:21:33.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=62 2024-03-25T09:21:33.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=63 2024-03-25T09:21:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=64 2024-03-25T09:21:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=65 2024-03-25T09:21:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=66 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=67 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=68 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=69 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=70 2024-03-25T09:21:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=71 2024-03-25T09:21:33.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=72 2024-03-25T09:21:33.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=73 2024-03-25T09:21:33.502 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.502 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.502 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.502 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.502 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.502 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.502 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=74 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=75 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=76 2024-03-25T09:21:33.503 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=77 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=78 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=79 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=80 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=81 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=82 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=83 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=84 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=85 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=86 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=87 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=88 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=89 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=90 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=91 2024-03-25T09:21:33.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=92 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=93 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=94 2024-03-25T09:21:33.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=95 2024-03-25T09:21:33.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:33.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=96 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=97 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=98 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=99 2024-03-25T09:21:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=100 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=101 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=102 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=103 2024-03-25T09:21:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=104 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=105 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=106 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=107 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=108 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=109 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=110 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=111 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=112 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=113 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=114 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=115 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=116 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=117 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=118 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=119 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=120 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=121 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=122 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=123 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.760 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=124 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=125 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=126 2024-03-25T09:21:33.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=127 2024-03-25T09:21:34.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=128 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=129 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=130 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=131 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=132 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=133 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=134 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=135 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=136 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=137 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=138 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=139 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=140 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=141 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=142 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=143 2024-03-25T09:21:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=144 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=145 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=146 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=147 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=148 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=149 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=150 2024-03-25T09:21:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=151 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=152 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=153 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=154 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=155 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=156 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=157 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:33] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=158 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=159 2024-03-25T09:21:34.256 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-mon[29386]: pgmap v352: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-25T09:21:34.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=160 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=161 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=162 2024-03-25T09:21:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=163 2024-03-25T09:21:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=164 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=165 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=166 2024-03-25T09:21:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=167 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=168 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=169 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=170 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=171 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=172 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=173 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=174 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=175 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=176 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=177 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=178 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=179 2024-03-25T09:21:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=180 2024-03-25T09:21:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=181 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=182 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=183 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=184 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=185 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=186 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=187 2024-03-25T09:21:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=188 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=189 2024-03-25T09:21:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=190 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=191 2024-03-25T09:21:34.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:34 smithi059 ceph-mon[32732]: pgmap v352: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-25T09:21:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=192 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=193 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=194 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.515 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:34 smithi040 ceph-mon[33094]: pgmap v352: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-25T09:21:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=195 2024-03-25T09:21:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=196 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=197 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=198 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=199 2024-03-25T09:21:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=200 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=201 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=202 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=203 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=204 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=205 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=206 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=207 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=208 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=209 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=210 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=211 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=212 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=213 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=214 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=215 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=216 2024-03-25T09:21:34.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=217 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=218 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=219 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=220 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=221 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=222 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=223 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=224 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=225 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=226 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=227 2024-03-25T09:21:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=228 2024-03-25T09:21:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=229 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=230 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=231 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=232 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=233 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=234 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=235 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=236 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=237 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=238 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=239 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=240 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=241 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=242 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=243 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=244 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=245 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=246 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=247 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=248 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=249 2024-03-25T09:21:34.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=250 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=251 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=252 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=253 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=254 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:34.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:34.786 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:34.786 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:34.786 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=255 2024-03-25T09:21:34.791 INFO:tasks.workunit.client.3.smithi129.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 172.21.15.19:4420: Successful 2024-03-25T09:21:35.131 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:34] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.a TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.19:4420, context: None 2024-03-25T09:21:35.131 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:34] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.c differs from requested gateway client.nvmeof.nvmeof.a 2024-03-25T09:21:35.131 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:35.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:35.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:35.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:35.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:35.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:35.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:35.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=256 2024-03-25T09:21:35.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:35.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:35.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:35.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:34] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.a TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.19:4420, context: None 2024-03-25T09:21:35.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:34] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.b differs from requested gateway client.nvmeof.nvmeof.a 2024-03-25T09:21:35.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:35.618 INFO:tasks.workunit.client.3.smithi129.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:35.618 INFO:tasks.workunit.client.3.smithi129.stdout:Adding gateway listener with IP 172.21.15.19 and name nvmeof.nvmeof.a 2024-03-25T09:21:35.619 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-25T09:21:35.619 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Adding gateway listener with IP 172.21.15.19 and name nvmeof.nvmeof.a' 2024-03-25T09:21:35.619 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --gateway-name client.nvmeof.nvmeof.a --traddr 172.21.15.19 --trsvcid 4420 2024-03-25T09:21:35.706 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:35Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:36.389 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-mon[29386]: pgmap v353: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-25T09:21:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:36 smithi059 ceph-mon[32732]: pgmap v353: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-25T09:21:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:36 smithi040 ceph-mon[33094]: pgmap v353: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-25T09:21:36.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:36.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.a TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.19:4420, context: 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2001: create_listener: True 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=1 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=2 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=3 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=4 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=5 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=6 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=7 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=8 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=9 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=10 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=11 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=12 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=13 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.653 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.653 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.653 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.653 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=14 2024-03-25T09:21:36.653 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.653 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.653 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.653 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.653 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.653 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=15 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=16 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=17 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=18 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=19 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=20 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=21 2024-03-25T09:21:36.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=22 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=23 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=24 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=25 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=26 2024-03-25T09:21:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=27 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=28 2024-03-25T09:21:36.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=29 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=30 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=31 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=32 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=33 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=34 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=35 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=36 2024-03-25T09:21:36.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=37 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=38 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=39 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=40 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=41 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=42 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=43 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=44 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=45 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=46 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=47 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=48 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=49 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=50 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=51 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=52 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=53 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=54 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=55 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.913 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=56 2024-03-25T09:21:36.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=57 2024-03-25T09:21:36.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=58 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=59 2024-03-25T09:21:36.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=60 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=61 2024-03-25T09:21:36.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=62 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=63 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:36.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:36.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:36.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:36.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:36.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:36.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=64 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=65 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=66 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=67 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=68 2024-03-25T09:21:37.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=69 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=70 2024-03-25T09:21:37.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=71 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=72 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=73 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=74 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=75 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:36] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=76 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.163 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=77 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=78 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.164 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=79 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=80 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=81 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=82 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.166 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=83 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=84 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=85 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=86 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=87 2024-03-25T09:21:37.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=88 2024-03-25T09:21:37.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=89 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.170 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=90 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=91 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=92 2024-03-25T09:21:37.171 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=93 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=94 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.172 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=95 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=96 2024-03-25T09:21:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=97 2024-03-25T09:21:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=98 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=99 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=100 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=101 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.412 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=102 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=103 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.413 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=104 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=105 2024-03-25T09:21:37.414 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=106 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=107 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=108 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=109 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=110 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=111 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=112 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=113 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=114 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=115 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.420 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=116 2024-03-25T09:21:37.420 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.420 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.420 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=117 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=118 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.421 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=119 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=120 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.422 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=121 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=122 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.423 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=123 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=124 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.424 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=125 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=126 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.425 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.426 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=127 2024-03-25T09:21:37.426 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.426 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.426 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.426 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.426 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.426 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.426 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=128 2024-03-25T09:21:37.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:37.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:37.669 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.669 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.669 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=129 2024-03-25T09:21:37.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=130 2024-03-25T09:21:37.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=131 2024-03-25T09:21:37.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.673 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.673 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.673 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=132 2024-03-25T09:21:37.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=133 2024-03-25T09:21:37.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=134 2024-03-25T09:21:37.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=135 2024-03-25T09:21:37.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=136 2024-03-25T09:21:37.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=137 2024-03-25T09:21:37.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=138 2024-03-25T09:21:37.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=139 2024-03-25T09:21:37.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=140 2024-03-25T09:21:37.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=141 2024-03-25T09:21:37.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.686 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.686 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.686 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.686 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.686 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.686 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=142 2024-03-25T09:21:37.687 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.687 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.687 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.687 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.687 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.687 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.688 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=143 2024-03-25T09:21:37.688 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.688 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.688 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.688 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.688 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.688 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.688 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=144 2024-03-25T09:21:37.688 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.688 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=145 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=146 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.689 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=147 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=148 2024-03-25T09:21:37.690 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=149 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=150 2024-03-25T09:21:37.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=151 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=152 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=153 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=154 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=155 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=156 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=157 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.695 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=158 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=159 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=160 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=161 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=162 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=163 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=164 2024-03-25T09:21:37.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=165 2024-03-25T09:21:37.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=166 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=167 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=168 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=169 2024-03-25T09:21:37.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=170 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=171 2024-03-25T09:21:37.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=172 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=173 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=174 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=175 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=176 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=177 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=178 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=179 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=180 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=181 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=182 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=183 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=184 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=185 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=186 2024-03-25T09:21:37.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=187 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=188 2024-03-25T09:21:37.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=189 2024-03-25T09:21:37.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=190 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=191 2024-03-25T09:21:37.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:37.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:37.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:37.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:37.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:37.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:37.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=192 2024-03-25T09:21:38.180 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-mon[29386]: pgmap v354: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-03-25T09:21:38.180 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.180 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=193 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=194 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=195 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.182 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.183 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=196 2024-03-25T09:21:38.183 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.183 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.183 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.183 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.183 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.183 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=197 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=198 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=199 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=200 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:37] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=201 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=202 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=203 2024-03-25T09:21:38.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=204 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=205 2024-03-25T09:21:38.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=206 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=207 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=208 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=209 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=210 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=211 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=212 2024-03-25T09:21:38.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=213 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=214 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=215 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=216 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=217 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=218 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=219 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=220 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=221 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=222 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=223 2024-03-25T09:21:38.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=224 2024-03-25T09:21:38.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=225 2024-03-25T09:21:38.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=226 2024-03-25T09:21:38.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=227 2024-03-25T09:21:38.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=228 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=229 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=230 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=231 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=232 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=233 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=234 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=235 2024-03-25T09:21:38.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=236 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=237 2024-03-25T09:21:38.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=238 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=239 2024-03-25T09:21:38.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=240 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=241 2024-03-25T09:21:38.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=242 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=243 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=244 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=245 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=246 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=247 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=248 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=249 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=250 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=251 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=252 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=253 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=254 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=255 2024-03-25T09:21:38.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:38.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: gateway_name: "client.nvmeof.nvmeof.a" 2024-03-25T09:21:38.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: traddr: "172.21.15.19" 2024-03-25T09:21:38.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: adrfam: ipv4 2024-03-25T09:21:38.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: trsvcid: 4420 2024-03-25T09:21:38.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: _ana_state='inaccessible' anagrpid=256 2024-03-25T09:21:38.456 INFO:tasks.workunit.client.3.smithi129.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 172.21.15.19:4420: Successful 2024-03-25T09:21:38.456 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:38 smithi059 ceph-mon[32732]: pgmap v354: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-03-25T09:21:38.456 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:38 smithi040 ceph-mon[33094]: pgmap v354: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-03-25T09:21:38.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:38.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:38.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:38] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.a TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.19:4420, context: None 2024-03-25T09:21:38.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:38] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.b differs from requested gateway client.nvmeof.nvmeof.a 2024-03-25T09:21:38.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:38] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.a TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.19:4420, context: None 2024-03-25T09:21:38.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:38] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.c differs from requested gateway client.nvmeof.nvmeof.a 2024-03-25T09:21:38.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:38.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:38.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:39.279 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:21:39.279 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.40 2024-03-25T09:21:39.279 INFO:tasks.workunit.client.3.smithi129.stderr:+ name=nvmeof.nvmeof.b 2024-03-25T09:21:39.280 INFO:tasks.workunit.client.3.smithi129.stderr:++ seq 1 3 2024-03-25T09:21:39.281 INFO:tasks.workunit.client.3.smithi129.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:39.281 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-25T09:21:39.281 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Adding gateway listener with IP 172.21.15.40 and name nvmeof.nvmeof.b' 2024-03-25T09:21:39.281 INFO:tasks.workunit.client.3.smithi129.stdout:Adding gateway listener with IP 172.21.15.40 and name nvmeof.nvmeof.b 2024-03-25T09:21:39.281 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.40 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --gateway-name client.nvmeof.nvmeof.b --traddr 172.21.15.40 --trsvcid 4420 2024-03-25T09:21:39.364 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:39Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:39.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:39.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:40.310 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-mon[33094]: pgmap v355: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-25T09:21:40.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.b TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.40:4420, context: 2024-03-25T09:21:40.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:21:40.058482] tcp.c: 850:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 172.21.15.40 port 4420 *** 2024-03-25T09:21:40.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2001: create_listener: True 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 1 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=1 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : optimized for group : 2 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='optimized' anagrpid=2 2024-03-25T09:21:40.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 3 2024-03-25T09:21:40.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=3 2024-03-25T09:21:40.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 4 2024-03-25T09:21:40.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=4 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 5 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=5 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 6 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=6 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 7 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=7 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 8 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=8 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 9 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=9 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 10 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=10 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 11 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=11 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 12 2024-03-25T09:21:40.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=12 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 13 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=13 2024-03-25T09:21:40.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 14 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=14 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 15 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=15 2024-03-25T09:21:40.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 16 2024-03-25T09:21:40.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=16 2024-03-25T09:21:40.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 17 2024-03-25T09:21:40.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=17 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 18 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=18 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 19 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=19 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 20 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.324 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=20 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 21 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=21 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 22 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=22 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 23 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=23 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 24 2024-03-25T09:21:40.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=24 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 25 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=25 2024-03-25T09:21:40.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 26 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=26 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 27 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=27 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 28 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=28 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 29 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=29 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 30 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=30 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 31 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=31 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 32 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=32 2024-03-25T09:21:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:40 smithi019 ceph-mon[29386]: pgmap v355: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-25T09:21:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:40 smithi059 ceph-mon[32732]: pgmap v355: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-25T09:21:40.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 33 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=33 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 34 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=34 2024-03-25T09:21:40.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 35 2024-03-25T09:21:40.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=35 2024-03-25T09:21:40.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 36 2024-03-25T09:21:40.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=36 2024-03-25T09:21:40.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 37 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=37 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 38 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=38 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 39 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=39 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 40 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=40 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 41 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=41 2024-03-25T09:21:40.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 42 2024-03-25T09:21:40.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=42 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 43 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=43 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 44 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=44 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 45 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=45 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 46 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=46 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 47 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=47 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 48 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=48 2024-03-25T09:21:40.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 49 2024-03-25T09:21:40.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=49 2024-03-25T09:21:40.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 50 2024-03-25T09:21:40.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=50 2024-03-25T09:21:40.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 51 2024-03-25T09:21:40.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=51 2024-03-25T09:21:40.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 52 2024-03-25T09:21:40.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=52 2024-03-25T09:21:40.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 53 2024-03-25T09:21:40.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.584 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.584 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.584 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=53 2024-03-25T09:21:40.584 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.585 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 54 2024-03-25T09:21:40.585 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.585 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.585 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.585 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.585 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.585 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=54 2024-03-25T09:21:40.585 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 55 2024-03-25T09:21:40.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=55 2024-03-25T09:21:40.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 56 2024-03-25T09:21:40.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=56 2024-03-25T09:21:40.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 57 2024-03-25T09:21:40.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=57 2024-03-25T09:21:40.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 58 2024-03-25T09:21:40.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=58 2024-03-25T09:21:40.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 59 2024-03-25T09:21:40.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=59 2024-03-25T09:21:40.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 60 2024-03-25T09:21:40.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=60 2024-03-25T09:21:40.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 61 2024-03-25T09:21:40.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=61 2024-03-25T09:21:40.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 62 2024-03-25T09:21:40.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=62 2024-03-25T09:21:40.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 63 2024-03-25T09:21:40.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=63 2024-03-25T09:21:40.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 64 2024-03-25T09:21:40.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=64 2024-03-25T09:21:40.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 65 2024-03-25T09:21:40.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=65 2024-03-25T09:21:40.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 66 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=66 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 67 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=67 2024-03-25T09:21:40.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 68 2024-03-25T09:21:40.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=68 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 69 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=69 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 70 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=70 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 71 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=71 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 72 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=72 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 73 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=73 2024-03-25T09:21:40.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 74 2024-03-25T09:21:40.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=74 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 75 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=75 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 76 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=76 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 77 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=77 2024-03-25T09:21:40.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 78 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=78 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 79 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=79 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 80 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=80 2024-03-25T09:21:40.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 81 2024-03-25T09:21:40.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=81 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 82 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=82 2024-03-25T09:21:40.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 83 2024-03-25T09:21:40.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=83 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 84 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=84 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 85 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=85 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 86 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.838 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=86 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 87 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=87 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 88 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.839 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=88 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 89 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=89 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 90 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=90 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 91 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=91 2024-03-25T09:21:40.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 92 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=92 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 93 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=93 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 94 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=94 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 95 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=95 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 96 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:40.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=96 2024-03-25T09:21:40.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:40.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:41.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 97 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=97 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 98 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=98 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 99 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=99 2024-03-25T09:21:41.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 100 2024-03-25T09:21:41.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=100 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 101 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=101 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 102 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=102 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 103 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=103 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 104 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=104 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 105 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=105 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 106 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=106 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 107 2024-03-25T09:21:41.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=107 2024-03-25T09:21:41.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 108 2024-03-25T09:21:41.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=108 2024-03-25T09:21:41.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 109 2024-03-25T09:21:41.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=109 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 110 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=110 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 111 2024-03-25T09:21:41.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=111 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 112 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=112 2024-03-25T09:21:41.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 113 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=113 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 114 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=114 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 115 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=115 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 116 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=116 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 117 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=117 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 118 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:40] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=118 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 119 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=119 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 120 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=120 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 121 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=121 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 122 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=122 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 123 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=123 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 124 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=124 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 125 2024-03-25T09:21:41.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=125 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 126 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=126 2024-03-25T09:21:41.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 127 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=127 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 128 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=128 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 129 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=129 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 130 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=130 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 131 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=131 2024-03-25T09:21:41.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 132 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=132 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 133 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=133 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 134 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=134 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 135 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=135 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 136 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=136 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 137 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=137 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 138 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=138 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 139 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=139 2024-03-25T09:21:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 140 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=140 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 141 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=141 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 142 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=142 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 143 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=143 2024-03-25T09:21:41.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 144 2024-03-25T09:21:41.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=144 2024-03-25T09:21:41.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 145 2024-03-25T09:21:41.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=145 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 146 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=146 2024-03-25T09:21:41.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 147 2024-03-25T09:21:41.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=147 2024-03-25T09:21:41.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 148 2024-03-25T09:21:41.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=148 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 149 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=149 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 150 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=150 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 151 2024-03-25T09:21:41.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=151 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 152 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=152 2024-03-25T09:21:41.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 153 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=153 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 154 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=154 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 155 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=155 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 156 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=156 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 157 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=157 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 158 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=158 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 159 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=159 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 160 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=160 2024-03-25T09:21:41.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:41.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:41.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 161 2024-03-25T09:21:41.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=161 2024-03-25T09:21:41.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 162 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=162 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 163 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=163 2024-03-25T09:21:41.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 164 2024-03-25T09:21:41.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=164 2024-03-25T09:21:41.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 165 2024-03-25T09:21:41.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=165 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 166 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=166 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 167 2024-03-25T09:21:41.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=167 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 168 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=168 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 169 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=169 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 170 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=170 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 171 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=171 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 172 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=172 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 173 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=173 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 174 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=174 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 175 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=175 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 176 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=176 2024-03-25T09:21:41.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 177 2024-03-25T09:21:41.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=177 2024-03-25T09:21:41.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 178 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=178 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 179 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=179 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 180 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=180 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 181 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=181 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 182 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=182 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 183 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.605 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=183 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 184 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=184 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 185 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.606 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=185 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 186 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=186 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 187 2024-03-25T09:21:41.607 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=187 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 188 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=188 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.608 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 189 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=189 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 190 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=190 2024-03-25T09:21:41.609 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 191 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=191 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 192 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=192 2024-03-25T09:21:41.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 193 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=193 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 194 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=194 2024-03-25T09:21:41.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 195 2024-03-25T09:21:41.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=195 2024-03-25T09:21:41.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 196 2024-03-25T09:21:41.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=196 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 197 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=197 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 198 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=198 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 199 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=199 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 200 2024-03-25T09:21:41.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=200 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 201 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=201 2024-03-25T09:21:41.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 202 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=202 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 203 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=203 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 204 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=204 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 205 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=205 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 206 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=206 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 207 2024-03-25T09:21:41.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=207 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 208 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=208 2024-03-25T09:21:41.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 209 2024-03-25T09:21:41.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=209 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 210 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=210 2024-03-25T09:21:41.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 211 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=211 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 212 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=212 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 213 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=213 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 214 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=214 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 215 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=215 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 216 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=216 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 217 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=217 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.862 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 218 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=218 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 219 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.863 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=219 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 220 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=220 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 221 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.864 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=221 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 222 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=222 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 223 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=223 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 224 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:41.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:41.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=224 2024-03-25T09:21:42.102 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-mon[33094]: pgmap v356: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:42.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 225 2024-03-25T09:21:42.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=225 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 226 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=226 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 227 2024-03-25T09:21:42.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=227 2024-03-25T09:21:42.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 228 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=228 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 229 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=229 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 230 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=230 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 231 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=231 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 232 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=232 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 233 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=233 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 234 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=234 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 235 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=235 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 236 2024-03-25T09:21:42.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=236 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 237 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=237 2024-03-25T09:21:42.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 238 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=238 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 239 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=239 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 240 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=240 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 241 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=241 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 242 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=242 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 243 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:41] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=243 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 244 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=244 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 245 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=245 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 246 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=246 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 247 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.116 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=247 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 248 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=248 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 249 2024-03-25T09:21:42.117 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=249 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 250 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=250 2024-03-25T09:21:42.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 251 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=251 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 252 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=252 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 253 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=253 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 254 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.120 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=254 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 255 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=255 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 256 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:42.121 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:42.122 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=256 2024-03-25T09:21:42.122 INFO:tasks.workunit.client.3.smithi129.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 172.21.15.40:4420: Successful 2024-03-25T09:21:42.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:42 smithi019 ceph-mon[29386]: pgmap v356: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:42.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:42] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.b TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.40:4420, context: None 2024-03-25T09:21:42.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:42] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.a differs from requested gateway client.nvmeof.nvmeof.b 2024-03-25T09:21:42.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:42 smithi059 ceph-mon[32732]: pgmap v356: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:42.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:42] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.b TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.40:4420, context: None 2024-03-25T09:21:42.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:42] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.c differs from requested gateway client.nvmeof.nvmeof.b 2024-03-25T09:21:42.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:42.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:42.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:42.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:42.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:42.980 INFO:tasks.workunit.client.3.smithi129.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:42.980 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-25T09:21:42.980 INFO:tasks.workunit.client.3.smithi129.stdout:Adding gateway listener with IP 172.21.15.40 and name nvmeof.nvmeof.b 2024-03-25T09:21:42.981 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Adding gateway listener with IP 172.21.15.40 and name nvmeof.nvmeof.b' 2024-03-25T09:21:42.981 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.40 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --gateway-name client.nvmeof.nvmeof.b --traddr 172.21.15.40 --trsvcid 4420 2024-03-25T09:21:43.074 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:43Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:43.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:43.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:44.074 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-mon[33094]: pgmap v357: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:44.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.b TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.40:4420, context: 2024-03-25T09:21:44.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2001: create_listener: True 2024-03-25T09:21:44.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:21:44.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=1 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=2 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=3 2024-03-25T09:21:44.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=4 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=5 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=6 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=7 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=8 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=9 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=10 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.080 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=11 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=12 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=13 2024-03-25T09:21:44.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=14 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=15 2024-03-25T09:21:44.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=16 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=17 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=18 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=19 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=20 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:43] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=21 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=22 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=23 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=24 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=25 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=26 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=27 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=28 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=29 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=30 2024-03-25T09:21:44.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=31 2024-03-25T09:21:44.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=32 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=33 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=34 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=35 2024-03-25T09:21:44.333 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=36 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=37 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=38 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=39 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=40 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=41 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=42 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=43 2024-03-25T09:21:44.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=44 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=45 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=46 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=47 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=48 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=49 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=50 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=51 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=52 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=53 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=54 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=55 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=56 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=57 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=58 2024-03-25T09:21:44.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=59 2024-03-25T09:21:44.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=60 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.346 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=61 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=62 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=63 2024-03-25T09:21:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:44 smithi019 ceph-mon[29386]: pgmap v357: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:44.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:44 smithi059 ceph-mon[32732]: pgmap v357: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 4.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:44.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=64 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=65 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=66 2024-03-25T09:21:44.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=67 2024-03-25T09:21:44.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=68 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=69 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=70 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=71 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=72 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=73 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=74 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=75 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=76 2024-03-25T09:21:44.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=77 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=78 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=79 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=80 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=81 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=82 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=83 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=84 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=85 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=86 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=87 2024-03-25T09:21:44.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=88 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=89 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=90 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=91 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=92 2024-03-25T09:21:44.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=93 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=94 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=95 2024-03-25T09:21:44.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=96 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=97 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.843 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=98 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=99 2024-03-25T09:21:44.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=100 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=101 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=102 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=103 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=104 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=105 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=106 2024-03-25T09:21:44.848 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=107 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=108 2024-03-25T09:21:44.849 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=109 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=110 2024-03-25T09:21:44.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=111 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=112 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=113 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=114 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=115 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=116 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.853 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=117 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=118 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.854 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=119 2024-03-25T09:21:44.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=120 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=121 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=122 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=123 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=124 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=125 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.858 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=126 2024-03-25T09:21:44.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:44.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:44.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:44.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:44.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:44.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:44.859 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=127 2024-03-25T09:21:44.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:44.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:45.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=128 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=129 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=130 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=131 2024-03-25T09:21:45.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=132 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=133 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=134 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=135 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=136 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=137 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=138 2024-03-25T09:21:45.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=139 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=140 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=141 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=142 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=143 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=144 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=145 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:44] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=146 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=147 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=148 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.110 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=149 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=150 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=151 2024-03-25T09:21:45.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=152 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=153 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.112 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=154 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=155 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=156 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=157 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=158 2024-03-25T09:21:45.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=159 2024-03-25T09:21:45.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.354 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=160 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=161 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.355 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=162 2024-03-25T09:21:45.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.356 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.357 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=163 2024-03-25T09:21:45.357 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.357 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.357 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.357 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=164 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=165 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=166 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=167 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=168 2024-03-25T09:21:45.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=169 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=170 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=171 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=172 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=173 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=174 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=175 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=176 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=177 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=178 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=179 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=180 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=181 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=182 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=183 2024-03-25T09:21:45.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=184 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=185 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=186 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=187 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.370 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=188 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.371 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=189 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=190 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=191 2024-03-25T09:21:45.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:45.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:45.610 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=192 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.611 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=193 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=194 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.612 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.613 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.613 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.613 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.614 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=195 2024-03-25T09:21:45.614 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=196 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.615 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=197 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=198 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=199 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.617 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=200 2024-03-25T09:21:45.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=201 2024-03-25T09:21:45.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.619 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.619 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.619 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.619 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=202 2024-03-25T09:21:45.619 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.619 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.619 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.619 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.620 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.620 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.620 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=203 2024-03-25T09:21:45.620 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.620 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.620 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.620 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.620 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.620 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=204 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=205 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.621 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=206 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=207 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=208 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=209 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=210 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=211 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=212 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=213 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=214 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=215 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=216 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=217 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=218 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=219 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=220 2024-03-25T09:21:45.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=221 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=222 2024-03-25T09:21:45.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=223 2024-03-25T09:21:45.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=224 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=225 2024-03-25T09:21:45.867 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=226 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.868 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.870 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=227 2024-03-25T09:21:45.870 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.870 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.870 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.870 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.870 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=228 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=229 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.871 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=230 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=231 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=232 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=233 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=234 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=235 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=236 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=237 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=238 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=239 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=240 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=241 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=242 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=243 2024-03-25T09:21:45.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=244 2024-03-25T09:21:45.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=245 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=246 2024-03-25T09:21:45.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=247 2024-03-25T09:21:45.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=248 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=249 2024-03-25T09:21:45.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=250 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=251 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=252 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=253 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=254 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:45.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:45.886 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:45.886 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=255 2024-03-25T09:21:45.888 INFO:tasks.workunit.client.3.smithi129.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 172.21.15.40:4420: Successful 2024-03-25T09:21:46.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:46 smithi019 ceph-mon[29386]: pgmap v358: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:21:46.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:45] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.b TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.40:4420, context: None 2024-03-25T09:21:46.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:45] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.a differs from requested gateway client.nvmeof.nvmeof.b 2024-03-25T09:21:46.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:46 smithi059 ceph-mon[32732]: pgmap v358: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:21:46.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:45] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.b TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.40:4420, context: None 2024-03-25T09:21:46.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:45] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.c differs from requested gateway client.nvmeof.nvmeof.b 2024-03-25T09:21:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:46 smithi040 ceph-mon[33094]: pgmap v358: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:21:46.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:46.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:46.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:46.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:46.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:46.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:46.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=256 2024-03-25T09:21:46.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:46.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:46.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:46.739 INFO:tasks.workunit.client.3.smithi129.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:46.739 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-25T09:21:46.739 INFO:tasks.workunit.client.3.smithi129.stdout:Adding gateway listener with IP 172.21.15.40 and name nvmeof.nvmeof.b 2024-03-25T09:21:46.740 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Adding gateway listener with IP 172.21.15.40 and name nvmeof.nvmeof.b' 2024-03-25T09:21:46.740 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.40 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --gateway-name client.nvmeof.nvmeof.b --traddr 172.21.15.40 --trsvcid 4420 2024-03-25T09:21:46.831 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:46Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:46.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:46.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:47.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:47.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:47.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.b TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.40:4420, context: 2024-03-25T09:21:47.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2001: create_listener: True 2024-03-25T09:21:47.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:21:47.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=1 2024-03-25T09:21:47.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=2 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=3 2024-03-25T09:21:47.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=4 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=5 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=6 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=7 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=8 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=9 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=10 2024-03-25T09:21:47.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.801 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.801 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.801 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.801 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.801 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.801 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=11 2024-03-25T09:21:47.801 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.801 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.801 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.802 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.802 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.802 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.802 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=12 2024-03-25T09:21:47.802 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.802 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=13 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=14 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=15 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=16 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=17 2024-03-25T09:21:47.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=18 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=19 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=20 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=21 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=22 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=23 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=24 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=25 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=26 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=27 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=28 2024-03-25T09:21:47.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=29 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=30 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=31 2024-03-25T09:21:47.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=32 2024-03-25T09:21:47.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:47.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:47.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:47.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:47.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:47.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:47.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=33 2024-03-25T09:21:48.051 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.051 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.051 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.051 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.051 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.051 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.051 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=34 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=35 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.052 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=36 2024-03-25T09:21:48.053 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.053 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.053 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.053 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.053 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.053 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.053 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=37 2024-03-25T09:21:48.053 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=38 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=39 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=40 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=41 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=42 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=43 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=44 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.057 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=45 2024-03-25T09:21:48.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.061 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.061 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.061 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.062 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.062 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.062 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=46 2024-03-25T09:21:48.062 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.062 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.062 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.062 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.062 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=47 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=48 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=49 2024-03-25T09:21:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.065 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=50 2024-03-25T09:21:48.065 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.065 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.065 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.065 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=51 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=52 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.066 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=53 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=54 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=55 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=56 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:47] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.068 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=57 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=58 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=59 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=60 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=61 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=62 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.072 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.072 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.072 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.072 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.072 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=63 2024-03-25T09:21:48.072 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.072 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=64 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=65 2024-03-25T09:21:48.306 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-mon[33094]: pgmap v359: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:48.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=66 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=67 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.308 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.308 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=68 2024-03-25T09:21:48.308 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.308 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.308 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.308 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.308 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.308 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.308 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=69 2024-03-25T09:21:48.309 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.309 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.309 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.309 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.309 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.309 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.309 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=70 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=71 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=72 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=73 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=74 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=75 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=76 2024-03-25T09:21:48.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=77 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=78 2024-03-25T09:21:48.313 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=79 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=80 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=81 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=82 2024-03-25T09:21:48.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=83 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=84 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=85 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=86 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.317 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=87 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=88 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.318 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=89 2024-03-25T09:21:48.319 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=90 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=91 2024-03-25T09:21:48.320 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=92 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=93 2024-03-25T09:21:48.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=94 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=95 2024-03-25T09:21:48.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=96 2024-03-25T09:21:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:48 smithi019 ceph-mon[29386]: pgmap v359: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:48.412 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:48 smithi059 ceph-mon[32732]: pgmap v359: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:48.562 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=97 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.563 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=98 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=99 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.564 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.565 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=100 2024-03-25T09:21:48.565 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.565 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=101 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=102 2024-03-25T09:21:48.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=103 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=104 2024-03-25T09:21:48.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=105 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=106 2024-03-25T09:21:48.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=107 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=108 2024-03-25T09:21:48.569 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=109 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=110 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=111 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=112 2024-03-25T09:21:48.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=113 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=114 2024-03-25T09:21:48.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=115 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=116 2024-03-25T09:21:48.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.574 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=117 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=118 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=119 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=120 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=121 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=122 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=123 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=124 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=125 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=126 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.579 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=127 2024-03-25T09:21:48.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.580 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=128 2024-03-25T09:21:48.818 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.818 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=129 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=130 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.819 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=131 2024-03-25T09:21:48.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=132 2024-03-25T09:21:48.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=133 2024-03-25T09:21:48.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=134 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=135 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=136 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=137 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=138 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=139 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.824 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=140 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=141 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=142 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.825 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=143 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.826 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=144 2024-03-25T09:21:48.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.827 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=145 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=146 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=147 2024-03-25T09:21:48.828 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=148 2024-03-25T09:21:48.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=149 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=150 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=151 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=152 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=153 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=154 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.832 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=155 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=156 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=157 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=158 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=159 2024-03-25T09:21:48.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:48.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:48.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:48.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:48.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:48.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:48.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=160 2024-03-25T09:21:48.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:48.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:49.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=161 2024-03-25T09:21:49.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.075 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=162 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=163 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.076 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=164 2024-03-25T09:21:49.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=165 2024-03-25T09:21:49.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.079 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=166 2024-03-25T09:21:49.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.081 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=167 2024-03-25T09:21:49.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=168 2024-03-25T09:21:49.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.083 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=169 2024-03-25T09:21:49.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=170 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=171 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.085 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=172 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=173 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.086 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=174 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=175 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.087 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=176 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=177 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.088 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=178 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=179 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=180 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=181 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:48] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=182 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=183 2024-03-25T09:21:49.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=184 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=185 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=186 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=187 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=188 2024-03-25T09:21:49.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=189 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=190 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=191 2024-03-25T09:21:49.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=192 2024-03-25T09:21:49.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=193 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=194 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.331 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=195 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.332 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.333 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=196 2024-03-25T09:21:49.333 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.333 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.333 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.333 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.333 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=197 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=198 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.334 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=199 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=200 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=201 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=202 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=203 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=204 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.337 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=205 2024-03-25T09:21:49.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=206 2024-03-25T09:21:49.338 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=207 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=208 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=209 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=210 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=211 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=212 2024-03-25T09:21:49.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=213 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=214 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=215 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.345 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=216 2024-03-25T09:21:49.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.347 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=217 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=218 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.348 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=219 2024-03-25T09:21:49.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.349 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=220 2024-03-25T09:21:49.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.350 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=221 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=222 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.351 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=223 2024-03-25T09:21:49.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.352 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.353 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=224 2024-03-25T09:21:49.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:49.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:49.586 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=225 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=226 2024-03-25T09:21:49.587 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=227 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=228 2024-03-25T09:21:49.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=229 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=230 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.590 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=231 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=232 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=233 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=234 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=235 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=236 2024-03-25T09:21:49.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=237 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.594 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=238 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=239 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=240 2024-03-25T09:21:49.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=241 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=242 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=243 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=244 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.597 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=245 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=246 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.598 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=247 2024-03-25T09:21:49.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.599 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=248 2024-03-25T09:21:49.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=249 2024-03-25T09:21:49.600 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=250 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=251 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=252 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=253 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=254 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=255 2024-03-25T09:21:49.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:49.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:49.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: gateway_name: "client.nvmeof.nvmeof.b" 2024-03-25T09:21:49.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: traddr: "172.21.15.40" 2024-03-25T09:21:49.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: adrfam: ipv4 2024-03-25T09:21:49.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: trsvcid: 4420 2024-03-25T09:21:49.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: _ana_state='inaccessible' anagrpid=256 2024-03-25T09:21:49.604 INFO:tasks.workunit.client.3.smithi129.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 172.21.15.40:4420: Successful 2024-03-25T09:21:49.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:49] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.b TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.40:4420, context: None 2024-03-25T09:21:49.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:49] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.a differs from requested gateway client.nvmeof.nvmeof.b 2024-03-25T09:21:50.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:49] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.b TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.40:4420, context: None 2024-03-25T09:21:50.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:49] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.c differs from requested gateway client.nvmeof.nvmeof.b 2024-03-25T09:21:50.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:50.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:50.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:50.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:50 smithi019 ceph-mon[29386]: pgmap v360: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:21:50.423 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:21:50.423 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.59 2024-03-25T09:21:50.424 INFO:tasks.workunit.client.3.smithi129.stderr:+ name=nvmeof.nvmeof.c 2024-03-25T09:21:50.424 INFO:tasks.workunit.client.3.smithi129.stderr:++ seq 1 3 2024-03-25T09:21:50.425 INFO:tasks.workunit.client.3.smithi129.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:50.425 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-25T09:21:50.426 INFO:tasks.workunit.client.3.smithi129.stdout:Adding gateway listener with IP 172.21.15.59 and name nvmeof.nvmeof.c 2024-03-25T09:21:50.426 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Adding gateway listener with IP 172.21.15.59 and name nvmeof.nvmeof.c' 2024-03-25T09:21:50.426 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.59 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --gateway-name client.nvmeof.nvmeof.c --traddr 172.21.15.59 --trsvcid 4420 2024-03-25T09:21:50.510 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:50Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:50.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:50 smithi059 ceph-mon[32732]: pgmap v360: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:21:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:50 smithi040 ceph-mon[33094]: pgmap v360: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:21:50.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:50.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.c TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.59:4420, context: 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:21:51.261700] tcp.c: 850:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 172.21.15.59 port 4420 *** 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2001: create_listener: True 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : optimized for group : 1 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='optimized' anagrpid=1 2024-03-25T09:21:51.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 2 2024-03-25T09:21:51.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=2 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 3 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=3 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 4 2024-03-25T09:21:51.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=4 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 5 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=5 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 6 2024-03-25T09:21:51.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=6 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 7 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=7 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 8 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=8 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 9 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=9 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 10 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=10 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 11 2024-03-25T09:21:51.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=11 2024-03-25T09:21:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 12 2024-03-25T09:21:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=12 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 13 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=13 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 14 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=14 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 15 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.459 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.460 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.460 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.460 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=15 2024-03-25T09:21:51.460 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.460 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 16 2024-03-25T09:21:51.460 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.460 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.460 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.460 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=16 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 17 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=17 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 18 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.461 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=18 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 19 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=19 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 20 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=20 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 21 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=21 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 22 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=22 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 23 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=23 2024-03-25T09:21:51.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 24 2024-03-25T09:21:51.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=24 2024-03-25T09:21:51.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 25 2024-03-25T09:21:51.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=25 2024-03-25T09:21:51.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 26 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=26 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 27 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=27 2024-03-25T09:21:51.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 28 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=28 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 29 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=29 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 30 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=30 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 31 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=31 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 32 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=32 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 33 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=33 2024-03-25T09:21:51.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 34 2024-03-25T09:21:51.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=34 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 35 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=35 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 36 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=36 2024-03-25T09:21:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 37 2024-03-25T09:21:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=37 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 38 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=38 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 39 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=39 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 40 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=40 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 41 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.716 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=41 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 42 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=42 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 43 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.717 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.718 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=43 2024-03-25T09:21:51.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 44 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=44 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 45 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=45 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 46 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=46 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 47 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=47 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 48 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=48 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 49 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=49 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 50 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=50 2024-03-25T09:21:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 51 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=51 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 52 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=52 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 53 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=53 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 54 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=54 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 55 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=55 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 56 2024-03-25T09:21:51.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=56 2024-03-25T09:21:51.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 57 2024-03-25T09:21:51.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=57 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 58 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=58 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 59 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=59 2024-03-25T09:21:51.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 60 2024-03-25T09:21:51.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=60 2024-03-25T09:21:51.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 61 2024-03-25T09:21:51.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=61 2024-03-25T09:21:51.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 62 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=62 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 63 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=63 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 64 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=64 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 65 2024-03-25T09:21:51.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=65 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 66 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=66 2024-03-25T09:21:51.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 67 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=67 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 68 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=68 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 69 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=69 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 70 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=70 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 71 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=71 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 72 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=72 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 73 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=73 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 74 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=74 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 75 2024-03-25T09:21:51.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=75 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 76 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=76 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 77 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=77 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 78 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=78 2024-03-25T09:21:51.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 79 2024-03-25T09:21:51.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=79 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 80 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=80 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 81 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=81 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 82 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=82 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 83 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=83 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 84 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=84 2024-03-25T09:21:51.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 85 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=85 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 86 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=86 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 87 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=87 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 88 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:51.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:51.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:51.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:51.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=88 2024-03-25T09:21:52.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:52.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:52.217 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-mon[32732]: pgmap v361: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-25T09:21:52.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 89 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=89 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 90 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=90 2024-03-25T09:21:52.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 91 2024-03-25T09:21:52.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=91 2024-03-25T09:21:52.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 92 2024-03-25T09:21:52.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:51] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=92 2024-03-25T09:21:52.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 93 2024-03-25T09:21:52.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=93 2024-03-25T09:21:52.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 94 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=94 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 95 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=95 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 96 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=96 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 97 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=97 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 98 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=98 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 99 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=99 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 100 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=100 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 101 2024-03-25T09:21:52.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=101 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 102 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=102 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 103 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=103 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 104 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=104 2024-03-25T09:21:52.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 105 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=105 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 106 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=106 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 107 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=107 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 108 2024-03-25T09:21:52.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=108 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 109 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=109 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 110 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=110 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 111 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=111 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 112 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=112 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 113 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=113 2024-03-25T09:21:52.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 114 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=114 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 115 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=115 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 116 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=116 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 117 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=117 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 118 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=118 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 119 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=119 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 120 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=120 2024-03-25T09:21:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:52 smithi019 ceph-mon[29386]: pgmap v361: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-25T09:21:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 121 2024-03-25T09:21:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=121 2024-03-25T09:21:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 122 2024-03-25T09:21:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=122 2024-03-25T09:21:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 123 2024-03-25T09:21:52.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=123 2024-03-25T09:21:52.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 124 2024-03-25T09:21:52.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=124 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 125 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=125 2024-03-25T09:21:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 126 2024-03-25T09:21:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=126 2024-03-25T09:21:52.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 127 2024-03-25T09:21:52.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=127 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 128 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=128 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 129 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=129 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 130 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=130 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 131 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=131 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 132 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=132 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 133 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=133 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 134 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=134 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 135 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=135 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 136 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=136 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 137 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=137 2024-03-25T09:21:52.486 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 138 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=138 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 139 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.487 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=139 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 140 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=140 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 141 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.488 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=141 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 142 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=142 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 143 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=143 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 144 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=144 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 145 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=145 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 146 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.491 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.492 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.492 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.492 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.492 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=146 2024-03-25T09:21:52.492 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.492 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 147 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=147 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 148 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.493 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=148 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 149 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=149 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 150 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=150 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 151 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=151 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 152 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.495 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.496 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.496 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.496 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=152 2024-03-25T09:21:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:52 smithi040 ceph-mon[33094]: pgmap v361: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-25T09:21:52.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 153 2024-03-25T09:21:52.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=153 2024-03-25T09:21:52.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 154 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=154 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 155 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=155 2024-03-25T09:21:52.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 156 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=156 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 157 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=157 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 158 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=158 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 159 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=159 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 160 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=160 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 161 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=161 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 162 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=162 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 163 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=163 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 164 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=164 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 165 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=165 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 166 2024-03-25T09:21:52.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=166 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 167 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=167 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 168 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=168 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 169 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=169 2024-03-25T09:21:52.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 170 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=170 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 171 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=171 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 172 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=172 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 173 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=173 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 174 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=174 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.743 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 175 2024-03-25T09:21:52.744 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.744 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.744 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.744 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=175 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 176 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=176 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 177 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.745 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=177 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 178 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=178 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 179 2024-03-25T09:21:52.746 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=179 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 180 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=180 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 181 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=181 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 182 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=182 2024-03-25T09:21:52.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 183 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=183 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 184 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.749 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=184 2024-03-25T09:21:52.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:52.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:52.985 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:21:52.777+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 185 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=185 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 186 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=186 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 187 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=187 2024-03-25T09:21:52.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 188 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=188 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 189 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=189 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 190 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=190 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 191 2024-03-25T09:21:52.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=191 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 192 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=192 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 193 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=193 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 194 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=194 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 195 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=195 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 196 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=196 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 197 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=197 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 198 2024-03-25T09:21:52.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=198 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 199 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=199 2024-03-25T09:21:52.995 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 200 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=200 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 201 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.996 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=201 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 202 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=202 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 203 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=203 2024-03-25T09:21:52.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:52.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 204 2024-03-25T09:21:52.999 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:52.999 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:52.999 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:52.999 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:52.999 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:52.999 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=204 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 205 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=205 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 206 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.000 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=206 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 207 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=207 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 208 2024-03-25T09:21:53.001 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=208 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 209 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.002 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=209 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 210 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=210 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 211 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.003 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=211 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 212 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=212 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 213 2024-03-25T09:21:53.004 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.005 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.005 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.005 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.005 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.005 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=213 2024-03-25T09:21:53.005 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.005 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 214 2024-03-25T09:21:53.005 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.005 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.005 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=214 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 215 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=215 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.006 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 216 2024-03-25T09:21:53.007 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.007 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.007 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.007 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.007 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.007 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=216 2024-03-25T09:21:53.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 217 2024-03-25T09:21:53.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:52] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=217 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 218 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=218 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 219 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=219 2024-03-25T09:21:53.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 220 2024-03-25T09:21:53.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=220 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 221 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=221 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 222 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=222 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 223 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=223 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 224 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=224 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 225 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=225 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 226 2024-03-25T09:21:53.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=226 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 227 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=227 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 228 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=228 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 229 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=229 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 230 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=230 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 231 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=231 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 232 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=232 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 233 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=233 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 234 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=234 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 235 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=235 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 236 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=236 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 237 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=237 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 238 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=238 2024-03-25T09:21:53.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 239 2024-03-25T09:21:53.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=239 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 240 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=240 2024-03-25T09:21:53.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 241 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=241 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 242 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.254 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=242 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 243 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=243 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 244 2024-03-25T09:21:53.255 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=244 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 245 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=245 2024-03-25T09:21:53.256 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 246 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=246 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 247 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.257 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.258 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=247 2024-03-25T09:21:53.324 INFO:tasks.workunit.client.3.smithi129.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 172.21.15.59:4420: Successful 2024-03-25T09:21:53.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 248 2024-03-25T09:21:53.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=248 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 249 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=249 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 250 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=250 2024-03-25T09:21:53.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 251 2024-03-25T09:21:53.514 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=251 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 252 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=252 2024-03-25T09:21:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 253 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=253 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 254 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=254 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 255 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=255 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 256 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:53.517 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:53.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=256 2024-03-25T09:21:53.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:53.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:53.518 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:53.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:53] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.c TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.59:4420, context: None 2024-03-25T09:21:53.616 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:53] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.b differs from requested gateway client.nvmeof.nvmeof.c 2024-03-25T09:21:53.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:53] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.c TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.59:4420, context: None 2024-03-25T09:21:53.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:53] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.a differs from requested gateway client.nvmeof.nvmeof.c 2024-03-25T09:21:54.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:54.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:54.208 INFO:tasks.workunit.client.3.smithi129.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:54.208 INFO:tasks.workunit.client.3.smithi129.stdout:Adding gateway listener with IP 172.21.15.59 and name nvmeof.nvmeof.c 2024-03-25T09:21:54.208 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-25T09:21:54.208 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Adding gateway listener with IP 172.21.15.59 and name nvmeof.nvmeof.c' 2024-03-25T09:21:54.208 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.59 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --gateway-name client.nvmeof.nvmeof.c --traddr 172.21.15.59 --trsvcid 4420 2024-03-25T09:21:54.307 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:54Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:54 smithi019 ceph-mon[29386]: pgmap v362: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-25T09:21:54.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:54 smithi059 ceph-mon[32732]: pgmap v362: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-25T09:21:54.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:54 smithi040 ceph-mon[33094]: pgmap v362: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-25T09:21:54.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:54.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:55.310 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.c TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.59:4420, context: 2024-03-25T09:21:55.310 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2001: create_listener: True 2024-03-25T09:21:55.310 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:21:55.310 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : optimized for group : 1 2024-03-25T09:21:55.310 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.310 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.310 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.310 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.310 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.310 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='optimized' anagrpid=1 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 2 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=2 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 3 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=3 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 4 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=4 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 5 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.313 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=5 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 6 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=6 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 7 2024-03-25T09:21:55.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=7 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 8 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=8 2024-03-25T09:21:55.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 9 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=9 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 10 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.316 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=10 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 11 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=11 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 12 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.317 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=12 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 13 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=13 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 14 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=14 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 15 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=15 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 16 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=16 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 17 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=17 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 18 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=18 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 19 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=19 2024-03-25T09:21:55.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 20 2024-03-25T09:21:55.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=20 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 21 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=21 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 22 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=22 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 23 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=23 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 24 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=24 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 25 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=25 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 26 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=26 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 27 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=27 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 28 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=28 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 29 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=29 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 30 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=30 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 31 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=31 2024-03-25T09:21:55.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 32 2024-03-25T09:21:55.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=32 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 33 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=33 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 34 2024-03-25T09:21:55.566 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=34 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 35 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=35 2024-03-25T09:21:55.567 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.568 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 36 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=36 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 37 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.569 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=37 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 38 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=38 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 39 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.570 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=39 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 40 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=40 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 41 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.571 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=41 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 42 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=42 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.572 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 43 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=43 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 44 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=44 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 45 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=45 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 46 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=46 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 47 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=47 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 48 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=48 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 49 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=49 2024-03-25T09:21:55.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 50 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=50 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 51 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=51 2024-03-25T09:21:55.577 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 52 2024-03-25T09:21:55.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=52 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 53 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=53 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 54 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=54 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 55 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=55 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 56 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=56 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 57 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=57 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 58 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=58 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 59 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=59 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 60 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=60 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 61 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=61 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 62 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=62 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 63 2024-03-25T09:21:55.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=63 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 64 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=64 2024-03-25T09:21:55.821 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 65 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=65 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 66 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.822 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=66 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 67 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=67 2024-03-25T09:21:55.823 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.824 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 68 2024-03-25T09:21:55.824 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.824 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.824 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=68 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 69 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=69 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 70 2024-03-25T09:21:55.825 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=70 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 71 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=71 2024-03-25T09:21:55.826 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.827 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 72 2024-03-25T09:21:55.827 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.827 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.827 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.827 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.827 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.827 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=72 2024-03-25T09:21:55.827 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 73 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=73 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 74 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.828 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=74 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 75 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=75 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 76 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.829 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=76 2024-03-25T09:21:55.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 77 2024-03-25T09:21:55.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=77 2024-03-25T09:21:55.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 78 2024-03-25T09:21:55.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=78 2024-03-25T09:21:55.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 79 2024-03-25T09:21:55.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=79 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 80 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=80 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 81 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=81 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 82 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=82 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 83 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=83 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 84 2024-03-25T09:21:55.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=84 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 85 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=85 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 86 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=86 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 87 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=87 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 88 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=88 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 89 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=89 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 90 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=90 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 91 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=91 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 92 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=92 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 93 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=93 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 94 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=94 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 95 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=95 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 96 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:55.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:55.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:55.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:55.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:55.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=96 2024-03-25T09:21:56.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:56.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:56.077 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-mon[32732]: pgmap v363: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:21:56.077 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-mon[32732]: Health check failed: 2 slow ops, oldest one blocked for 33 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 97 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=97 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 98 2024-03-25T09:21:56.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=98 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 99 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=99 2024-03-25T09:21:56.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 100 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=100 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 101 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=101 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 102 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=102 2024-03-25T09:21:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 103 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=103 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 104 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.083 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=104 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 105 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=105 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 106 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=106 2024-03-25T09:21:56.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 107 2024-03-25T09:21:56.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=107 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 108 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=108 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 109 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=109 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 110 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=110 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 111 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=111 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 112 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=112 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 113 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=113 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 114 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=114 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 115 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=115 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 116 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=116 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 117 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=117 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 118 2024-03-25T09:21:56.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:55] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=118 2024-03-25T09:21:56.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 119 2024-03-25T09:21:56.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=119 2024-03-25T09:21:56.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 120 2024-03-25T09:21:56.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=120 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 121 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=121 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 122 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=122 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 123 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=123 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 124 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=124 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 125 2024-03-25T09:21:56.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=125 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 126 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=126 2024-03-25T09:21:56.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 127 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=127 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 128 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=128 2024-03-25T09:21:56.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 129 2024-03-25T09:21:56.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=129 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 130 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=130 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 131 2024-03-25T09:21:56.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.336 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.336 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.336 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.336 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.336 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=131 2024-03-25T09:21:56.336 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.337 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 132 2024-03-25T09:21:56.337 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=132 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 133 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=133 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 134 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=134 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 135 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=135 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 136 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=136 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 137 2024-03-25T09:21:56.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=137 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 138 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=138 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 139 2024-03-25T09:21:56.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=139 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 140 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=140 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 141 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=141 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 142 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=142 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 143 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=143 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 144 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=144 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 145 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=145 2024-03-25T09:21:56.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 146 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=146 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 147 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=147 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 148 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=148 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 149 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=149 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 150 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=150 2024-03-25T09:21:56.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 151 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=151 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 152 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=152 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 153 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=153 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 154 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=154 2024-03-25T09:21:56.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 155 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=155 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 156 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=156 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 157 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=157 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 158 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=158 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 159 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=159 2024-03-25T09:21:56.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 160 2024-03-25T09:21:56.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=160 2024-03-25T09:21:56.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:56 smithi019 ceph-mon[29386]: pgmap v363: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:21:56.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:56 smithi019 ceph-mon[29386]: Health check failed: 2 slow ops, oldest one blocked for 33 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:21:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:56 smithi040 ceph-mon[33094]: pgmap v363: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:21:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:56 smithi040 ceph-mon[33094]: Health check failed: 2 slow ops, oldest one blocked for 33 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:21:56.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 161 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=161 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 162 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=162 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 163 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=163 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 164 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=164 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 165 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=165 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.593 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 166 2024-03-25T09:21:56.594 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.594 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.594 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.594 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.594 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.594 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=166 2024-03-25T09:21:56.594 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.594 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 167 2024-03-25T09:21:56.595 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=167 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 168 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=168 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 169 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=169 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 170 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.597 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=170 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 171 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=171 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 172 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=172 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 173 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=173 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 174 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=174 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 175 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=175 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 176 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=176 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 177 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=177 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 178 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=178 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 179 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=179 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 180 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=180 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 181 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=181 2024-03-25T09:21:56.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 182 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=182 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 183 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=183 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 184 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=184 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 185 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=185 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 186 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=186 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 187 2024-03-25T09:21:56.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=187 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 188 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=188 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 189 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=189 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 190 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=190 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 191 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=191 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 192 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.611 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.611 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.611 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=192 2024-03-25T09:21:56.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 193 2024-03-25T09:21:56.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=193 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 194 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=194 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 195 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=195 2024-03-25T09:21:56.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 196 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=196 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 197 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.849 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=197 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 198 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=198 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 199 2024-03-25T09:21:56.850 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=199 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 200 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=200 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.851 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 201 2024-03-25T09:21:56.852 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.852 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.852 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.852 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.852 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.852 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=201 2024-03-25T09:21:56.852 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.852 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 202 2024-03-25T09:21:56.852 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.853 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.853 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.853 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.853 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.853 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=202 2024-03-25T09:21:56.853 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 203 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=203 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 204 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=204 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 205 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=205 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 206 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=206 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 207 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=207 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 208 2024-03-25T09:21:56.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=208 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 209 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=209 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 210 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=210 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 211 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=211 2024-03-25T09:21:56.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 212 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=212 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 213 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=213 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 214 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=214 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 215 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=215 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 216 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=216 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 217 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=217 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 218 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=218 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 219 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=219 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 220 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=220 2024-03-25T09:21:56.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 221 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=221 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 222 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=222 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 223 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=223 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 224 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:56.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:56.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:56.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=224 2024-03-25T09:21:56.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:56.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 225 2024-03-25T09:21:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=225 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 226 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=226 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 227 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=227 2024-03-25T09:21:57.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 228 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=228 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 229 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=229 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 230 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=230 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 231 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=231 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 232 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=232 2024-03-25T09:21:57.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 233 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=233 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 234 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=234 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 235 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=235 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 236 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=236 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 237 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=237 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 238 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=238 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 239 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=239 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 240 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.111 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=240 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 241 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=241 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.112 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 242 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=242 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 243 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:56] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=243 2024-03-25T09:21:57.113 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 244 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=244 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 245 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=245 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 246 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=246 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 247 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.116 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.116 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.116 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.116 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=247 2024-03-25T09:21:57.116 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.116 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 248 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=248 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 249 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=249 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 250 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=250 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 251 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.118 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=251 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 252 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=252 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 253 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.119 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=253 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 254 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=254 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 255 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.120 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=255 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2034: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 256 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:57.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=256 2024-03-25T09:21:57.122 INFO:tasks.workunit.client.3.smithi129.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 172.21.15.59:4420: Successful 2024-03-25T09:21:57.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:57] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.c TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.59:4420, context: None 2024-03-25T09:21:57.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:57] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.a differs from requested gateway client.nvmeof.nvmeof.c 2024-03-25T09:21:57.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:57.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:57.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:21:57.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:57] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.c TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.59:4420, context: None 2024-03-25T09:21:57.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:57] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.b differs from requested gateway client.nvmeof.nvmeof.c 2024-03-25T09:21:58.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:58.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:21:58.025 INFO:tasks.workunit.client.3.smithi129.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:21:58.025 INFO:tasks.workunit.client.3.smithi129.stdout:Adding gateway listener with IP 172.21.15.59 and name nvmeof.nvmeof.c 2024-03-25T09:21:58.026 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-25T09:21:58.026 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Adding gateway listener with IP 172.21.15.59 and name nvmeof.nvmeof.c' 2024-03-25T09:21:58.026 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.59 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --gateway-name client.nvmeof.nvmeof.c --traddr 172.21.15.59 --trsvcid 4420 2024-03-25T09:21:58.057 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:21:57.777+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:21:58.115 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:21:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:21:58.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:21:58 smithi019 ceph-mon[29386]: pgmap v364: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:58.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-mon[32732]: pgmap v364: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:58.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:21:58 smithi040 ceph-mon[33094]: pgmap v364: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:21:58.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:21:58.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:21:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:21:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:21:59.062 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.c TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.59:4420, context: 2024-03-25T09:21:59.062 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2001: create_listener: True 2024-03-25T09:21:59.062 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:21:59.062 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.062 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=1 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=2 2024-03-25T09:21:59.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=3 2024-03-25T09:21:59.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=4 2024-03-25T09:21:59.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=5 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=6 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=7 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=8 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=9 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=10 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.070 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=11 2024-03-25T09:21:59.071 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.071 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.071 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.071 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.071 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.071 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.071 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=12 2024-03-25T09:21:59.071 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.071 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.071 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=13 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=14 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=15 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=16 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=17 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=18 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=19 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=20 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=21 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=22 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=23 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:58] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=24 2024-03-25T09:21:59.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=25 2024-03-25T09:21:59.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=26 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=27 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=28 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=29 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=30 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=31 2024-03-25T09:21:59.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=32 2024-03-25T09:21:59.318 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=33 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=34 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=35 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=36 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=37 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=38 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=39 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.322 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=40 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=41 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.324 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=42 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=43 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.325 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=44 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=45 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.326 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=46 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=47 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.327 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=48 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=49 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.328 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=50 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=51 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.329 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=52 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=53 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.330 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=54 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=55 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.331 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=56 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=57 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.332 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=58 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=59 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.333 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=60 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=61 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=62 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=63 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.336 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.336 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=64 2024-03-25T09:21:59.574 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=65 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.575 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=66 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=67 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.576 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=68 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=69 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.578 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=70 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=71 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.579 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=72 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=73 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.580 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=74 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=75 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=76 2024-03-25T09:21:59.581 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=77 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.582 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=78 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=79 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=80 2024-03-25T09:21:59.583 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=81 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=82 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.584 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=83 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=84 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.585 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=85 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=86 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.586 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=87 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=88 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.587 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=89 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=90 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=91 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=92 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=93 2024-03-25T09:21:59.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=94 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=95 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=96 2024-03-25T09:21:59.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.830 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=97 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=98 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=99 2024-03-25T09:21:59.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=100 2024-03-25T09:21:59.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=101 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=102 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=103 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=104 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=105 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=106 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=107 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=108 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=109 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=110 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=111 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=112 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=113 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=114 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=115 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=116 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.841 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=117 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=118 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.842 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=119 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=120 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.843 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=121 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=122 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.844 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=123 2024-03-25T09:21:59.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.845 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=124 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=125 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=126 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=127 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:21:59.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=128 2024-03-25T09:22:00.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:00.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:21:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:21:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:00.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-mon[32732]: pgmap v365: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=129 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=130 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=131 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=132 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=133 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.089 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=134 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=135 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.090 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=136 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=137 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.091 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=138 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=139 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=140 2024-03-25T09:22:00.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.093 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=141 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=142 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=143 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=144 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.095 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=145 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=146 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=147 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=148 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:21:59] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.097 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:21:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=149 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=150 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.098 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=151 2024-03-25T09:22:00.099 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.099 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.099 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.099 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.099 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.099 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.099 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=152 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=153 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=154 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=155 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=156 2024-03-25T09:22:00.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=157 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=158 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=159 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=160 2024-03-25T09:22:00.136 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.136 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.136 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.136 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.136 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.136 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.136 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=161 2024-03-25T09:22:00.136 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=162 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=163 2024-03-25T09:22:00.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=164 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=165 2024-03-25T09:22:00.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=166 2024-03-25T09:22:00.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=167 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=168 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=169 2024-03-25T09:22:00.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=170 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=171 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=172 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=173 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.347 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=174 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=175 2024-03-25T09:22:00.348 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=176 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=177 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=178 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.350 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=179 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=180 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=181 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=182 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=183 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=184 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=185 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=186 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.354 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=187 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=188 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.355 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=189 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=190 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.356 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.357 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=191 2024-03-25T09:22:00.357 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.357 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.357 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.357 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.357 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.357 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.357 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=192 2024-03-25T09:22:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:00 smithi019 ceph-mon[29386]: pgmap v365: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:22:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:00 smithi040 ceph-mon[33094]: pgmap v365: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-25T09:22:00.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=193 2024-03-25T09:22:00.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=194 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=195 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=196 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=197 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=198 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=199 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=200 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=201 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=202 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=203 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=204 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=205 2024-03-25T09:22:00.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=206 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=207 2024-03-25T09:22:00.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=208 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=209 2024-03-25T09:22:00.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=210 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=211 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=212 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=213 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=214 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=215 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.611 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.611 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.611 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=216 2024-03-25T09:22:00.611 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.611 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.611 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=217 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=218 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.612 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=219 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=220 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.613 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=221 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=222 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.614 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.615 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.615 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=223 2024-03-25T09:22:00.615 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.615 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.615 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.615 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.615 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.615 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.615 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=224 2024-03-25T09:22:00.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=225 2024-03-25T09:22:00.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.854 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=226 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=227 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.855 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=228 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=229 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=230 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=231 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.858 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=232 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=233 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=234 2024-03-25T09:22:00.859 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=235 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=236 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.860 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=237 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=238 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.861 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=239 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=240 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=241 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=242 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=243 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=244 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=245 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=246 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=247 2024-03-25T09:22:00.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=248 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=249 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=250 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=251 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.868 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=252 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=253 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.869 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=254 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=255 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2036: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: gateway_name: "client.nvmeof.nvmeof.c" 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: traddr: "172.21.15.59" 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: adrfam: ipv4 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: trsvcid: 4420 2024-03-25T09:22:00.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: _ana_state='inaccessible' anagrpid=256 2024-03-25T09:22:00.871 INFO:tasks.workunit.client.3.smithi129.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 172.21.15.59:4420: Successful 2024-03-25T09:22:00.871 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:00.871 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:00.871 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:00] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.c TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.59:4420, context: None 2024-03-25T09:22:00.871 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:00] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.a differs from requested gateway client.nvmeof.nvmeof.c 2024-03-25T09:22:01.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2046: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:01.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:01.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:01.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:00] INFO grpc.py:1975: Received request to create client.nvmeof.nvmeof.c TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.59:4420, context: None 2024-03-25T09:22:01.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:00] INFO grpc.py:2009: Listener not created as gateway client.nvmeof.nvmeof.b differs from requested gateway client.nvmeof.nvmeof.c 2024-03-25T09:22:01.770 INFO:tasks.workunit.client.3.smithi129.stderr:++ seq 1 3 2024-03-25T09:22:01.770 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:22:01.770 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-25T09:22:01.770 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode1 --host '*' 2024-03-25T09:22:01.855 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:01Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:02.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:02.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:02.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:02 smithi019 ceph-mon[29386]: pgmap v366: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:22:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:02 smithi059 ceph-mon[32732]: pgmap v366: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:22:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:02 smithi040 ceph-mon[33094]: pgmap v366: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:22:02.567 INFO:tasks.workunit.client.3.smithi129.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode1: Successful 2024-03-25T09:22:02.875 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:02.778+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:02.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:02] INFO grpc.py:1619: Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:02.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:02] INFO grpc.py:1625: add_host *: True 2024-03-25T09:22:02.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:02.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:02.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:02.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:02] INFO grpc.py:1619: Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:02.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:02] INFO grpc.py:1625: add_host *: True 2024-03-25T09:22:03.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:02] INFO grpc.py:1619: Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:03.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:02] INFO grpc.py:1625: add_host *: True 2024-03-25T09:22:03.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:03.466 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:22:03.467 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-25T09:22:03.467 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode2 --host '*' 2024-03-25T09:22:03.553 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:03Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:04.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:04.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:04.243 INFO:tasks.workunit.client.3.smithi129.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode2: Successful 2024-03-25T09:22:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:04 smithi019 ceph-mon[29386]: pgmap v367: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:22:04.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:04] INFO grpc.py:1619: Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:04.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:04] INFO grpc.py:1625: add_host *: True 2024-03-25T09:22:04.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:04 smithi059 ceph-mon[32732]: pgmap v367: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:22:04.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:04] INFO grpc.py:1619: Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:04.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:04] INFO grpc.py:1625: add_host *: True 2024-03-25T09:22:04.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:04 smithi040 ceph-mon[33094]: pgmap v367: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:22:04.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:04] INFO grpc.py:1619: Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:04.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:04] INFO grpc.py:1625: add_host *: True 2024-03-25T09:22:04.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:04.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:05.118 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:22:05.118 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-25T09:22:05.118 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode3 --host '*' 2024-03-25T09:22:05.196 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:05Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:05.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:05.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:05.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:05 smithi019 ceph-mon[29386]: Health check update: 2 slow ops, oldest one blocked for 38 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:05.664 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:05 smithi040 ceph-mon[33094]: Health check update: 2 slow ops, oldest one blocked for 38 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:05 smithi059 ceph-mon[32732]: Health check update: 2 slow ops, oldest one blocked for 38 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:05.916 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:05.916 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:05.917 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:05] INFO grpc.py:1619: Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:22:05.918 INFO:tasks.workunit.client.3.smithi129.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode3: Successful 2024-03-25T09:22:06.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:05] INFO grpc.py:1619: Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:22:06.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:05] INFO grpc.py:1625: add_host *: True 2024-03-25T09:22:06.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:05] INFO grpc.py:1619: Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:22:06.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:05] INFO grpc.py:1625: add_host *: True 2024-03-25T09:22:06.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:05] INFO grpc.py:1625: add_host *: True 2024-03-25T09:22:06.562 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:06 smithi019 ceph-mon[29386]: pgmap v368: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 853 B/s wr, 8 op/s 2024-03-25T09:22:06.744 INFO:tasks.workunit.client.3.smithi129.stderr:+ image_index=1 2024-03-25T09:22:06.745 INFO:tasks.workunit.client.3.smithi129.stderr:++ seq 1 3 2024-03-25T09:22:06.745 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:22:06.746 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-25T09:22:06.746 INFO:tasks.workunit.client.3.smithi129.stderr:++ seq 1 20 2024-03-25T09:22:06.746 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:06.747 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage1 2024-03-25T09:22:06.747 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage1 --load-balancing-group 2 2024-03-25T09:22:06.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:06 smithi059 ceph-mon[32732]: pgmap v368: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 853 B/s wr, 8 op/s 2024-03-25T09:22:06.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:06 smithi040 ceph-mon[33094]: pgmap v368: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 853 B/s wr, 8 op/s 2024-03-25T09:22:06.835 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:06Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:06.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:06.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:07.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:06 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:07.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:06 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:07.579 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-25T09:22:07.784 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:826: Received request to add a namespace using NSID 1 and UUID 9348e01d-cee8-403d-bb54-53970ff1ea16 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:07.785 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:294: Received request to create bdev bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 from mypool/myimage1 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:07.785 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:07.587485] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_2_0, nonce 172.21.15.40:0/3841647446, rc 0 2024-03-25T09:22:07.785 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:07.588031] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_2_0, nonce 172.21.15.40:0/3841647446 2024-03-25T09:22:07.785 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:271: Allocated cluster name='cluster_context_2_0' nonce='172.21.15.40:0/3841647446' anagrp=2 2024-03-25T09:22:07.785 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:07.600374] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 rbd disk to lun 2024-03-25T09:22:07.785 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:333: bdev_rbd_create: bdev_9348e01d-cee8-403d-bb54-53970ff1ea16, cluster_name cluster_context_2_0 2024-03-25T09:22:07.785 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:704: Received request to add bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 1 and UUID 9348e01d-cee8-403d-bb54-53970ff1ea16 2024-03-25T09:22:07.785 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:22:07.785 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:07.785 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:07.786 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:765: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:22:07.786 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.786 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 1 2024-03-25T09:22:07.786 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.787 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.787 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.787 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 2 2024-03-25T09:22:07.787 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: OPTIMIZED 2024-03-25T09:22:07.787 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.787 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.787 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 3 2024-03-25T09:22:07.788 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.788 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.788 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.788 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 4 2024-03-25T09:22:07.788 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.788 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.788 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.788 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 5 2024-03-25T09:22:07.788 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.788 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.789 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.789 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 6 2024-03-25T09:22:07.789 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.789 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.789 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.789 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 7 2024-03-25T09:22:07.789 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.790 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.790 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.790 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 8 2024-03-25T09:22:07.790 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.790 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.790 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.790 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 9 2024-03-25T09:22:07.790 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.790 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.790 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 10 2024-03-25T09:22:07.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 11 2024-03-25T09:22:07.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 12 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 13 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 14 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 15 2024-03-25T09:22:07.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 16 2024-03-25T09:22:07.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:07.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.794 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 1 2024-03-25T09:22:07.794 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.794 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.794 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.794 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 2 2024-03-25T09:22:07.794 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: OPTIMIZED 2024-03-25T09:22:07.794 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.794 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.794 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 3 2024-03-25T09:22:07.794 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 4 2024-03-25T09:22:07.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 5 2024-03-25T09:22:07.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 6 2024-03-25T09:22:07.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 7 2024-03-25T09:22:07.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 8 2024-03-25T09:22:07.797 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 9 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 10 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 11 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.798 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 12 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 13 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 14 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 15 2024-03-25T09:22:07.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: states { 2024-03-25T09:22:07.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: grp_id: 16 2024-03-25T09:22:07.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: state: INACCESSIBLE 2024-03-25T09:22:07.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: } 2024-03-25T09:22:07.829 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:07.778+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:07.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: ] 2024-03-25T09:22:07.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:22:07.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode2' prefix='listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.b_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.b_TCP_172.21.15.40_4420'] 2024-03-25T09:22:07.829 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.b_TCP_172.21.15.40_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:22:07.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=1 2024-03-25T09:22:07.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=2 2024-03-25T09:22:07.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=3 2024-03-25T09:22:07.830 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=4 2024-03-25T09:22:07.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=5 2024-03-25T09:22:07.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=6 2024-03-25T09:22:07.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.831 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=7 2024-03-25T09:22:07.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:826: Received request to add a namespace using NSID 1 and UUID 9348e01d-cee8-403d-bb54-53970ff1ea16 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:07.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:294: Received request to create bdev bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 from mypool/myimage1 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:07.831 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:07.590763] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_2_0, nonce 172.21.15.59:0/884707852, rc 0 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:07.591226] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_2_0, nonce 172.21.15.59:0/884707852 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:271: Allocated cluster name='cluster_context_2_0' nonce='172.21.15.59:0/884707852' anagrp=2 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:07.604433] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 rbd disk to lun 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:333: bdev_rbd_create: bdev_9348e01d-cee8-403d-bb54-53970ff1ea16, cluster_name cluster_context_2_0 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:704: Received request to add bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 1 and UUID 9348e01d-cee8-403d-bb54-53970ff1ea16 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:765: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 1 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: OPTIMIZED 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 2 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.832 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 3 2024-03-25T09:22:07.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 4 2024-03-25T09:22:07.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.833 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 5 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 6 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 7 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 8 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 9 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 10 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 11 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 12 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 13 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 14 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 15 2024-03-25T09:22:07.836 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: states { 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: grp_id: 16 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: state: INACCESSIBLE 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: } 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: ] 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode3' prefix='listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.c_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.c_TCP_172.21.15.59_4420'] 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.c_TCP_172.21.15.59_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=1 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=2 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=3 2024-03-25T09:22:07.837 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=4 2024-03-25T09:22:07.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=5 2024-03-25T09:22:07.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=6 2024-03-25T09:22:07.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:07.838 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=7 2024-03-25T09:22:07.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:07] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:07.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:07] INFO grpc.py:294: Received request to create bdev bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 from mypool/myimage1 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:07.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:07.550295] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_2_0, nonce 172.21.15.19:0/1501504769, rc 0 2024-03-25T09:22:07.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:07.550388] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_2_0, nonce 172.21.15.19:0/1501504769 2024-03-25T09:22:07.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:07] INFO grpc.py:271: Allocated cluster name='cluster_context_2_0' nonce='172.21.15.19:0/1501504769' anagrp=2 2024-03-25T09:22:07.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:07.564698] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 rbd disk to lun 2024-03-25T09:22:07.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:07] INFO grpc.py:333: bdev_rbd_create: bdev_9348e01d-cee8-403d-bb54-53970ff1ea16, cluster_name cluster_context_2_0 2024-03-25T09:22:07.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:07] INFO grpc.py:704: Received request to add bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID 9348e01d-cee8-403d-bb54-53970ff1ea16 2024-03-25T09:22:07.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:07] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:22:08.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=8 2024-03-25T09:22:08.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=9 2024-03-25T09:22:08.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=10 2024-03-25T09:22:08.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=11 2024-03-25T09:22:08.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=12 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=13 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=14 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=15 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.c', 'traddr': '172.21.15.59', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=16 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp2 time 1711358527.9087868 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 2 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1478: nsid 1 for nqn nqn.2016-06.io.spdk:cnode1 to recycle: 2024-03-25T09:22:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1484: nsid :1, pool_name: mypool, rbd_name: myimage1, block_size: 512, uuid:9348e01d-cee8-403d-bb54-53970ff1ea16, anagrpid:2 2024-03-25T09:22:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1053: Received request to remove namespace 1 from nqn.2016-06.io.spdk:cnode1 2024-03-25T09:22:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1066: remove_namespace 1: True 2024-03-25T09:22:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:393: Received request to delete bdev bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 2024-03-25T09:22:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:247: Free cluster name='cluster_context_2_0' ret=True 2024-03-25T09:22:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:402: delete_bdev bdev_9348e01d-cee8-403d-bb54-53970ff1ea16: True 2024-03-25T09:22:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1497: Recreate nsid: 1 2024-03-25T09:22:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1498: ns params: {'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'subsys': 'nqn.2016-06.io.spdk:cnode1'} 2024-03-25T09:22:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:294: Received request to create bdev bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 from mypool/myimage1 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:07.947293] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_2_0, nonce 172.21.15.59:0/4198443473, rc 0 2024-03-25T09:22:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:07.947403] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_2_0, nonce 172.21.15.59:0/4198443473 2024-03-25T09:22:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:271: Allocated cluster name='cluster_context_2_0' nonce='172.21.15.59:0/4198443473' anagrp=2 2024-03-25T09:22:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:07.958631] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 rbd disk to lun 2024-03-25T09:22:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:333: bdev_rbd_create: bdev_9348e01d-cee8-403d-bb54-53970ff1ea16, cluster_name cluster_context_2_0 2024-03-25T09:22:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1502: bdev_rbd_create: bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 2024-03-25T09:22:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:704: Received request to add bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 1 and UUID 9348e01d-cee8-403d-bb54-53970ff1ea16 2024-03-25T09:22:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:22:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp2; latency time 0.05816650390625 sec 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp3 time 1711358527.967041 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 3 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp3; latency time 0.00018095970153808594 sec 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp4 time 1711358527.9672809 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 4 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp4; latency time 0.00016736984252929688 sec 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp5 time 1711358527.967506 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 5 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.267 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp5; latency time 0.00016379356384277344 sec 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp6 time 1711358527.9677322 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 6 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp6; latency time 0.00018143653869628906 sec 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp7 time 1711358527.9679887 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 7 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp7; latency time 0.0001709461212158203 sec 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp8 time 1711358527.9682171 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 8 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp8; latency time 0.00016450881958007812 sec 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp9 time 1711358527.968438 2024-03-25T09:22:08.268 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 9 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp9; latency time 0.00016427040100097656 sec 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp10 time 1711358527.9686584 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 10 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp10; latency time 0.000164031982421875 sec 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp11 time 1711358527.9688783 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 11 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp11; latency time 0.00018644332885742188 sec 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp12 time 1711358527.969122 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 12 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.269 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp12; latency time 0.0001659393310546875 sec 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp13 time 1711358527.9693453 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 13 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp13; latency time 0.00017309188842773438 sec 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp14 time 1711358527.9695752 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 14 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp14; latency time 0.00016379356384277344 sec 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp15 time 1711358527.9697945 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 15 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp15; latency time 0.00017213821411132812 sec 2024-03-25T09:22:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1470: == recycle_safe started == for anagrp16 time 1711358527.9700243 2024-03-25T09:22:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1472: Doing loop on 16 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:07] INFO grpc.py:1519: == recycle_safe completed == for anagrp16; latency time 0.00016570091247558594 sec 2024-03-25T09:22:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=8 2024-03-25T09:22:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=9 2024-03-25T09:22:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=10 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=11 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=12 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=13 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=14 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=15 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=16 2024-03-25T09:22:08.272 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode3' prefix='listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.b_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.b_TCP_172.21.15.40_4420'] 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.b_TCP_172.21.15.40_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=1 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=2 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=3 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=4 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=5 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.273 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=6 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=7 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=8 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=9 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=10 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=11 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:07] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=12 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=13 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=14 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=15 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.b', 'traddr': '172.21.15.40', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=16 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp1 time 1711358528.0367143 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 1 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp1; latency time 0.0002505779266357422 sec 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp3 time 1711358528.0370555 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 3 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp3; latency time 0.00021886825561523438 sec 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp4 time 1711358528.037348 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 4 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp4; latency time 0.0002124309539794922 sec 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp5 time 1711358528.037633 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 5 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp5; latency time 0.00021123886108398438 sec 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp6 time 1711358528.037917 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 6 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp6; latency time 0.0002243518829345703 sec 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp7 time 1711358528.038214 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 7 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.276 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp7; latency time 0.0002105236053466797 sec 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp8 time 1711358528.0384963 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 8 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp8; latency time 0.000209808349609375 sec 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp9 time 1711358528.0387783 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 9 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp9; latency time 0.00021028518676757812 sec 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp10 time 1711358528.0390701 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 10 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp10; latency time 0.00021076202392578125 sec 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp11 time 1711358528.0393527 2024-03-25T09:22:08.277 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 11 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp11; latency time 0.00020837783813476562 sec 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp12 time 1711358528.039633 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 12 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp12; latency time 0.00021696090698242188 sec 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp13 time 1711358528.039922 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 13 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp13; latency time 0.0002193450927734375 sec 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp14 time 1711358528.0402133 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 14 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp14; latency time 0.0002090930938720703 sec 2024-03-25T09:22:08.278 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp15 time 1711358528.040494 2024-03-25T09:22:08.279 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 15 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.279 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.279 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp15; latency time 0.00021004676818847656 sec 2024-03-25T09:22:08.279 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1470: == recycle_safe started == for anagrp16 time 1711358528.0407763 2024-03-25T09:22:08.279 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1472: Doing loop on 16 map; subsystem_nsid_anagrp: 2024-03-25T09:22:08.279 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:08.279 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:08] INFO grpc.py:1519: == recycle_safe completed == for anagrp16; latency time 0.0002086162567138672 sec 2024-03-25T09:22:08.429 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:08.429 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:08.429 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage2 2024-03-25T09:22:08.429 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage2 --load-balancing-group 3 2024-03-25T09:22:08.522 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:08Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:08.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:08 smithi019 ceph-mon[29386]: pgmap v369: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.7 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:22:08.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:08.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:09.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:08 smithi059 ceph-mon[32732]: pgmap v369: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.7 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:22:09.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:08 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:09.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:08 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:09.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:08 smithi040 ceph-mon[33094]: pgmap v369: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.7 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-25T09:22:09.303 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-25T09:22:09.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:09] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:09] INFO grpc.py:294: Received request to create bdev bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe from mypool/myimage2 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:09.274987] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_3_0, nonce 172.21.15.19:0/107522112, rc 0 2024-03-25T09:22:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:09.275081] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_3_0, nonce 172.21.15.19:0/107522112 2024-03-25T09:22:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:09] INFO grpc.py:271: Allocated cluster name='cluster_context_3_0' nonce='172.21.15.19:0/107522112' anagrp=3 2024-03-25T09:22:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:09.288791] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe rbd disk to lun 2024-03-25T09:22:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:09] INFO grpc.py:333: bdev_rbd_create: bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe, cluster_name cluster_context_3_0 2024-03-25T09:22:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:09] INFO grpc.py:704: Received request to add bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID ec2f9973-1e51-46f2-b483-e3d5c29585fe 2024-03-25T09:22:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:09] INFO grpc.py:727: subsystem_add_ns: 2 2024-03-25T09:22:09.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:09] INFO grpc.py:826: Received request to add a namespace using NSID 2 and UUID ec2f9973-1e51-46f2-b483-e3d5c29585fe to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:09.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:09] INFO grpc.py:294: Received request to create bdev bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe from mypool/myimage2 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:09.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:09.325670] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_3_0, nonce 172.21.15.40:0/3279197558, rc 0 2024-03-25T09:22:09.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:09.325759] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_3_0, nonce 172.21.15.40:0/3279197558 2024-03-25T09:22:09.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:09] INFO grpc.py:271: Allocated cluster name='cluster_context_3_0' nonce='172.21.15.40:0/3279197558' anagrp=3 2024-03-25T09:22:09.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:09.339064] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe rbd disk to lun 2024-03-25T09:22:09.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:09] INFO grpc.py:333: bdev_rbd_create: bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe, cluster_name cluster_context_3_0 2024-03-25T09:22:09.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:09] INFO grpc.py:704: Received request to add bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 2 and UUID ec2f9973-1e51-46f2-b483-e3d5c29585fe 2024-03-25T09:22:09.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:09] INFO grpc.py:727: subsystem_add_ns: 2 2024-03-25T09:22:09.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:09.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:09] INFO grpc.py:826: Received request to add a namespace using NSID 2 and UUID ec2f9973-1e51-46f2-b483-e3d5c29585fe to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:09.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:09] INFO grpc.py:294: Received request to create bdev bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe from mypool/myimage2 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:09.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:09.319538] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_3_0, nonce 172.21.15.59:0/343269808, rc 0 2024-03-25T09:22:09.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:09.319622] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_3_0, nonce 172.21.15.59:0/343269808 2024-03-25T09:22:09.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:09] INFO grpc.py:271: Allocated cluster name='cluster_context_3_0' nonce='172.21.15.59:0/343269808' anagrp=3 2024-03-25T09:22:09.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:09.332123] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe rbd disk to lun 2024-03-25T09:22:09.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:09] INFO grpc.py:333: bdev_rbd_create: bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe, cluster_name cluster_context_3_0 2024-03-25T09:22:09.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:09] INFO grpc.py:704: Received request to add bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 2 and UUID ec2f9973-1e51-46f2-b483-e3d5c29585fe 2024-03-25T09:22:09.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:09] INFO grpc.py:727: subsystem_add_ns: 2 2024-03-25T09:22:10.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:10.146 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:10.147 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:10.147 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage3 2024-03-25T09:22:10.147 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage3 --load-balancing-group 1 2024-03-25T09:22:10.218 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:10Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:10.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:765: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:22:10.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 1 2024-03-25T09:22:10.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 2 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 3 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: OPTIMIZED 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 4 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 5 2024-03-25T09:22:10.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 6 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 7 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 8 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 9 2024-03-25T09:22:10.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 10 2024-03-25T09:22:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 11 2024-03-25T09:22:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 12 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 13 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 14 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 15 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 16 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 1 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 2 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 3 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: OPTIMIZED 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 4 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 5 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 6 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 7 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 8 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 9 2024-03-25T09:22:10.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 10 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 11 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 12 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 13 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 14 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 15 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 16 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: INACCESSIBLE 2024-03-25T09:22:10.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: ] 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode2' prefix='listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.a_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420'] 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=1 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=2 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=3 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=4 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=5 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=6 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=7 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=8 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=9 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=10 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=11 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=12 2024-03-25T09:22:10.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=13 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=14 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=15 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=16 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode3' prefix='listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.a_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420'] 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=1 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=2 2024-03-25T09:22:10.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=3 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=4 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=5 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=6 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=7 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=8 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=9 2024-03-25T09:22:10.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=10 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=11 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=12 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=13 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=14 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=15 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=16 2024-03-25T09:22:10.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp1 time 1711358530.5091412 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 1 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp1; latency time 0.00046753883361816406 sec 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp2 time 1711358530.5097108 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 2 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1478: nsid 1 for nqn nqn.2016-06.io.spdk:cnode1 to recycle: 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1484: nsid :1, pool_name: mypool, rbd_name: myimage1, block_size: 512, uuid:9348e01d-cee8-403d-bb54-53970ff1ea16, anagrpid:2 2024-03-25T09:22:10.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1053: Received request to remove namespace 1 from nqn.2016-06.io.spdk:cnode1 2024-03-25T09:22:10.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-mon[29386]: pgmap v370: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-25T09:22:10.901 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-mon[29386]: Health check update: 2 slow ops, oldest one blocked for 43 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:10.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1066: remove_namespace 1: True 2024-03-25T09:22:10.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:393: Received request to delete bdev bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 2024-03-25T09:22:10.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:247: Free cluster name='cluster_context_2_0' ret=True 2024-03-25T09:22:10.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:402: delete_bdev bdev_9348e01d-cee8-403d-bb54-53970ff1ea16: True 2024-03-25T09:22:10.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1497: Recreate nsid: 1 2024-03-25T09:22:10.901 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1498: ns params: {'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'subsys': 'nqn.2016-06.io.spdk:cnode1'} 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:294: Received request to create bdev bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 from mypool/myimage1 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:10.547822] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_2_0, nonce 172.21.15.19:0/1541634332, rc 0 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:10.547902] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_2_0, nonce 172.21.15.19:0/1541634332 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:271: Allocated cluster name='cluster_context_2_0' nonce='172.21.15.19:0/1541634332' anagrp=2 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:10.560341] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 rbd disk to lun 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:333: bdev_rbd_create: bdev_9348e01d-cee8-403d-bb54-53970ff1ea16, cluster_name cluster_context_2_0 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1502: bdev_rbd_create: bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:704: Received request to add bdev_9348e01d-cee8-403d-bb54-53970ff1ea16 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 1 and UUID 9348e01d-cee8-403d-bb54-53970ff1ea16 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp2; latency time 0.05898857116699219 sec 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp4 time 1711358530.5687878 2024-03-25T09:22:10.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 4 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp4; latency time 0.00029850006103515625 sec 2024-03-25T09:22:10.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp5 time 1711358530.56916 2024-03-25T09:22:10.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 5 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp5; latency time 0.00029850006103515625 sec 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp6 time 1711358530.5695348 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 6 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp6; latency time 0.0002815723419189453 sec 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp7 time 1711358530.5698876 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 7 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp7; latency time 0.00028014183044433594 sec 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp8 time 1711358530.5702395 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 8 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp8; latency time 0.0002918243408203125 sec 2024-03-25T09:22:10.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp9 time 1711358530.5706036 2024-03-25T09:22:10.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 9 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp9; latency time 0.0002903938293457031 sec 2024-03-25T09:22:10.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp10 time 1711358530.5709658 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 10 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp10; latency time 0.0002772808074951172 sec 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp11 time 1711358530.5713136 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 11 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp11; latency time 0.0002875328063964844 sec 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp12 time 1711358530.5716727 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 12 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp12; latency time 0.00027680397033691406 sec 2024-03-25T09:22:10.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp13 time 1711358530.572021 2024-03-25T09:22:10.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 13 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp13; latency time 0.0002751350402832031 sec 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp14 time 1711358530.5723672 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 14 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp14; latency time 0.00028586387634277344 sec 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp15 time 1711358530.5727243 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 15 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp15; latency time 0.0002765655517578125 sec 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1470: == recycle_safe started == for anagrp16 time 1711358530.5730722 2024-03-25T09:22:10.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1472: Doing loop on 16 map; subsystem_nsid_anagrp: 2024-03-25T09:22:10.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 1 ana_val: 2 2024-03-25T09:22:10.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1476: nsid: 2 ana_val: 3 2024-03-25T09:22:10.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:1519: == recycle_safe completed == for anagrp16; latency time 0.0002765655517578125 sec 2024-03-25T09:22:10.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:10.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:10.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:10.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:294: Received request to create bdev bdev_dad17cdf-8065-4627-8ab8-7463052c2015 from mypool/myimage3 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:10.940 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-25T09:22:11.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-mon[32732]: pgmap v370: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-25T09:22:11.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-mon[32732]: Health check update: 2 slow ops, oldest one blocked for 43 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:10] INFO grpc.py:826: Received request to add a namespace using NSID 3 and UUID dad17cdf-8065-4627-8ab8-7463052c2015 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:10] INFO grpc.py:294: Received request to create bdev bdev_dad17cdf-8065-4627-8ab8-7463052c2015 from mypool/myimage3 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:10.951455] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_1_0, nonce 172.21.15.59:0/1180794581, rc 0 2024-03-25T09:22:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:10.951849] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_1_0, nonce 172.21.15.59:0/1180794581 2024-03-25T09:22:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:10] INFO grpc.py:271: Allocated cluster name='cluster_context_1_0' nonce='172.21.15.59:0/1180794581' anagrp=1 2024-03-25T09:22:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:10.965012] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_dad17cdf-8065-4627-8ab8-7463052c2015 rbd disk to lun 2024-03-25T09:22:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:10] INFO grpc.py:333: bdev_rbd_create: bdev_dad17cdf-8065-4627-8ab8-7463052c2015, cluster_name cluster_context_1_0 2024-03-25T09:22:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:10] INFO grpc.py:704: Received request to add bdev_dad17cdf-8065-4627-8ab8-7463052c2015 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 3 and UUID dad17cdf-8065-4627-8ab8-7463052c2015 2024-03-25T09:22:11.013 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:10] INFO grpc.py:727: subsystem_add_ns: 3 2024-03-25T09:22:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-mon[33094]: pgmap v370: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-25T09:22:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-mon[33094]: Health check update: 2 slow ops, oldest one blocked for 43 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:10] INFO grpc.py:826: Received request to add a namespace using NSID 3 and UUID dad17cdf-8065-4627-8ab8-7463052c2015 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:10] INFO grpc.py:294: Received request to create bdev bdev_dad17cdf-8065-4627-8ab8-7463052c2015 from mypool/myimage3 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:10.946250] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_1_0, nonce 172.21.15.40:0/970369053, rc 0 2024-03-25T09:22:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:10.946348] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_1_0, nonce 172.21.15.40:0/970369053 2024-03-25T09:22:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:10] INFO grpc.py:271: Allocated cluster name='cluster_context_1_0' nonce='172.21.15.40:0/970369053' anagrp=1 2024-03-25T09:22:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:10.959773] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_dad17cdf-8065-4627-8ab8-7463052c2015 rbd disk to lun 2024-03-25T09:22:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:10] INFO grpc.py:333: bdev_rbd_create: bdev_dad17cdf-8065-4627-8ab8-7463052c2015, cluster_name cluster_context_1_0 2024-03-25T09:22:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:10] INFO grpc.py:704: Received request to add bdev_dad17cdf-8065-4627-8ab8-7463052c2015 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 3 and UUID dad17cdf-8065-4627-8ab8-7463052c2015 2024-03-25T09:22:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:10] INFO grpc.py:727: subsystem_add_ns: 3 2024-03-25T09:22:11.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:10.911840] bdev_rbd.c:1062:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_1_0, nonce 172.21.15.19:0/2777322440, rc 0 2024-03-25T09:22:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:10.911942] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_1_0, nonce 172.21.15.19:0/2777322440 2024-03-25T09:22:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:271: Allocated cluster name='cluster_context_1_0' nonce='172.21.15.19:0/2777322440' anagrp=1 2024-03-25T09:22:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:10.925552] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_dad17cdf-8065-4627-8ab8-7463052c2015 rbd disk to lun 2024-03-25T09:22:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:333: bdev_rbd_create: bdev_dad17cdf-8065-4627-8ab8-7463052c2015, cluster_name cluster_context_1_0 2024-03-25T09:22:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:704: Received request to add bdev_dad17cdf-8065-4627-8ab8-7463052c2015 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID dad17cdf-8065-4627-8ab8-7463052c2015 2024-03-25T09:22:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:10] INFO grpc.py:727: subsystem_add_ns: 3 2024-03-25T09:22:11.823 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:11.823 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:11.824 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage4 2024-03-25T09:22:11.824 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage4 --load-balancing-group 2 2024-03-25T09:22:11.915 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:11Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:12.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:12.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:12.699 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-25T09:22:12.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:12 smithi019 ceph-mon[29386]: pgmap v371: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 1023 B/s wr, 26 op/s 2024-03-25T09:22:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:12] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:12] INFO grpc.py:294: Received request to create bdev bdev_35f3505f-88ed-414f-b648-59aa4a961c41 from mypool/myimage4 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:12.683609] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_35f3505f-88ed-414f-b648-59aa4a961c41 rbd disk to lun 2024-03-25T09:22:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:12] INFO grpc.py:333: bdev_rbd_create: bdev_35f3505f-88ed-414f-b648-59aa4a961c41, cluster_name cluster_context_2_0 2024-03-25T09:22:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:12] INFO grpc.py:704: Received request to add bdev_35f3505f-88ed-414f-b648-59aa4a961c41 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID 35f3505f-88ed-414f-b648-59aa4a961c41 2024-03-25T09:22:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:12] INFO grpc.py:727: subsystem_add_ns: 4 2024-03-25T09:22:13.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:12 smithi059 ceph-mon[32732]: pgmap v371: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 1023 B/s wr, 26 op/s 2024-03-25T09:22:13.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:12.778+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:13.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:12] INFO grpc.py:826: Received request to add a namespace using NSID 4 and UUID 35f3505f-88ed-414f-b648-59aa4a961c41 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:13.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:12] INFO grpc.py:294: Received request to create bdev bdev_35f3505f-88ed-414f-b648-59aa4a961c41 from mypool/myimage4 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:13.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:12.708706] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_35f3505f-88ed-414f-b648-59aa4a961c41 rbd disk to lun 2024-03-25T09:22:13.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:12] INFO grpc.py:333: bdev_rbd_create: bdev_35f3505f-88ed-414f-b648-59aa4a961c41, cluster_name cluster_context_2_0 2024-03-25T09:22:13.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:12] INFO grpc.py:704: Received request to add bdev_35f3505f-88ed-414f-b648-59aa4a961c41 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 4 and UUID 35f3505f-88ed-414f-b648-59aa4a961c41 2024-03-25T09:22:13.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:12] INFO grpc.py:727: subsystem_add_ns: 4 2024-03-25T09:22:13.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:13.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:13.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:12 smithi040 ceph-mon[33094]: pgmap v371: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 1023 B/s wr, 26 op/s 2024-03-25T09:22:13.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:12] INFO grpc.py:826: Received request to add a namespace using NSID 4 and UUID 35f3505f-88ed-414f-b648-59aa4a961c41 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:13.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:12] INFO grpc.py:294: Received request to create bdev bdev_35f3505f-88ed-414f-b648-59aa4a961c41 from mypool/myimage4 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:13.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:12.707620] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_35f3505f-88ed-414f-b648-59aa4a961c41 rbd disk to lun 2024-03-25T09:22:13.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:12] INFO grpc.py:333: bdev_rbd_create: bdev_35f3505f-88ed-414f-b648-59aa4a961c41, cluster_name cluster_context_2_0 2024-03-25T09:22:13.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:12] INFO grpc.py:704: Received request to add bdev_35f3505f-88ed-414f-b648-59aa4a961c41 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 4 and UUID 35f3505f-88ed-414f-b648-59aa4a961c41 2024-03-25T09:22:13.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:12] INFO grpc.py:727: subsystem_add_ns: 4 2024-03-25T09:22:13.523 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:13.523 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:13.523 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage5 2024-03-25T09:22:13.523 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage5 --load-balancing-group 3 2024-03-25T09:22:13.621 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:13Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:14.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:14.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:14.366 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 5 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-25T09:22:14.596 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:14] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:14.596 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:14] INFO grpc.py:294: Received request to create bdev bdev_94a7c175-9506-4f46-951b-5cfcf9926b02 from mypool/myimage5 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:14.596 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:14.350774] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_94a7c175-9506-4f46-951b-5cfcf9926b02 rbd disk to lun 2024-03-25T09:22:14.596 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:14] INFO grpc.py:333: bdev_rbd_create: bdev_94a7c175-9506-4f46-951b-5cfcf9926b02, cluster_name cluster_context_3_0 2024-03-25T09:22:14.596 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:14] INFO grpc.py:704: Received request to add bdev_94a7c175-9506-4f46-951b-5cfcf9926b02 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID 94a7c175-9506-4f46-951b-5cfcf9926b02 2024-03-25T09:22:14.596 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:14] INFO grpc.py:727: subsystem_add_ns: 5 2024-03-25T09:22:14.596 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:14.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:14] INFO grpc.py:826: Received request to add a namespace using NSID 5 and UUID 94a7c175-9506-4f46-951b-5cfcf9926b02 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:14.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:14] INFO grpc.py:294: Received request to create bdev bdev_94a7c175-9506-4f46-951b-5cfcf9926b02 from mypool/myimage5 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:14.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:14.377248] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_94a7c175-9506-4f46-951b-5cfcf9926b02 rbd disk to lun 2024-03-25T09:22:14.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:14] INFO grpc.py:333: bdev_rbd_create: bdev_94a7c175-9506-4f46-951b-5cfcf9926b02, cluster_name cluster_context_3_0 2024-03-25T09:22:14.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:14] INFO grpc.py:704: Received request to add bdev_94a7c175-9506-4f46-951b-5cfcf9926b02 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 5 and UUID 94a7c175-9506-4f46-951b-5cfcf9926b02 2024-03-25T09:22:14.748 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:14] INFO grpc.py:727: subsystem_add_ns: 5 2024-03-25T09:22:14.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:14] INFO grpc.py:826: Received request to add a namespace using NSID 5 and UUID 94a7c175-9506-4f46-951b-5cfcf9926b02 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:14.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:14] INFO grpc.py:294: Received request to create bdev bdev_94a7c175-9506-4f46-951b-5cfcf9926b02 from mypool/myimage5 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:14.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:14.376174] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_94a7c175-9506-4f46-951b-5cfcf9926b02 rbd disk to lun 2024-03-25T09:22:14.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:14] INFO grpc.py:333: bdev_rbd_create: bdev_94a7c175-9506-4f46-951b-5cfcf9926b02, cluster_name cluster_context_3_0 2024-03-25T09:22:14.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:14] INFO grpc.py:704: Received request to add bdev_94a7c175-9506-4f46-951b-5cfcf9926b02 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 5 and UUID 94a7c175-9506-4f46-951b-5cfcf9926b02 2024-03-25T09:22:14.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:14] INFO grpc.py:727: subsystem_add_ns: 5 2024-03-25T09:22:14.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:14 smithi019 ceph-mon[29386]: pgmap v372: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 1023 B/s wr, 26 op/s 2024-03-25T09:22:14.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:15.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:14 smithi059 ceph-mon[32732]: pgmap v372: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 1023 B/s wr, 26 op/s 2024-03-25T09:22:15.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:15.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:15.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:14 smithi040 ceph-mon[33094]: pgmap v372: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 1023 B/s wr, 26 op/s 2024-03-25T09:22:15.209 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:15.209 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:15.209 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage6 2024-03-25T09:22:15.209 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage6 --load-balancing-group 1 2024-03-25T09:22:15.288 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:15Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:16.007 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:15 smithi019 ceph-mon[29386]: Health check update: 2 slow ops, oldest one blocked for 48 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:16.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:15] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:16.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:15] INFO grpc.py:294: Received request to create bdev bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a from mypool/myimage6 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:16.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:16.007926] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a rbd disk to lun 2024-03-25T09:22:16.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:15 smithi059 ceph-mon[32732]: Health check update: 2 slow ops, oldest one blocked for 48 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:16.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:15 smithi040 ceph-mon[33094]: Health check update: 2 slow ops, oldest one blocked for 48 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:16.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:16.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:16.022 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 6 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-25T09:22:16.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:16] INFO grpc.py:333: bdev_rbd_create: bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a, cluster_name cluster_context_1_0 2024-03-25T09:22:16.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:16] INFO grpc.py:704: Received request to add bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID 5625280c-ac4b-4ac7-8303-2044d130bb4a 2024-03-25T09:22:16.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:16] INFO grpc.py:727: subsystem_add_ns: 6 2024-03-25T09:22:16.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:16 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:16] INFO grpc.py:826: Received request to add a namespace using NSID 6 and UUID 5625280c-ac4b-4ac7-8303-2044d130bb4a to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:16.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:16 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:16] INFO grpc.py:294: Received request to create bdev bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a from mypool/myimage6 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:16.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:16 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:16.034502] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a rbd disk to lun 2024-03-25T09:22:16.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:16 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:16] INFO grpc.py:333: bdev_rbd_create: bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a, cluster_name cluster_context_1_0 2024-03-25T09:22:16.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:16 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:16] INFO grpc.py:704: Received request to add bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 6 and UUID 5625280c-ac4b-4ac7-8303-2044d130bb4a 2024-03-25T09:22:16.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:16 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:16] INFO grpc.py:727: subsystem_add_ns: 6 2024-03-25T09:22:16.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:16] INFO grpc.py:826: Received request to add a namespace using NSID 6 and UUID 5625280c-ac4b-4ac7-8303-2044d130bb4a to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:16.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:16] INFO grpc.py:294: Received request to create bdev bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a from mypool/myimage6 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:16.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:16.032779] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a rbd disk to lun 2024-03-25T09:22:16.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:16] INFO grpc.py:333: bdev_rbd_create: bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a, cluster_name cluster_context_1_0 2024-03-25T09:22:16.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:16] INFO grpc.py:704: Received request to add bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 6 and UUID 5625280c-ac4b-4ac7-8303-2044d130bb4a 2024-03-25T09:22:16.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:16] INFO grpc.py:727: subsystem_add_ns: 6 2024-03-25T09:22:16.825 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:16.826 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:16.826 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage7 2024-03-25T09:22:16.826 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage7 --load-balancing-group 2 2024-03-25T09:22:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:16 smithi019 ceph-mon[29386]: pgmap v373: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 1.7 KiB/s wr, 47 op/s 2024-03-25T09:22:16.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:16.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:16.916 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:16Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:17.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:16 smithi059 ceph-mon[32732]: pgmap v373: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 1.7 KiB/s wr, 47 op/s 2024-03-25T09:22:17.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:16 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:17.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:16 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:17.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:16 smithi040 ceph-mon[33094]: pgmap v373: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 1.7 KiB/s wr, 47 op/s 2024-03-25T09:22:17.654 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 7 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-25T09:22:17.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:17] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:17.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:17] INFO grpc.py:294: Received request to create bdev bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a from mypool/myimage7 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:17.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:17.640039] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a rbd disk to lun 2024-03-25T09:22:17.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:17] INFO grpc.py:333: bdev_rbd_create: bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a, cluster_name cluster_context_2_0 2024-03-25T09:22:17.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:17] INFO grpc.py:704: Received request to add bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID db665a65-d3b0-4cc5-b87c-c623e77ea38a 2024-03-25T09:22:17.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:17] INFO grpc.py:727: subsystem_add_ns: 7 2024-03-25T09:22:18.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:17.778+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:18.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:17] INFO grpc.py:826: Received request to add a namespace using NSID 7 and UUID db665a65-d3b0-4cc5-b87c-c623e77ea38a to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:18.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:17] INFO grpc.py:294: Received request to create bdev bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a from mypool/myimage7 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:18.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:17.667711] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a rbd disk to lun 2024-03-25T09:22:18.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:17] INFO grpc.py:333: bdev_rbd_create: bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a, cluster_name cluster_context_2_0 2024-03-25T09:22:18.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:17] INFO grpc.py:704: Received request to add bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 7 and UUID db665a65-d3b0-4cc5-b87c-c623e77ea38a 2024-03-25T09:22:18.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:17] INFO grpc.py:727: subsystem_add_ns: 7 2024-03-25T09:22:18.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:17] INFO grpc.py:826: Received request to add a namespace using NSID 7 and UUID db665a65-d3b0-4cc5-b87c-c623e77ea38a to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:18.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:17] INFO grpc.py:294: Received request to create bdev bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a from mypool/myimage7 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:18.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:17.664998] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a rbd disk to lun 2024-03-25T09:22:18.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:17] INFO grpc.py:333: bdev_rbd_create: bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a, cluster_name cluster_context_2_0 2024-03-25T09:22:18.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:17] INFO grpc.py:704: Received request to add bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 7 and UUID db665a65-d3b0-4cc5-b87c-c623e77ea38a 2024-03-25T09:22:18.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:17] INFO grpc.py:727: subsystem_add_ns: 7 2024-03-25T09:22:18.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:18.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:18.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:18 smithi019 ceph-mon[29386]: pgmap v374: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s rd, 1.4 KiB/s wr, 52 op/s 2024-03-25T09:22:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:18 smithi059 ceph-mon[32732]: pgmap v374: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s rd, 1.4 KiB/s wr, 52 op/s 2024-03-25T09:22:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:18 smithi040 ceph-mon[33094]: pgmap v374: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s rd, 1.4 KiB/s wr, 52 op/s 2024-03-25T09:22:18.527 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:18.527 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:18.527 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage8 2024-03-25T09:22:18.527 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage8 --load-balancing-group 3 2024-03-25T09:22:18.606 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:18Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:18.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:18.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:19.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:18 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:19.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:18 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:19.322 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 8 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-25T09:22:19.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:19] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:19] INFO grpc.py:294: Received request to create bdev bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d from mypool/myimage8 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:19.308910] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d rbd disk to lun 2024-03-25T09:22:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:19] INFO grpc.py:333: bdev_rbd_create: bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d, cluster_name cluster_context_3_0 2024-03-25T09:22:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:19] INFO grpc.py:704: Received request to add bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID c84ffc5f-6335-4b22-858e-f4e302c3ca1d 2024-03-25T09:22:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:19] INFO grpc.py:727: subsystem_add_ns: 8 2024-03-25T09:22:19.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:19] INFO grpc.py:826: Received request to add a namespace using NSID 8 and UUID c84ffc5f-6335-4b22-858e-f4e302c3ca1d to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:19.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:19] INFO grpc.py:294: Received request to create bdev bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d from mypool/myimage8 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:19.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:19.332982] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d rbd disk to lun 2024-03-25T09:22:19.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:19] INFO grpc.py:333: bdev_rbd_create: bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d, cluster_name cluster_context_3_0 2024-03-25T09:22:19.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:19] INFO grpc.py:704: Received request to add bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 8 and UUID c84ffc5f-6335-4b22-858e-f4e302c3ca1d 2024-03-25T09:22:19.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:19] INFO grpc.py:727: subsystem_add_ns: 8 2024-03-25T09:22:19.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:19.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:19] INFO grpc.py:826: Received request to add a namespace using NSID 8 and UUID c84ffc5f-6335-4b22-858e-f4e302c3ca1d to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:19.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:19] INFO grpc.py:294: Received request to create bdev bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d from mypool/myimage8 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:19.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:19.333880] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d rbd disk to lun 2024-03-25T09:22:19.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:19] INFO grpc.py:333: bdev_rbd_create: bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d, cluster_name cluster_context_3_0 2024-03-25T09:22:19.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:19] INFO grpc.py:704: Received request to add bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 8 and UUID c84ffc5f-6335-4b22-858e-f4e302c3ca1d 2024-03-25T09:22:19.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:19] INFO grpc.py:727: subsystem_add_ns: 8 2024-03-25T09:22:20.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:20.127 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:20.128 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:20.128 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage9 2024-03-25T09:22:20.128 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage9 --load-balancing-group 1 2024-03-25T09:22:20.217 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:20Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:20.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:20 smithi019 ceph-mon[29386]: pgmap v375: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 2.1 KiB/s wr, 70 op/s 2024-03-25T09:22:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:20 smithi059 ceph-mon[32732]: pgmap v375: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 2.1 KiB/s wr, 70 op/s 2024-03-25T09:22:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:20 smithi040 ceph-mon[33094]: pgmap v375: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 2.1 KiB/s wr, 70 op/s 2024-03-25T09:22:20.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:20.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:20.960 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 9 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-25T09:22:21.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:21 smithi059 ceph-mon[32732]: Health check update: 2 slow ops, oldest one blocked for 58 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:21.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:21.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:21.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:20] INFO grpc.py:826: Received request to add a namespace using NSID 9 and UUID cfac5177-80a6-48b3-9cfe-623acba5e940 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:21.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:20] INFO grpc.py:294: Received request to create bdev bdev_cfac5177-80a6-48b3-9cfe-623acba5e940 from mypool/myimage9 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:21.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:20.974089] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_cfac5177-80a6-48b3-9cfe-623acba5e940 rbd disk to lun 2024-03-25T09:22:21.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:20] INFO grpc.py:333: bdev_rbd_create: bdev_cfac5177-80a6-48b3-9cfe-623acba5e940, cluster_name cluster_context_1_0 2024-03-25T09:22:21.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:20] INFO grpc.py:704: Received request to add bdev_cfac5177-80a6-48b3-9cfe-623acba5e940 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 9 and UUID cfac5177-80a6-48b3-9cfe-623acba5e940 2024-03-25T09:22:21.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:20] INFO grpc.py:727: subsystem_add_ns: 9 2024-03-25T09:22:21.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:21 smithi040 ceph-mon[33094]: Health check update: 2 slow ops, oldest one blocked for 58 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:21.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:20] INFO grpc.py:826: Received request to add a namespace using NSID 9 and UUID cfac5177-80a6-48b3-9cfe-623acba5e940 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:21.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:20] INFO grpc.py:294: Received request to create bdev bdev_cfac5177-80a6-48b3-9cfe-623acba5e940 from mypool/myimage9 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:21.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:20.968635] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_cfac5177-80a6-48b3-9cfe-623acba5e940 rbd disk to lun 2024-03-25T09:22:21.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:20] INFO grpc.py:333: bdev_rbd_create: bdev_cfac5177-80a6-48b3-9cfe-623acba5e940, cluster_name cluster_context_1_0 2024-03-25T09:22:21.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:20] INFO grpc.py:704: Received request to add bdev_cfac5177-80a6-48b3-9cfe-623acba5e940 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 9 and UUID cfac5177-80a6-48b3-9cfe-623acba5e940 2024-03-25T09:22:21.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:20] INFO grpc.py:727: subsystem_add_ns: 9 2024-03-25T09:22:21.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:21 smithi019 ceph-mon[29386]: Health check update: 2 slow ops, oldest one blocked for 58 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:21.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:20] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:21.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:20] INFO grpc.py:294: Received request to create bdev bdev_cfac5177-80a6-48b3-9cfe-623acba5e940 from mypool/myimage9 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:21.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:20.946414] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_cfac5177-80a6-48b3-9cfe-623acba5e940 rbd disk to lun 2024-03-25T09:22:21.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:20] INFO grpc.py:333: bdev_rbd_create: bdev_cfac5177-80a6-48b3-9cfe-623acba5e940, cluster_name cluster_context_1_0 2024-03-25T09:22:21.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:20] INFO grpc.py:704: Received request to add bdev_cfac5177-80a6-48b3-9cfe-623acba5e940 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID cfac5177-80a6-48b3-9cfe-623acba5e940 2024-03-25T09:22:21.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:20] INFO grpc.py:727: subsystem_add_ns: 9 2024-03-25T09:22:21.861 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:21.861 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:21.861 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage10 2024-03-25T09:22:21.861 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage10 --load-balancing-group 2 2024-03-25T09:22:21.969 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:21Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:22.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:22.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:22 smithi019 ceph-mon[29386]: pgmap v376: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 1.6 KiB/s wr, 67 op/s 2024-03-25T09:22:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:22 smithi059 ceph-mon[32732]: pgmap v376: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 1.6 KiB/s wr, 67 op/s 2024-03-25T09:22:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:22 smithi040 ceph-mon[33094]: pgmap v376: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 1.6 KiB/s wr, 67 op/s 2024-03-25T09:22:22.693 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 10 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-25T09:22:22.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:22.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:22.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:22] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:22.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:22] INFO grpc.py:294: Received request to create bdev bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d from mypool/myimage10 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:22.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:22.678047] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d rbd disk to lun 2024-03-25T09:22:22.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:22] INFO grpc.py:333: bdev_rbd_create: bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d, cluster_name cluster_context_2_0 2024-03-25T09:22:22.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:22] INFO grpc.py:704: Received request to add bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID 1d4c97a4-a950-45bc-9517-9e4618e2a30d 2024-03-25T09:22:22.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:22] INFO grpc.py:727: subsystem_add_ns: 10 2024-03-25T09:22:22.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:22.778+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:22.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:22] INFO grpc.py:826: Received request to add a namespace using NSID 10 and UUID 1d4c97a4-a950-45bc-9517-9e4618e2a30d to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:22.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:22] INFO grpc.py:294: Received request to create bdev bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d from mypool/myimage10 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:22.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:22.703445] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d rbd disk to lun 2024-03-25T09:22:22.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:22] INFO grpc.py:333: bdev_rbd_create: bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d, cluster_name cluster_context_2_0 2024-03-25T09:22:22.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:22] INFO grpc.py:704: Received request to add bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 10 and UUID 1d4c97a4-a950-45bc-9517-9e4618e2a30d 2024-03-25T09:22:22.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:22] INFO grpc.py:727: subsystem_add_ns: 10 2024-03-25T09:22:22.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:23.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:22] INFO grpc.py:826: Received request to add a namespace using NSID 10 and UUID 1d4c97a4-a950-45bc-9517-9e4618e2a30d to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:23.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:22] INFO grpc.py:294: Received request to create bdev bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d from mypool/myimage10 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:23.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:22.700118] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d rbd disk to lun 2024-03-25T09:22:23.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:22] INFO grpc.py:333: bdev_rbd_create: bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d, cluster_name cluster_context_2_0 2024-03-25T09:22:23.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:22] INFO grpc.py:704: Received request to add bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 10 and UUID 1d4c97a4-a950-45bc-9517-9e4618e2a30d 2024-03-25T09:22:23.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:22] INFO grpc.py:727: subsystem_add_ns: 10 2024-03-25T09:22:23.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:23.538 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:23.538 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:23.538 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage11 2024-03-25T09:22:23.538 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage11 --load-balancing-group 3 2024-03-25T09:22:23.622 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:23Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:24.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:24.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:24.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:24 smithi019 ceph-mon[29386]: pgmap v377: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:22:24.337 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:24 smithi059 ceph-mon[32732]: pgmap v377: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:22:24.337 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 11 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-25T09:22:24.337 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:24 smithi040 ceph-mon[33094]: pgmap v377: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:22:24.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:24] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:24.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:24] INFO grpc.py:294: Received request to create bdev bdev_abf15eea-7fca-456e-a25b-48d067aee8bd from mypool/myimage11 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:24.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:24.323271] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_abf15eea-7fca-456e-a25b-48d067aee8bd rbd disk to lun 2024-03-25T09:22:24.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:24] INFO grpc.py:333: bdev_rbd_create: bdev_abf15eea-7fca-456e-a25b-48d067aee8bd, cluster_name cluster_context_3_0 2024-03-25T09:22:24.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:24] INFO grpc.py:704: Received request to add bdev_abf15eea-7fca-456e-a25b-48d067aee8bd to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID abf15eea-7fca-456e-a25b-48d067aee8bd 2024-03-25T09:22:24.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:24] INFO grpc.py:727: subsystem_add_ns: 11 2024-03-25T09:22:24.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:24.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:24 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:24] INFO grpc.py:826: Received request to add a namespace using NSID 11 and UUID abf15eea-7fca-456e-a25b-48d067aee8bd to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:24.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:24 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:24] INFO grpc.py:294: Received request to create bdev bdev_abf15eea-7fca-456e-a25b-48d067aee8bd from mypool/myimage11 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:24.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:24 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:24.349963] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_abf15eea-7fca-456e-a25b-48d067aee8bd rbd disk to lun 2024-03-25T09:22:24.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:24 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:24] INFO grpc.py:333: bdev_rbd_create: bdev_abf15eea-7fca-456e-a25b-48d067aee8bd, cluster_name cluster_context_3_0 2024-03-25T09:22:24.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:24 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:24] INFO grpc.py:704: Received request to add bdev_abf15eea-7fca-456e-a25b-48d067aee8bd to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 11 and UUID abf15eea-7fca-456e-a25b-48d067aee8bd 2024-03-25T09:22:24.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:24 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:24] INFO grpc.py:727: subsystem_add_ns: 11 2024-03-25T09:22:24.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:24] INFO grpc.py:826: Received request to add a namespace using NSID 11 and UUID abf15eea-7fca-456e-a25b-48d067aee8bd to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:24.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:24] INFO grpc.py:294: Received request to create bdev bdev_abf15eea-7fca-456e-a25b-48d067aee8bd from mypool/myimage11 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:24.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:24.348337] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_abf15eea-7fca-456e-a25b-48d067aee8bd rbd disk to lun 2024-03-25T09:22:24.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:24] INFO grpc.py:333: bdev_rbd_create: bdev_abf15eea-7fca-456e-a25b-48d067aee8bd, cluster_name cluster_context_3_0 2024-03-25T09:22:24.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:24] INFO grpc.py:704: Received request to add bdev_abf15eea-7fca-456e-a25b-48d067aee8bd to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 11 and UUID abf15eea-7fca-456e-a25b-48d067aee8bd 2024-03-25T09:22:24.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:24] INFO grpc.py:727: subsystem_add_ns: 11 2024-03-25T09:22:24.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:25.223 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:25.223 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:25.223 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage12 2024-03-25T09:22:25.223 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage12 --load-balancing-group 1 2024-03-25T09:22:25.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:24 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:25.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:24 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:25.313 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:25Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:26.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:26.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:26.055 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 12 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-25T09:22:26.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-mon[29386]: pgmap v378: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 2.1 KiB/s wr, 68 op/s 2024-03-25T09:22:26.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-mon[29386]: Health check update: 2 slow ops, oldest one blocked for 63 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:26.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:22:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:26] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:26] INFO grpc.py:294: Received request to create bdev bdev_3020f654-8f85-4773-b868-1e2603567d08 from mypool/myimage12 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:26.040216] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_3020f654-8f85-4773-b868-1e2603567d08 rbd disk to lun 2024-03-25T09:22:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:26] INFO grpc.py:333: bdev_rbd_create: bdev_3020f654-8f85-4773-b868-1e2603567d08, cluster_name cluster_context_1_0 2024-03-25T09:22:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:26] INFO grpc.py:704: Received request to add bdev_3020f654-8f85-4773-b868-1e2603567d08 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID 3020f654-8f85-4773-b868-1e2603567d08 2024-03-25T09:22:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:26] INFO grpc.py:727: subsystem_add_ns: 12 2024-03-25T09:22:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-mon[32732]: pgmap v378: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 2.1 KiB/s wr, 68 op/s 2024-03-25T09:22:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-mon[32732]: Health check update: 2 slow ops, oldest one blocked for 63 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:22:26.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:26] INFO grpc.py:826: Received request to add a namespace using NSID 12 and UUID 3020f654-8f85-4773-b868-1e2603567d08 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:26.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:26] INFO grpc.py:294: Received request to create bdev bdev_3020f654-8f85-4773-b868-1e2603567d08 from mypool/myimage12 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:26.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:26.066653] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_3020f654-8f85-4773-b868-1e2603567d08 rbd disk to lun 2024-03-25T09:22:26.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:26] INFO grpc.py:333: bdev_rbd_create: bdev_3020f654-8f85-4773-b868-1e2603567d08, cluster_name cluster_context_1_0 2024-03-25T09:22:26.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:26] INFO grpc.py:704: Received request to add bdev_3020f654-8f85-4773-b868-1e2603567d08 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 12 and UUID 3020f654-8f85-4773-b868-1e2603567d08 2024-03-25T09:22:26.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:26] INFO grpc.py:727: subsystem_add_ns: 12 2024-03-25T09:22:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:26 smithi040 ceph-mon[33094]: pgmap v378: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 2.1 KiB/s wr, 68 op/s 2024-03-25T09:22:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:26 smithi040 ceph-mon[33094]: Health check update: 2 slow ops, oldest one blocked for 63 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:26 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:22:26.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:26] INFO grpc.py:826: Received request to add a namespace using NSID 12 and UUID 3020f654-8f85-4773-b868-1e2603567d08 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:26] INFO grpc.py:294: Received request to create bdev bdev_3020f654-8f85-4773-b868-1e2603567d08 from mypool/myimage12 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:26.065355] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_3020f654-8f85-4773-b868-1e2603567d08 rbd disk to lun 2024-03-25T09:22:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:26] INFO grpc.py:333: bdev_rbd_create: bdev_3020f654-8f85-4773-b868-1e2603567d08, cluster_name cluster_context_1_0 2024-03-25T09:22:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:26] INFO grpc.py:704: Received request to add bdev_3020f654-8f85-4773-b868-1e2603567d08 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 12 and UUID 3020f654-8f85-4773-b868-1e2603567d08 2024-03-25T09:22:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:26] INFO grpc.py:727: subsystem_add_ns: 12 2024-03-25T09:22:26.891 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:26.891 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:26.891 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage13 2024-03-25T09:22:26.891 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage13 --load-balancing-group 2 2024-03-25T09:22:26.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:26.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:26.997 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:27.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:27.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:27.755 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 13 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-25T09:22:27.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:27.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:27.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:27.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:27.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:27.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:27.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:27] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:27.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:27] INFO grpc.py:294: Received request to create bdev bdev_8c66140e-b02b-4f7c-a095-3fba10f63656 from mypool/myimage13 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:27.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:27.740138] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8c66140e-b02b-4f7c-a095-3fba10f63656 rbd disk to lun 2024-03-25T09:22:27.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:27] INFO grpc.py:333: bdev_rbd_create: bdev_8c66140e-b02b-4f7c-a095-3fba10f63656, cluster_name cluster_context_2_0 2024-03-25T09:22:27.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:27] INFO grpc.py:704: Received request to add bdev_8c66140e-b02b-4f7c-a095-3fba10f63656 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID 8c66140e-b02b-4f7c-a095-3fba10f63656 2024-03-25T09:22:27.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:27] INFO grpc.py:727: subsystem_add_ns: 13 2024-03-25T09:22:28.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:27] INFO grpc.py:826: Received request to add a namespace using NSID 13 and UUID 8c66140e-b02b-4f7c-a095-3fba10f63656 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:28.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:27] INFO grpc.py:294: Received request to create bdev bdev_8c66140e-b02b-4f7c-a095-3fba10f63656 from mypool/myimage13 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:28.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:27.766893] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8c66140e-b02b-4f7c-a095-3fba10f63656 rbd disk to lun 2024-03-25T09:22:28.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:27] INFO grpc.py:333: bdev_rbd_create: bdev_8c66140e-b02b-4f7c-a095-3fba10f63656, cluster_name cluster_context_2_0 2024-03-25T09:22:28.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:27] INFO grpc.py:704: Received request to add bdev_8c66140e-b02b-4f7c-a095-3fba10f63656 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 13 and UUID 8c66140e-b02b-4f7c-a095-3fba10f63656 2024-03-25T09:22:28.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:27] INFO grpc.py:727: subsystem_add_ns: 13 2024-03-25T09:22:28.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:27.779+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:28.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:28.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:28.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:27] INFO grpc.py:826: Received request to add a namespace using NSID 13 and UUID 8c66140e-b02b-4f7c-a095-3fba10f63656 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:28.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:27] INFO grpc.py:294: Received request to create bdev bdev_8c66140e-b02b-4f7c-a095-3fba10f63656 from mypool/myimage13 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:28.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:27.769544] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8c66140e-b02b-4f7c-a095-3fba10f63656 rbd disk to lun 2024-03-25T09:22:28.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:27] INFO grpc.py:333: bdev_rbd_create: bdev_8c66140e-b02b-4f7c-a095-3fba10f63656, cluster_name cluster_context_2_0 2024-03-25T09:22:28.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:27] INFO grpc.py:704: Received request to add bdev_8c66140e-b02b-4f7c-a095-3fba10f63656 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 13 and UUID 8c66140e-b02b-4f7c-a095-3fba10f63656 2024-03-25T09:22:28.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:27] INFO grpc.py:727: subsystem_add_ns: 13 2024-03-25T09:22:28.651 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:28.651 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:28.651 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage14 2024-03-25T09:22:28.652 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage14 --load-balancing-group 3 2024-03-25T09:22:28.728 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:28.993 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.993 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:28.994 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:28 smithi059 ceph-mon[32732]: pgmap v379: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 1.5 KiB/s wr, 55 op/s 2024-03-25T09:22:28.994 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"} : dispatch 2024-03-25T09:22:28.994 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:22:28.994 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:22:28.994 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:28 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:29.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:29.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:29.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:28 smithi040 ceph-mon[33094]: pgmap v379: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 1.5 KiB/s wr, 55 op/s 2024-03-25T09:22:29.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"} : dispatch 2024-03-25T09:22:29.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:22:29.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:22:29.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:28 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:29.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:29.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:29.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:28 smithi019 ceph-mon[29386]: pgmap v379: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 1.5 KiB/s wr, 55 op/s 2024-03-25T09:22:29.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"} : dispatch 2024-03-25T09:22:29.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:22:29.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:22:29.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:28 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:22:29.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:29.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:29.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:28 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:29.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:28 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:29.484 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 14 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-25T09:22:29.760 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:29] INFO grpc.py:826: Received request to add a namespace using NSID 14 and UUID e28eedce-ad53-4fcb-b8ca-a4e93d49e613 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:29.760 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:29] INFO grpc.py:294: Received request to create bdev bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613 from mypool/myimage14 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:29.760 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:29.492885] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613 rbd disk to lun 2024-03-25T09:22:29.760 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:29] INFO grpc.py:333: bdev_rbd_create: bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613, cluster_name cluster_context_3_0 2024-03-25T09:22:29.760 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:29] INFO grpc.py:704: Received request to add bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 14 and UUID e28eedce-ad53-4fcb-b8ca-a4e93d49e613 2024-03-25T09:22:29.760 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:29] INFO grpc.py:727: subsystem_add_ns: 14 2024-03-25T09:22:29.761 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:29.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:29] INFO grpc.py:826: Received request to add a namespace using NSID 14 and UUID e28eedce-ad53-4fcb-b8ca-a4e93d49e613 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:29.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:29] INFO grpc.py:294: Received request to create bdev bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613 from mypool/myimage14 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:29.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:29.495062] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613 rbd disk to lun 2024-03-25T09:22:29.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:29] INFO grpc.py:333: bdev_rbd_create: bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613, cluster_name cluster_context_3_0 2024-03-25T09:22:29.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:29] INFO grpc.py:704: Received request to add bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 14 and UUID e28eedce-ad53-4fcb-b8ca-a4e93d49e613 2024-03-25T09:22:29.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:29] INFO grpc.py:727: subsystem_add_ns: 14 2024-03-25T09:22:29.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:29] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:29.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:29] INFO grpc.py:294: Received request to create bdev bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613 from mypool/myimage14 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:29.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:29.468062] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613 rbd disk to lun 2024-03-25T09:22:29.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:29] INFO grpc.py:333: bdev_rbd_create: bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613, cluster_name cluster_context_3_0 2024-03-25T09:22:29.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:29] INFO grpc.py:704: Received request to add bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID e28eedce-ad53-4fcb-b8ca-a4e93d49e613 2024-03-25T09:22:29.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:29] INFO grpc.py:727: subsystem_add_ns: 14 2024-03-25T09:22:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:30.295 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:30.295 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:30.295 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage15 2024-03-25T09:22:30.295 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage15 --load-balancing-group 1 2024-03-25T09:22:30.389 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:30Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:30.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:30 smithi019 ceph-mon[29386]: pgmap v380: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 2.0 KiB/s wr, 58 op/s 2024-03-25T09:22:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:30 smithi059 ceph-mon[32732]: pgmap v380: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 2.0 KiB/s wr, 58 op/s 2024-03-25T09:22:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:30 smithi040 ceph-mon[33094]: pgmap v380: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 2.0 KiB/s wr, 58 op/s 2024-03-25T09:22:31.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:31.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:31.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:31] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:31.182 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 15 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-25T09:22:31.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:31.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:31.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:31] INFO grpc.py:826: Received request to add a namespace using NSID 15 and UUID 980bdbda-0d04-42f7-b22e-3bf9062a7e97 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:31.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:31] INFO grpc.py:294: Received request to create bdev bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97 from mypool/myimage15 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:31.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:31.192296] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97 rbd disk to lun 2024-03-25T09:22:31.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:31] INFO grpc.py:333: bdev_rbd_create: bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97, cluster_name cluster_context_1_0 2024-03-25T09:22:31.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:31] INFO grpc.py:704: Received request to add bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 15 and UUID 980bdbda-0d04-42f7-b22e-3bf9062a7e97 2024-03-25T09:22:31.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:31] INFO grpc.py:727: subsystem_add_ns: 15 2024-03-25T09:22:31.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:31] INFO grpc.py:294: Received request to create bdev bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97 from mypool/myimage15 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:31.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:31.167386] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97 rbd disk to lun 2024-03-25T09:22:31.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:31] INFO grpc.py:333: bdev_rbd_create: bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97, cluster_name cluster_context_1_0 2024-03-25T09:22:31.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:31] INFO grpc.py:704: Received request to add bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID 980bdbda-0d04-42f7-b22e-3bf9062a7e97 2024-03-25T09:22:31.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:31] INFO grpc.py:727: subsystem_add_ns: 15 2024-03-25T09:22:31.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:31] INFO grpc.py:826: Received request to add a namespace using NSID 15 and UUID 980bdbda-0d04-42f7-b22e-3bf9062a7e97 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:31.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:31] INFO grpc.py:294: Received request to create bdev bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97 from mypool/myimage15 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:31.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:31.194888] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97 rbd disk to lun 2024-03-25T09:22:31.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:31] INFO grpc.py:333: bdev_rbd_create: bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97, cluster_name cluster_context_1_0 2024-03-25T09:22:31.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:31] INFO grpc.py:704: Received request to add bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 15 and UUID 980bdbda-0d04-42f7-b22e-3bf9062a7e97 2024-03-25T09:22:31.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:31] INFO grpc.py:727: subsystem_add_ns: 15 2024-03-25T09:22:32.060 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:32.060 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:32.079 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:32.079 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:32.079 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage16 2024-03-25T09:22:32.079 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage16 --load-balancing-group 2 2024-03-25T09:22:32.165 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:32Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:32.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:32 smithi019 ceph-mon[29386]: pgmap v381: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 1.5 KiB/s wr, 55 op/s 2024-03-25T09:22:32.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:32 smithi059 ceph-mon[32732]: pgmap v381: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 1.5 KiB/s wr, 55 op/s 2024-03-25T09:22:32.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:32 smithi040 ceph-mon[33094]: pgmap v381: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 1.5 KiB/s wr, 55 op/s 2024-03-25T09:22:32.903 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 16 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-25T09:22:33.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:33.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:33.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:32] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:33.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:32] INFO grpc.py:294: Received request to create bdev bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d from mypool/myimage16 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:33.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:32.887819] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d rbd disk to lun 2024-03-25T09:22:33.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:32] INFO grpc.py:333: bdev_rbd_create: bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d, cluster_name cluster_context_2_0 2024-03-25T09:22:33.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:32] INFO grpc.py:704: Received request to add bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID 111fd48c-55a6-4b8b-8fc1-ab645d2e177d 2024-03-25T09:22:33.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:32] INFO grpc.py:727: subsystem_add_ns: 16 2024-03-25T09:22:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:32.779+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:33.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:32] INFO grpc.py:826: Received request to add a namespace using NSID 16 and UUID 111fd48c-55a6-4b8b-8fc1-ab645d2e177d to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:33.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:32] INFO grpc.py:294: Received request to create bdev bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d from mypool/myimage16 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:33.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:32.913163] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d rbd disk to lun 2024-03-25T09:22:33.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:32] INFO grpc.py:333: bdev_rbd_create: bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d, cluster_name cluster_context_2_0 2024-03-25T09:22:33.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:32] INFO grpc.py:704: Received request to add bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 16 and UUID 111fd48c-55a6-4b8b-8fc1-ab645d2e177d 2024-03-25T09:22:33.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:32] INFO grpc.py:727: subsystem_add_ns: 16 2024-03-25T09:22:33.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:33.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:33.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:32] INFO grpc.py:826: Received request to add a namespace using NSID 16 and UUID 111fd48c-55a6-4b8b-8fc1-ab645d2e177d to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:33.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:32] INFO grpc.py:294: Received request to create bdev bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d from mypool/myimage16 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:33.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:32.911468] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d rbd disk to lun 2024-03-25T09:22:33.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:32] INFO grpc.py:333: bdev_rbd_create: bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d, cluster_name cluster_context_2_0 2024-03-25T09:22:33.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:32] INFO grpc.py:704: Received request to add bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 16 and UUID 111fd48c-55a6-4b8b-8fc1-ab645d2e177d 2024-03-25T09:22:33.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:32] INFO grpc.py:727: subsystem_add_ns: 16 2024-03-25T09:22:33.830 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:33.830 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:33.830 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage17 2024-03-25T09:22:33.830 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage17 --load-balancing-group 3 2024-03-25T09:22:33.940 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:33Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:34.062 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:34.062 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:34.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:34 smithi019 ceph-mon[29386]: pgmap v382: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-25T09:22:34.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:34 smithi059 ceph-mon[32732]: pgmap v382: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-25T09:22:34.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:34 smithi040 ceph-mon[33094]: pgmap v382: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-25T09:22:34.678 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 17 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-25T09:22:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:34] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:34] INFO grpc.py:294: Received request to create bdev bdev_9042541e-2b4e-4b32-8722-3d8b54f30519 from mypool/myimage17 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:34.663071] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9042541e-2b4e-4b32-8722-3d8b54f30519 rbd disk to lun 2024-03-25T09:22:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:34] INFO grpc.py:333: bdev_rbd_create: bdev_9042541e-2b4e-4b32-8722-3d8b54f30519, cluster_name cluster_context_3_0 2024-03-25T09:22:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:34] INFO grpc.py:704: Received request to add bdev_9042541e-2b4e-4b32-8722-3d8b54f30519 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID 9042541e-2b4e-4b32-8722-3d8b54f30519 2024-03-25T09:22:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:34] INFO grpc.py:727: subsystem_add_ns: 17 2024-03-25T09:22:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:35.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:34] INFO grpc.py:826: Received request to add a namespace using NSID 17 and UUID 9042541e-2b4e-4b32-8722-3d8b54f30519 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:35.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:34] INFO grpc.py:294: Received request to create bdev bdev_9042541e-2b4e-4b32-8722-3d8b54f30519 from mypool/myimage17 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:35.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:34.690077] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9042541e-2b4e-4b32-8722-3d8b54f30519 rbd disk to lun 2024-03-25T09:22:35.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:34] INFO grpc.py:333: bdev_rbd_create: bdev_9042541e-2b4e-4b32-8722-3d8b54f30519, cluster_name cluster_context_3_0 2024-03-25T09:22:35.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:34] INFO grpc.py:704: Received request to add bdev_9042541e-2b4e-4b32-8722-3d8b54f30519 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 17 and UUID 9042541e-2b4e-4b32-8722-3d8b54f30519 2024-03-25T09:22:35.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:34] INFO grpc.py:727: subsystem_add_ns: 17 2024-03-25T09:22:35.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:34] INFO grpc.py:826: Received request to add a namespace using NSID 17 and UUID 9042541e-2b4e-4b32-8722-3d8b54f30519 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:35.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:34] INFO grpc.py:294: Received request to create bdev bdev_9042541e-2b4e-4b32-8722-3d8b54f30519 from mypool/myimage17 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:35.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:34.688970] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9042541e-2b4e-4b32-8722-3d8b54f30519 rbd disk to lun 2024-03-25T09:22:35.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:34] INFO grpc.py:333: bdev_rbd_create: bdev_9042541e-2b4e-4b32-8722-3d8b54f30519, cluster_name cluster_context_3_0 2024-03-25T09:22:35.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:34] INFO grpc.py:704: Received request to add bdev_9042541e-2b4e-4b32-8722-3d8b54f30519 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 17 and UUID 9042541e-2b4e-4b32-8722-3d8b54f30519 2024-03-25T09:22:35.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:34] INFO grpc.py:727: subsystem_add_ns: 17 2024-03-25T09:22:35.305 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:35.305 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:35.481 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:35.482 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:35.482 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage18 2024-03-25T09:22:35.482 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage18 --load-balancing-group 1 2024-03-25T09:22:35.569 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:35Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:35.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:35 smithi019 ceph-mon[29386]: Health check update: 2 slow ops, oldest one blocked for 68 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:35.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:35 smithi059 ceph-mon[32732]: Health check update: 2 slow ops, oldest one blocked for 68 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:35.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:35 smithi040 ceph-mon[33094]: Health check update: 2 slow ops, oldest one blocked for 68 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:36.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:36.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:36.343 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 18 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-25T09:22:36.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:36 smithi019 ceph-mon[29386]: pgmap v383: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 2.1 KiB/s wr, 66 op/s 2024-03-25T09:22:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:36] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:36] INFO grpc.py:294: Received request to create bdev bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068 from mypool/myimage18 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:36.327407] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068 rbd disk to lun 2024-03-25T09:22:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:36] INFO grpc.py:333: bdev_rbd_create: bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068, cluster_name cluster_context_1_0 2024-03-25T09:22:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:36] INFO grpc.py:704: Received request to add bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID ce6b322f-6392-498b-b5fa-c9cae8cff068 2024-03-25T09:22:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:36] INFO grpc.py:727: subsystem_add_ns: 18 2024-03-25T09:22:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:36 smithi059 ceph-mon[32732]: pgmap v383: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 2.1 KiB/s wr, 66 op/s 2024-03-25T09:22:36.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:36] INFO grpc.py:826: Received request to add a namespace using NSID 18 and UUID ce6b322f-6392-498b-b5fa-c9cae8cff068 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:36.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:36] INFO grpc.py:294: Received request to create bdev bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068 from mypool/myimage18 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:36.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:36.353992] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068 rbd disk to lun 2024-03-25T09:22:36.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:36] INFO grpc.py:333: bdev_rbd_create: bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068, cluster_name cluster_context_1_0 2024-03-25T09:22:36.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:36] INFO grpc.py:704: Received request to add bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 18 and UUID ce6b322f-6392-498b-b5fa-c9cae8cff068 2024-03-25T09:22:36.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:36] INFO grpc.py:727: subsystem_add_ns: 18 2024-03-25T09:22:36.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:36 smithi040 ceph-mon[33094]: pgmap v383: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 2.1 KiB/s wr, 66 op/s 2024-03-25T09:22:36.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:36] INFO grpc.py:826: Received request to add a namespace using NSID 18 and UUID ce6b322f-6392-498b-b5fa-c9cae8cff068 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:36.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:36] INFO grpc.py:294: Received request to create bdev bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068 from mypool/myimage18 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:36.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:36.353229] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068 rbd disk to lun 2024-03-25T09:22:36.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:36] INFO grpc.py:333: bdev_rbd_create: bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068, cluster_name cluster_context_1_0 2024-03-25T09:22:36.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:36] INFO grpc.py:704: Received request to add bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 18 and UUID ce6b322f-6392-498b-b5fa-c9cae8cff068 2024-03-25T09:22:36.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:36] INFO grpc.py:727: subsystem_add_ns: 18 2024-03-25T09:22:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:37.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:37.190 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:37.190 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:37.190 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage19 2024-03-25T09:22:37.190 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage19 --load-balancing-group 2 2024-03-25T09:22:37.279 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:37Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:37.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:37.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:37.995 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 19 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-25T09:22:38.063 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:37.779+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:38.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:38.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:38.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:37] INFO grpc.py:826: Received request to add a namespace using NSID 19 and UUID 3372559d-2e5c-4244-ab43-15dfcc15b9ff to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:38.063 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:37] INFO grpc.py:294: Received request to create bdev bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff from mypool/myimage19 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:38.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:38.004897] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff rbd disk to lun 2024-03-25T09:22:38.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:38] INFO grpc.py:333: bdev_rbd_create: bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff, cluster_name cluster_context_2_0 2024-03-25T09:22:38.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:38] INFO grpc.py:704: Received request to add bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 19 and UUID 3372559d-2e5c-4244-ab43-15dfcc15b9ff 2024-03-25T09:22:38.064 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:38] INFO grpc.py:727: subsystem_add_ns: 19 2024-03-25T09:22:38.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:37] INFO grpc.py:826: Received request to add a namespace using NSID 19 and UUID 3372559d-2e5c-4244-ab43-15dfcc15b9ff to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:38.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:37] INFO grpc.py:294: Received request to create bdev bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff from mypool/myimage19 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:38.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:38.007629] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff rbd disk to lun 2024-03-25T09:22:38.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:38] INFO grpc.py:333: bdev_rbd_create: bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff, cluster_name cluster_context_2_0 2024-03-25T09:22:38.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:38] INFO grpc.py:704: Received request to add bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 19 and UUID 3372559d-2e5c-4244-ab43-15dfcc15b9ff 2024-03-25T09:22:38.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:38] INFO grpc.py:727: subsystem_add_ns: 19 2024-03-25T09:22:38.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:38 smithi019 ceph-mon[29386]: pgmap v384: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-25T09:22:38.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:37] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:37] INFO grpc.py:294: Received request to create bdev bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff from mypool/myimage19 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:37.981085] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff rbd disk to lun 2024-03-25T09:22:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:37] INFO grpc.py:333: bdev_rbd_create: bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff, cluster_name cluster_context_2_0 2024-03-25T09:22:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:37] INFO grpc.py:704: Received request to add bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID 3372559d-2e5c-4244-ab43-15dfcc15b9ff 2024-03-25T09:22:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:37] INFO grpc.py:727: subsystem_add_ns: 19 2024-03-25T09:22:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:38 smithi059 ceph-mon[32732]: pgmap v384: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-25T09:22:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:38 smithi040 ceph-mon[33094]: pgmap v384: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-25T09:22:38.875 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:38.875 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:38.875 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage20 2024-03-25T09:22:38.875 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage20 --load-balancing-group 3 2024-03-25T09:22:38.956 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:38Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:39.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:39.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:39.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:39.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:39.693 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 20 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-25T09:22:40.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:39] INFO grpc.py:826: Received request to add a namespace using NSID 20 and UUID a1ef7b58-ccef-4b5e-b39d-ba06291661f6 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:40.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:39] INFO grpc.py:294: Received request to create bdev bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6 from mypool/myimage20 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:40.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:39.703419] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6 rbd disk to lun 2024-03-25T09:22:40.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:39] INFO grpc.py:333: bdev_rbd_create: bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6, cluster_name cluster_context_3_0 2024-03-25T09:22:40.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:39] INFO grpc.py:704: Received request to add bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 20 and UUID a1ef7b58-ccef-4b5e-b39d-ba06291661f6 2024-03-25T09:22:40.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:39] INFO grpc.py:727: subsystem_add_ns: 20 2024-03-25T09:22:40.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:39] INFO grpc.py:826: Received request to add a namespace using NSID 20 and UUID a1ef7b58-ccef-4b5e-b39d-ba06291661f6 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-25T09:22:40.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:39] INFO grpc.py:294: Received request to create bdev bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6 from mypool/myimage20 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:40.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:39.701298] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6 rbd disk to lun 2024-03-25T09:22:40.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:39] INFO grpc.py:333: bdev_rbd_create: bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6, cluster_name cluster_context_3_0 2024-03-25T09:22:40.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:39] INFO grpc.py:704: Received request to add bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 20 and UUID a1ef7b58-ccef-4b5e-b39d-ba06291661f6 2024-03-25T09:22:40.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:39] INFO grpc.py:727: subsystem_add_ns: 20 2024-03-25T09:22:40.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:40.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:40.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:39] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:22:40.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:39] INFO grpc.py:294: Received request to create bdev bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6 from mypool/myimage20 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:40.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:39.677422] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6 rbd disk to lun 2024-03-25T09:22:40.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:39] INFO grpc.py:333: bdev_rbd_create: bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6, cluster_name cluster_context_3_0 2024-03-25T09:22:40.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:39] INFO grpc.py:704: Received request to add bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID a1ef7b58-ccef-4b5e-b39d-ba06291661f6 2024-03-25T09:22:40.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:39] INFO grpc.py:727: subsystem_add_ns: 20 2024-03-25T09:22:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:40 smithi019 ceph-mon[29386]: pgmap v385: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 2.1 KiB/s wr, 65 op/s 2024-03-25T09:22:40.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:40 smithi040 ceph-mon[33094]: pgmap v385: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 2.1 KiB/s wr, 65 op/s 2024-03-25T09:22:40.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:40 smithi059 ceph-mon[32732]: pgmap v385: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 2.1 KiB/s wr, 65 op/s 2024-03-25T09:22:40.543 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:40.543 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:22:40.543 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-25T09:22:40.544 INFO:tasks.workunit.client.3.smithi129.stderr:++ seq 1 20 2024-03-25T09:22:40.544 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:40.545 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage21 2024-03-25T09:22:40.545 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage21 --load-balancing-group 1 2024-03-25T09:22:40.618 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:40Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:41.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:41.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:41.327 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:41 smithi019 ceph-mon[29386]: Health check update: 3 slow ops, oldest one blocked for 78 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:41.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:41 smithi059 ceph-mon[32732]: Health check update: 3 slow ops, oldest one blocked for 78 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:41.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:41] INFO grpc.py:826: Received request to add a namespace using NSID 1 and UUID 0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:41.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:41] INFO grpc.py:294: Received request to create bdev bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 from mypool/myimage21 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:41.353 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-25T09:22:41.353 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:41 smithi040 ceph-mon[33094]: Health check update: 3 slow ops, oldest one blocked for 78 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:41.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:41] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:41.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:41] INFO grpc.py:294: Received request to create bdev bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 from mypool/myimage21 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:41.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:41.338700] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 rbd disk to lun 2024-03-25T09:22:41.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:41] INFO grpc.py:333: bdev_rbd_create: bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8, cluster_name cluster_context_1_0 2024-03-25T09:22:41.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:41] INFO grpc.py:704: Received request to add bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID 0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 2024-03-25T09:22:41.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:41] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:22:41.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:41.364089] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 rbd disk to lun 2024-03-25T09:22:41.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:41] INFO grpc.py:333: bdev_rbd_create: bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8, cluster_name cluster_context_1_0 2024-03-25T09:22:41.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:41] INFO grpc.py:704: Received request to add bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 1 and UUID 0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 2024-03-25T09:22:41.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:41] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:22:41.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:41] INFO grpc.py:826: Received request to add a namespace using NSID 1 and UUID 0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:41.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:41] INFO grpc.py:294: Received request to create bdev bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 from mypool/myimage21 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:41.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:41.365274] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 rbd disk to lun 2024-03-25T09:22:41.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:41] INFO grpc.py:333: bdev_rbd_create: bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8, cluster_name cluster_context_1_0 2024-03-25T09:22:41.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:41] INFO grpc.py:704: Received request to add bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 1 and UUID 0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8 2024-03-25T09:22:41.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:41] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:22:42.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:42.067 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:42.127 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:42.127 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:42.127 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage22 2024-03-25T09:22:42.127 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage22 --load-balancing-group 2 2024-03-25T09:22:42.205 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:42Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:42.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:42 smithi019 ceph-mon[29386]: pgmap v386: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 1.7 KiB/s wr, 73 op/s 2024-03-25T09:22:42.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:42 smithi059 ceph-mon[32732]: pgmap v386: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 1.7 KiB/s wr, 73 op/s 2024-03-25T09:22:42.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:42 smithi040 ceph-mon[33094]: pgmap v386: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 1.7 KiB/s wr, 73 op/s 2024-03-25T09:22:42.958 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-25T09:22:43.054 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:42.780+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 7 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:43.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:42] INFO grpc.py:826: Received request to add a namespace using NSID 2 and UUID 8152cee8-8d2b-415a-ac00-822531debce3 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:43.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:42] INFO grpc.py:294: Received request to create bdev bdev_8152cee8-8d2b-415a-ac00-822531debce3 from mypool/myimage22 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:43.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:42.968370] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8152cee8-8d2b-415a-ac00-822531debce3 rbd disk to lun 2024-03-25T09:22:43.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:42] INFO grpc.py:333: bdev_rbd_create: bdev_8152cee8-8d2b-415a-ac00-822531debce3, cluster_name cluster_context_2_0 2024-03-25T09:22:43.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:42] INFO grpc.py:704: Received request to add bdev_8152cee8-8d2b-415a-ac00-822531debce3 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 2 and UUID 8152cee8-8d2b-415a-ac00-822531debce3 2024-03-25T09:22:43.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:42] INFO grpc.py:727: subsystem_add_ns: 2 2024-03-25T09:22:43.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:42] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:42] INFO grpc.py:294: Received request to create bdev bdev_8152cee8-8d2b-415a-ac00-822531debce3 from mypool/myimage22 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:42.943714] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8152cee8-8d2b-415a-ac00-822531debce3 rbd disk to lun 2024-03-25T09:22:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:42] INFO grpc.py:333: bdev_rbd_create: bdev_8152cee8-8d2b-415a-ac00-822531debce3, cluster_name cluster_context_2_0 2024-03-25T09:22:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:42] INFO grpc.py:704: Received request to add bdev_8152cee8-8d2b-415a-ac00-822531debce3 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID 8152cee8-8d2b-415a-ac00-822531debce3 2024-03-25T09:22:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:42] INFO grpc.py:727: subsystem_add_ns: 2 2024-03-25T09:22:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:42] INFO grpc.py:826: Received request to add a namespace using NSID 2 and UUID 8152cee8-8d2b-415a-ac00-822531debce3 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:42] INFO grpc.py:294: Received request to create bdev bdev_8152cee8-8d2b-415a-ac00-822531debce3 from mypool/myimage22 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:42.965051] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8152cee8-8d2b-415a-ac00-822531debce3 rbd disk to lun 2024-03-25T09:22:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:42] INFO grpc.py:333: bdev_rbd_create: bdev_8152cee8-8d2b-415a-ac00-822531debce3, cluster_name cluster_context_2_0 2024-03-25T09:22:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:42] INFO grpc.py:704: Received request to add bdev_8152cee8-8d2b-415a-ac00-822531debce3 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 2 and UUID 8152cee8-8d2b-415a-ac00-822531debce3 2024-03-25T09:22:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:42] INFO grpc.py:727: subsystem_add_ns: 2 2024-03-25T09:22:43.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:43.786 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:43.786 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:43.786 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage23 2024-03-25T09:22:43.786 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage23 --load-balancing-group 3 2024-03-25T09:22:43.874 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:43Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:44 smithi040 ceph-mon[33094]: pgmap v387: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:22:44.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:44.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:44 smithi019 ceph-mon[29386]: pgmap v387: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:22:44.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:44 smithi059 ceph-mon[32732]: pgmap v387: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:22:44.602 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-25T09:22:44.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:44] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:44.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:44] INFO grpc.py:294: Received request to create bdev bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65 from mypool/myimage23 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:44.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:44.587032] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65 rbd disk to lun 2024-03-25T09:22:44.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:44] INFO grpc.py:333: bdev_rbd_create: bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65, cluster_name cluster_context_3_0 2024-03-25T09:22:44.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:44] INFO grpc.py:704: Received request to add bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID 1b4f6c4b-2e43-4361-953c-a9a83224db65 2024-03-25T09:22:44.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:44] INFO grpc.py:727: subsystem_add_ns: 3 2024-03-25T09:22:44.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:44.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:45.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:44] INFO grpc.py:826: Received request to add a namespace using NSID 3 and UUID 1b4f6c4b-2e43-4361-953c-a9a83224db65 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:45.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:44] INFO grpc.py:294: Received request to create bdev bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65 from mypool/myimage23 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:45.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:44.612722] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65 rbd disk to lun 2024-03-25T09:22:45.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:44] INFO grpc.py:333: bdev_rbd_create: bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65, cluster_name cluster_context_3_0 2024-03-25T09:22:45.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:44] INFO grpc.py:704: Received request to add bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 3 and UUID 1b4f6c4b-2e43-4361-953c-a9a83224db65 2024-03-25T09:22:45.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:44] INFO grpc.py:727: subsystem_add_ns: 3 2024-03-25T09:22:45.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:44] INFO grpc.py:826: Received request to add a namespace using NSID 3 and UUID 1b4f6c4b-2e43-4361-953c-a9a83224db65 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:45.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:44] INFO grpc.py:294: Received request to create bdev bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65 from mypool/myimage23 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:45.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:44.609404] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65 rbd disk to lun 2024-03-25T09:22:45.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:44] INFO grpc.py:333: bdev_rbd_create: bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65, cluster_name cluster_context_3_0 2024-03-25T09:22:45.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:44] INFO grpc.py:704: Received request to add bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 3 and UUID 1b4f6c4b-2e43-4361-953c-a9a83224db65 2024-03-25T09:22:45.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:44] INFO grpc.py:727: subsystem_add_ns: 3 2024-03-25T09:22:45.454 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:45.454 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:45.454 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage24 2024-03-25T09:22:45.454 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage24 --load-balancing-group 1 2024-03-25T09:22:45.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:45.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:45.540 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:45Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:46.265 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:46 smithi040 ceph-mon[33094]: pgmap v388: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 2.2 KiB/s wr, 77 op/s 2024-03-25T09:22:46.266 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:46 smithi040 ceph-mon[33094]: Health check update: 7 slow ops, oldest one blocked for 83 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:46.266 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:46.266 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:46.291 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-25T09:22:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:46 smithi019 ceph-mon[29386]: pgmap v388: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 2.2 KiB/s wr, 77 op/s 2024-03-25T09:22:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:46 smithi019 ceph-mon[29386]: Health check update: 7 slow ops, oldest one blocked for 83 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:46.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:46] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:46.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:46] INFO grpc.py:294: Received request to create bdev bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad from mypool/myimage24 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:46.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:46.276824] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad rbd disk to lun 2024-03-25T09:22:46.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:46] INFO grpc.py:333: bdev_rbd_create: bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad, cluster_name cluster_context_1_0 2024-03-25T09:22:46.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:46] INFO grpc.py:704: Received request to add bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID 84b837fb-53a0-48a0-9c3b-d546be3f13ad 2024-03-25T09:22:46.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:46] INFO grpc.py:727: subsystem_add_ns: 4 2024-03-25T09:22:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:46 smithi059 ceph-mon[32732]: pgmap v388: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 2.2 KiB/s wr, 77 op/s 2024-03-25T09:22:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:46 smithi059 ceph-mon[32732]: Health check update: 7 slow ops, oldest one blocked for 83 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:46.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:46] INFO grpc.py:826: Received request to add a namespace using NSID 4 and UUID 84b837fb-53a0-48a0-9c3b-d546be3f13ad to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:46.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:46] INFO grpc.py:294: Received request to create bdev bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad from mypool/myimage24 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:46.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:46.301859] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad rbd disk to lun 2024-03-25T09:22:46.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:46] INFO grpc.py:333: bdev_rbd_create: bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad, cluster_name cluster_context_1_0 2024-03-25T09:22:46.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:46] INFO grpc.py:704: Received request to add bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 4 and UUID 84b837fb-53a0-48a0-9c3b-d546be3f13ad 2024-03-25T09:22:46.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:46] INFO grpc.py:727: subsystem_add_ns: 4 2024-03-25T09:22:46.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:46] INFO grpc.py:826: Received request to add a namespace using NSID 4 and UUID 84b837fb-53a0-48a0-9c3b-d546be3f13ad to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:46] INFO grpc.py:294: Received request to create bdev bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad from mypool/myimage24 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:46.301016] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad rbd disk to lun 2024-03-25T09:22:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:46] INFO grpc.py:333: bdev_rbd_create: bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad, cluster_name cluster_context_1_0 2024-03-25T09:22:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:46] INFO grpc.py:704: Received request to add bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 4 and UUID 84b837fb-53a0-48a0-9c3b-d546be3f13ad 2024-03-25T09:22:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:46] INFO grpc.py:727: subsystem_add_ns: 4 2024-03-25T09:22:47.113 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:47.113 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:47.113 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage25 2024-03-25T09:22:47.113 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage25 --load-balancing-group 2 2024-03-25T09:22:47.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:47.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:47.204 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:47Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:47.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:47.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:47.943 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 5 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-25T09:22:48.064 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:47.780+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:47] INFO grpc.py:826: Received request to add a namespace using NSID 5 and UUID 10e7459c-f430-4a5b-8236-b9fcbf95f3a9 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:47] INFO grpc.py:294: Received request to create bdev bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9 from mypool/myimage25 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:47.954614] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9 rbd disk to lun 2024-03-25T09:22:48.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:47] INFO grpc.py:333: bdev_rbd_create: bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9, cluster_name cluster_context_2_0 2024-03-25T09:22:48.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:47] INFO grpc.py:704: Received request to add bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 5 and UUID 10e7459c-f430-4a5b-8236-b9fcbf95f3a9 2024-03-25T09:22:48.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:47] INFO grpc.py:727: subsystem_add_ns: 5 2024-03-25T09:22:48.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:48 smithi040 ceph-mon[33094]: pgmap v389: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:22:48.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:48.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:48.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:47] INFO grpc.py:826: Received request to add a namespace using NSID 5 and UUID 10e7459c-f430-4a5b-8236-b9fcbf95f3a9 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:48.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:47] INFO grpc.py:294: Received request to create bdev bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9 from mypool/myimage25 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:48.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:47.952838] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9 rbd disk to lun 2024-03-25T09:22:48.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:47] INFO grpc.py:333: bdev_rbd_create: bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9, cluster_name cluster_context_2_0 2024-03-25T09:22:48.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:47] INFO grpc.py:704: Received request to add bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 5 and UUID 10e7459c-f430-4a5b-8236-b9fcbf95f3a9 2024-03-25T09:22:48.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:47] INFO grpc.py:727: subsystem_add_ns: 5 2024-03-25T09:22:48.338 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:48 smithi059 ceph-mon[32732]: pgmap v389: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:22:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:48 smithi019 ceph-mon[29386]: pgmap v389: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:22:48.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:47] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:48.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:47] INFO grpc.py:294: Received request to create bdev bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9 from mypool/myimage25 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:48.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:47.928488] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9 rbd disk to lun 2024-03-25T09:22:48.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:47] INFO grpc.py:333: bdev_rbd_create: bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9, cluster_name cluster_context_2_0 2024-03-25T09:22:48.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:47] INFO grpc.py:704: Received request to add bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID 10e7459c-f430-4a5b-8236-b9fcbf95f3a9 2024-03-25T09:22:48.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:47] INFO grpc.py:727: subsystem_add_ns: 5 2024-03-25T09:22:48.748 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:48.748 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:48.748 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage26 2024-03-25T09:22:48.748 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage26 --load-balancing-group 3 2024-03-25T09:22:48.824 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:48Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:49.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:49.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:49.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:49.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:49.586 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 6 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-25T09:22:49.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:49] INFO grpc.py:826: Received request to add a namespace using NSID 6 and UUID aad1627f-b632-4c58-9c41-ef7d1846a13e to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:49.844 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:49] INFO grpc.py:294: Received request to create bdev bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e from mypool/myimage26 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:49.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:49.593641] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e rbd disk to lun 2024-03-25T09:22:49.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:49] INFO grpc.py:333: bdev_rbd_create: bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e, cluster_name cluster_context_3_0 2024-03-25T09:22:49.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:49] INFO grpc.py:704: Received request to add bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 6 and UUID aad1627f-b632-4c58-9c41-ef7d1846a13e 2024-03-25T09:22:49.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:49] INFO grpc.py:727: subsystem_add_ns: 6 2024-03-25T09:22:49.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:49.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:49] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:49.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:49] INFO grpc.py:294: Received request to create bdev bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e from mypool/myimage26 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:49.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:49.571450] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e rbd disk to lun 2024-03-25T09:22:49.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:49] INFO grpc.py:333: bdev_rbd_create: bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e, cluster_name cluster_context_3_0 2024-03-25T09:22:49.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:49] INFO grpc.py:704: Received request to add bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID aad1627f-b632-4c58-9c41-ef7d1846a13e 2024-03-25T09:22:49.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:49] INFO grpc.py:727: subsystem_add_ns: 6 2024-03-25T09:22:50.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:49] INFO grpc.py:826: Received request to add a namespace using NSID 6 and UUID aad1627f-b632-4c58-9c41-ef7d1846a13e to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:50.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:49] INFO grpc.py:294: Received request to create bdev bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e from mypool/myimage26 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:50.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:49.595333] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e rbd disk to lun 2024-03-25T09:22:50.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:49] INFO grpc.py:333: bdev_rbd_create: bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e, cluster_name cluster_context_3_0 2024-03-25T09:22:50.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:49] INFO grpc.py:704: Received request to add bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 6 and UUID aad1627f-b632-4c58-9c41-ef7d1846a13e 2024-03-25T09:22:50.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:49] INFO grpc.py:727: subsystem_add_ns: 6 2024-03-25T09:22:50.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:50 smithi040 ceph-mon[33094]: pgmap v390: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 2.2 KiB/s wr, 77 op/s 2024-03-25T09:22:50.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:50.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:50 smithi019 ceph-mon[29386]: pgmap v390: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 2.2 KiB/s wr, 77 op/s 2024-03-25T09:22:50.423 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:50.423 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:50.423 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage27 2024-03-25T09:22:50.424 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage27 --load-balancing-group 1 2024-03-25T09:22:50.499 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:50Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:50.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:50 smithi059 ceph-mon[32732]: pgmap v390: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 2.2 KiB/s wr, 77 op/s 2024-03-25T09:22:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:51.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:51.240 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 7 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-25T09:22:51.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:51.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:51.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:51] INFO grpc.py:826: Received request to add a namespace using NSID 7 and UUID 926c1429-34b4-4551-97c7-318bf5dfa876 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:51.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:51] INFO grpc.py:294: Received request to create bdev bdev_926c1429-34b4-4551-97c7-318bf5dfa876 from mypool/myimage27 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:51.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:51.251583] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_926c1429-34b4-4551-97c7-318bf5dfa876 rbd disk to lun 2024-03-25T09:22:51.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:51] INFO grpc.py:333: bdev_rbd_create: bdev_926c1429-34b4-4551-97c7-318bf5dfa876, cluster_name cluster_context_1_0 2024-03-25T09:22:51.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:51] INFO grpc.py:704: Received request to add bdev_926c1429-34b4-4551-97c7-318bf5dfa876 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 7 and UUID 926c1429-34b4-4551-97c7-318bf5dfa876 2024-03-25T09:22:51.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:51] INFO grpc.py:727: subsystem_add_ns: 7 2024-03-25T09:22:51.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:51] INFO grpc.py:826: Received request to add a namespace using NSID 7 and UUID 926c1429-34b4-4551-97c7-318bf5dfa876 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:51.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:51] INFO grpc.py:294: Received request to create bdev bdev_926c1429-34b4-4551-97c7-318bf5dfa876 from mypool/myimage27 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:51.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:51.249575] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_926c1429-34b4-4551-97c7-318bf5dfa876 rbd disk to lun 2024-03-25T09:22:51.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:51] INFO grpc.py:333: bdev_rbd_create: bdev_926c1429-34b4-4551-97c7-318bf5dfa876, cluster_name cluster_context_1_0 2024-03-25T09:22:51.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:51] INFO grpc.py:704: Received request to add bdev_926c1429-34b4-4551-97c7-318bf5dfa876 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 7 and UUID 926c1429-34b4-4551-97c7-318bf5dfa876 2024-03-25T09:22:51.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:51] INFO grpc.py:727: subsystem_add_ns: 7 2024-03-25T09:22:51.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:51] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:51.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:51] INFO grpc.py:294: Received request to create bdev bdev_926c1429-34b4-4551-97c7-318bf5dfa876 from mypool/myimage27 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:51.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:51.225496] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_926c1429-34b4-4551-97c7-318bf5dfa876 rbd disk to lun 2024-03-25T09:22:51.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:51] INFO grpc.py:333: bdev_rbd_create: bdev_926c1429-34b4-4551-97c7-318bf5dfa876, cluster_name cluster_context_1_0 2024-03-25T09:22:51.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:51] INFO grpc.py:704: Received request to add bdev_926c1429-34b4-4551-97c7-318bf5dfa876 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID 926c1429-34b4-4551-97c7-318bf5dfa876 2024-03-25T09:22:51.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:51] INFO grpc.py:727: subsystem_add_ns: 7 2024-03-25T09:22:52.032 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:52.032 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:52.032 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage28 2024-03-25T09:22:52.032 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage28 --load-balancing-group 2 2024-03-25T09:22:52.122 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:52Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:52 smithi040 ceph-mon[33094]: pgmap v391: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:22:52.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:52.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:52 smithi019 ceph-mon[29386]: pgmap v391: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:22:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:52 smithi059 ceph-mon[32732]: pgmap v391: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:22:52.808 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 8 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-25T09:22:53.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:52.780+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:53.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:52] INFO grpc.py:826: Received request to add a namespace using NSID 8 and UUID 29dba39d-1be4-4646-b04c-d3d692f2847a to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:53.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:52] INFO grpc.py:294: Received request to create bdev bdev_29dba39d-1be4-4646-b04c-d3d692f2847a from mypool/myimage28 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:53.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:52.815493] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_29dba39d-1be4-4646-b04c-d3d692f2847a rbd disk to lun 2024-03-25T09:22:53.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:52] INFO grpc.py:333: bdev_rbd_create: bdev_29dba39d-1be4-4646-b04c-d3d692f2847a, cluster_name cluster_context_2_0 2024-03-25T09:22:53.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:52] INFO grpc.py:704: Received request to add bdev_29dba39d-1be4-4646-b04c-d3d692f2847a to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 8 and UUID 29dba39d-1be4-4646-b04c-d3d692f2847a 2024-03-25T09:22:53.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:52] INFO grpc.py:727: subsystem_add_ns: 8 2024-03-25T09:22:53.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:52] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:52] INFO grpc.py:294: Received request to create bdev bdev_29dba39d-1be4-4646-b04c-d3d692f2847a from mypool/myimage28 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:52.791753] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_29dba39d-1be4-4646-b04c-d3d692f2847a rbd disk to lun 2024-03-25T09:22:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:52] INFO grpc.py:333: bdev_rbd_create: bdev_29dba39d-1be4-4646-b04c-d3d692f2847a, cluster_name cluster_context_2_0 2024-03-25T09:22:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:52] INFO grpc.py:704: Received request to add bdev_29dba39d-1be4-4646-b04c-d3d692f2847a to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID 29dba39d-1be4-4646-b04c-d3d692f2847a 2024-03-25T09:22:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:52] INFO grpc.py:727: subsystem_add_ns: 8 2024-03-25T09:22:53.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:52] INFO grpc.py:826: Received request to add a namespace using NSID 8 and UUID 29dba39d-1be4-4646-b04c-d3d692f2847a to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:53.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:52] INFO grpc.py:294: Received request to create bdev bdev_29dba39d-1be4-4646-b04c-d3d692f2847a from mypool/myimage28 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:53.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:52.818046] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_29dba39d-1be4-4646-b04c-d3d692f2847a rbd disk to lun 2024-03-25T09:22:53.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:52] INFO grpc.py:333: bdev_rbd_create: bdev_29dba39d-1be4-4646-b04c-d3d692f2847a, cluster_name cluster_context_2_0 2024-03-25T09:22:53.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:52] INFO grpc.py:704: Received request to add bdev_29dba39d-1be4-4646-b04c-d3d692f2847a to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 8 and UUID 29dba39d-1be4-4646-b04c-d3d692f2847a 2024-03-25T09:22:53.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:52] INFO grpc.py:727: subsystem_add_ns: 8 2024-03-25T09:22:53.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:53.634 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:53.634 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:53.635 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage29 2024-03-25T09:22:53.635 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage29 --load-balancing-group 3 2024-03-25T09:22:53.718 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:53Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:54.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:54 smithi040 ceph-mon[33094]: pgmap v392: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s rd, 1.4 KiB/s wr, 46 op/s 2024-03-25T09:22:54.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:54.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:54.403 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:54 smithi019 ceph-mon[29386]: pgmap v392: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s rd, 1.4 KiB/s wr, 46 op/s 2024-03-25T09:22:54.430 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:54 smithi059 ceph-mon[32732]: pgmap v392: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s rd, 1.4 KiB/s wr, 46 op/s 2024-03-25T09:22:54.432 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 9 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-25T09:22:54.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:54] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:54.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:54] INFO grpc.py:294: Received request to create bdev bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0 from mypool/myimage29 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:54.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:54.416059] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0 rbd disk to lun 2024-03-25T09:22:54.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:54] INFO grpc.py:333: bdev_rbd_create: bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0, cluster_name cluster_context_3_0 2024-03-25T09:22:54.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:54] INFO grpc.py:704: Received request to add bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID 8303b2b0-3e51-485f-82d6-8c2e377307d0 2024-03-25T09:22:54.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:54] INFO grpc.py:727: subsystem_add_ns: 9 2024-03-25T09:22:54.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:54] INFO grpc.py:826: Received request to add a namespace using NSID 9 and UUID 8303b2b0-3e51-485f-82d6-8c2e377307d0 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:54.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:54] INFO grpc.py:294: Received request to create bdev bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0 from mypool/myimage29 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:54.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:54.440114] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0 rbd disk to lun 2024-03-25T09:22:54.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:54] INFO grpc.py:333: bdev_rbd_create: bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0, cluster_name cluster_context_3_0 2024-03-25T09:22:54.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:54] INFO grpc.py:704: Received request to add bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 9 and UUID 8303b2b0-3e51-485f-82d6-8c2e377307d0 2024-03-25T09:22:54.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:54] INFO grpc.py:727: subsystem_add_ns: 9 2024-03-25T09:22:54.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:54] INFO grpc.py:826: Received request to add a namespace using NSID 9 and UUID 8303b2b0-3e51-485f-82d6-8c2e377307d0 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:54.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:54] INFO grpc.py:294: Received request to create bdev bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0 from mypool/myimage29 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:54.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:54.442234] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0 rbd disk to lun 2024-03-25T09:22:54.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:54] INFO grpc.py:333: bdev_rbd_create: bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0, cluster_name cluster_context_3_0 2024-03-25T09:22:54.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:54] INFO grpc.py:704: Received request to add bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 9 and UUID 8303b2b0-3e51-485f-82d6-8c2e377307d0 2024-03-25T09:22:54.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:54] INFO grpc.py:727: subsystem_add_ns: 9 2024-03-25T09:22:55.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:55.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:55.184 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:55.184 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:55.184 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage30 2024-03-25T09:22:55.184 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage30 --load-balancing-group 1 2024-03-25T09:22:55.268 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:55Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:55.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:55 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 88 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:55.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:55.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:55.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:55 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 88 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:55.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:55 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 88 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:22:55.975 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 10 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-25T09:22:56.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:55] INFO grpc.py:826: Received request to add a namespace using NSID 10 and UUID 8ba967bc-4f6a-4613-9496-8d3412cc4aac to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:56.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:55] INFO grpc.py:294: Received request to create bdev bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac from mypool/myimage30 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:56.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:55.984170] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac rbd disk to lun 2024-03-25T09:22:56.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:55] INFO grpc.py:333: bdev_rbd_create: bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac, cluster_name cluster_context_1_0 2024-03-25T09:22:56.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:55] INFO grpc.py:704: Received request to add bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 10 and UUID 8ba967bc-4f6a-4613-9496-8d3412cc4aac 2024-03-25T09:22:56.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:55] INFO grpc.py:727: subsystem_add_ns: 10 2024-03-25T09:22:56.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:56.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:56.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:55] INFO grpc.py:826: Received request to add a namespace using NSID 10 and UUID 8ba967bc-4f6a-4613-9496-8d3412cc4aac to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:56.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:55] INFO grpc.py:294: Received request to create bdev bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac from mypool/myimage30 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:56.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:55.982445] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac rbd disk to lun 2024-03-25T09:22:56.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:55] INFO grpc.py:333: bdev_rbd_create: bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac, cluster_name cluster_context_1_0 2024-03-25T09:22:56.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:55] INFO grpc.py:704: Received request to add bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 10 and UUID 8ba967bc-4f6a-4613-9496-8d3412cc4aac 2024-03-25T09:22:56.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:55] INFO grpc.py:727: subsystem_add_ns: 10 2024-03-25T09:22:56.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:55] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:56.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:55] INFO grpc.py:294: Received request to create bdev bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac from mypool/myimage30 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:56.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:55.960777] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac rbd disk to lun 2024-03-25T09:22:56.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:55] INFO grpc.py:333: bdev_rbd_create: bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac, cluster_name cluster_context_1_0 2024-03-25T09:22:56.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:55] INFO grpc.py:704: Received request to add bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID 8ba967bc-4f6a-4613-9496-8d3412cc4aac 2024-03-25T09:22:56.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:55] INFO grpc.py:727: subsystem_add_ns: 10 2024-03-25T09:22:56.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:56 smithi019 ceph-mon[29386]: pgmap v393: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 2.0 KiB/s wr, 58 op/s 2024-03-25T09:22:56.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:56 smithi059 ceph-mon[32732]: pgmap v393: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 2.0 KiB/s wr, 58 op/s 2024-03-25T09:22:56.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:56 smithi040 ceph-mon[33094]: pgmap v393: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 2.0 KiB/s wr, 58 op/s 2024-03-25T09:22:56.802 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:56.802 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:56.802 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage31 2024-03-25T09:22:56.802 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage31 --load-balancing-group 2 2024-03-25T09:22:56.896 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:56Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:57.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:57.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:57.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:57.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:57.591 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 11 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-25T09:22:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:57] INFO grpc.py:826: Received request to add a namespace using NSID 11 and UUID 141ddca5-7f42-4f88-96c3-e6bc93fb0d08 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:57] INFO grpc.py:294: Received request to create bdev bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08 from mypool/myimage31 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:57.600924] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08 rbd disk to lun 2024-03-25T09:22:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:57] INFO grpc.py:333: bdev_rbd_create: bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08, cluster_name cluster_context_2_0 2024-03-25T09:22:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:57] INFO grpc.py:704: Received request to add bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 11 and UUID 141ddca5-7f42-4f88-96c3-e6bc93fb0d08 2024-03-25T09:22:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:57] INFO grpc.py:727: subsystem_add_ns: 11 2024-03-25T09:22:57.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:57] INFO grpc.py:826: Received request to add a namespace using NSID 11 and UUID 141ddca5-7f42-4f88-96c3-e6bc93fb0d08 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:57.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:57] INFO grpc.py:294: Received request to create bdev bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08 from mypool/myimage31 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:57.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:57.597832] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08 rbd disk to lun 2024-03-25T09:22:57.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:57] INFO grpc.py:333: bdev_rbd_create: bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08, cluster_name cluster_context_2_0 2024-03-25T09:22:57.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:57] INFO grpc.py:704: Received request to add bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 11 and UUID 141ddca5-7f42-4f88-96c3-e6bc93fb0d08 2024-03-25T09:22:57.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:57] INFO grpc.py:727: subsystem_add_ns: 11 2024-03-25T09:22:57.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:57.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:57] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:57.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:57] INFO grpc.py:294: Received request to create bdev bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08 from mypool/myimage31 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:57.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:57.576490] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08 rbd disk to lun 2024-03-25T09:22:57.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:57] INFO grpc.py:333: bdev_rbd_create: bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08, cluster_name cluster_context_2_0 2024-03-25T09:22:57.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:57] INFO grpc.py:704: Received request to add bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID 141ddca5-7f42-4f88-96c3-e6bc93fb0d08 2024-03-25T09:22:57.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:57] INFO grpc.py:727: subsystem_add_ns: 11 2024-03-25T09:22:58.062 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:22:57.780+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:22:58.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:22:58 smithi040 ceph-mon[33094]: pgmap v394: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-25T09:22:58.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '44 2024-03-25T09:22:58.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: 20'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:22:58.395 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:58.395 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:58.395 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage32 2024-03-25T09:22:58.395 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage32 --load-balancing-group 3 2024-03-25T09:22:58.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:22:58 smithi019 ceph-mon[29386]: pgmap v394: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-25T09:22:58.480 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:22:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:22:58.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:22:58 smithi059 ceph-mon[32732]: pgmap v394: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-25T09:22:59.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:59.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '44 2024-03-25T09:22:59.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: 20'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:22:59.220 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 12 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-25T09:22:59.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:22:59.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 2024-03-25T09:22:59.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:22:59.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:59] INFO grpc.py:826: Received request to add a namespace using NSID 12 and UUID 035b3e5a-d391-4bf4-9e91-07424831f76f to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:59.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:59] INFO grpc.py:294: Received request to create bdev bdev_035b3e5a-d391-4bf4-9e91-07424831f76f from mypool/myimage32 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:59.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:22:59.228408] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_035b3e5a-d391-4bf4-9e91-07424831f76f rbd disk to lun 2024-03-25T09:22:59.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:59] INFO grpc.py:333: bdev_rbd_create: bdev_035b3e5a-d391-4bf4-9e91-07424831f76f, cluster_name cluster_context_3_0 2024-03-25T09:22:59.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:59] INFO grpc.py:704: Received request to add bdev_035b3e5a-d391-4bf4-9e91-07424831f76f to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 12 and UUID 035b3e5a-d391-4bf4-9e91-07424831f76f 2024-03-25T09:22:59.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:22:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:22:59] INFO grpc.py:727: subsystem_add_ns: 12 2024-03-25T09:22:59.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:59] INFO grpc.py:826: Received request to add a namespace using NSID 12 and UUID 035b3e5a-d391-4bf4-9e91-07424831f76f to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:22:59.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:59] INFO grpc.py:294: Received request to create bdev bdev_035b3e5a-d391-4bf4-9e91-07424831f76f from mypool/myimage32 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:59.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:22:59.230753] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_035b3e5a-d391-4bf4-9e91-07424831f76f rbd disk to lun 2024-03-25T09:22:59.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:59] INFO grpc.py:333: bdev_rbd_create: bdev_035b3e5a-d391-4bf4-9e91-07424831f76f, cluster_name cluster_context_3_0 2024-03-25T09:22:59.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:59] INFO grpc.py:704: Received request to add bdev_035b3e5a-d391-4bf4-9e91-07424831f76f to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 12 and UUID 035b3e5a-d391-4bf4-9e91-07424831f76f 2024-03-25T09:22:59.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:59] INFO grpc.py:727: subsystem_add_ns: 12 2024-03-25T09:22:59.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:59] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:22:59.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:59] INFO grpc.py:294: Received request to create bdev bdev_035b3e5a-d391-4bf4-9e91-07424831f76f from mypool/myimage32 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:22:59.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:22:59.205738] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_035b3e5a-d391-4bf4-9e91-07424831f76f rbd disk to lun 2024-03-25T09:22:59.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:59] INFO grpc.py:333: bdev_rbd_create: bdev_035b3e5a-d391-4bf4-9e91-07424831f76f, cluster_name cluster_context_3_0 2024-03-25T09:22:59.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:59] INFO grpc.py:704: Received request to add bdev_035b3e5a-d391-4bf4-9e91-07424831f76f to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID 035b3e5a-d391-4bf4-9e91-07424831f76f 2024-03-25T09:22:59.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:22:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:22:59] INFO grpc.py:727: subsystem_add_ns: 12 2024-03-25T09:22:59.946 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:22:59.946 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:22:59.946 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage33 2024-03-25T09:22:59.946 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage33 --load-balancing-group 1 2024-03-25T09:23:00.042 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:00.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:00 smithi040 ceph-mon[33094]: pgmap v395: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 97 KiB/s rd, 2.1 KiB/s wr, 53 op/s 2024-03-25T09:23:00.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:00.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:22:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:00.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:22:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:23:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:00 smithi019 ceph-mon[29386]: pgmap v395: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 97 KiB/s rd, 2.1 KiB/s wr, 53 op/s 2024-03-25T09:23:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:00 smithi059 ceph-mon[32732]: pgmap v395: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 97 KiB/s rd, 2.1 KiB/s wr, 53 op/s 2024-03-25T09:23:00.736 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 13 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-25T09:23:01.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:00] INFO grpc.py:826: Received request to add a namespace using NSID 13 and UUID dd79c772-7cf8-4fed-9a85-db14e97b125a to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:01.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:00] INFO grpc.py:294: Received request to create bdev bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a from mypool/myimage33 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:01.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:00.744989] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a rbd disk to lun 2024-03-25T09:23:01.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:00] INFO grpc.py:333: bdev_rbd_create: bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a, cluster_name cluster_context_1_0 2024-03-25T09:23:01.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:00] INFO grpc.py:704: Received request to add bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 13 and UUID dd79c772-7cf8-4fed-9a85-db14e97b125a 2024-03-25T09:23:01.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:00] INFO grpc.py:727: subsystem_add_ns: 13 2024-03-25T09:23:01.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:00] INFO grpc.py:826: Received request to add a namespace using NSID 13 and UUID dd79c772-7cf8-4fed-9a85-db14e97b125a to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:01.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:00] INFO grpc.py:294: Received request to create bdev bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a from mypool/myimage33 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:01.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:00.746760] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a rbd disk to lun 2024-03-25T09:23:01.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:00] INFO grpc.py:333: bdev_rbd_create: bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a, cluster_name cluster_context_1_0 2024-03-25T09:23:01.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:00] INFO grpc.py:704: Received request to add bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 13 and UUID dd79c772-7cf8-4fed-9a85-db14e97b125a 2024-03-25T09:23:01.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:00] INFO grpc.py:727: subsystem_add_ns: 13 2024-03-25T09:23:01.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:00] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:23:01.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:00] INFO grpc.py:294: Received request to create bdev bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a from mypool/myimage33 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:01.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:00.721709] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a rbd disk to lun 2024-03-25T09:23:01.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:00] INFO grpc.py:333: bdev_rbd_create: bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a, cluster_name cluster_context_1_0 2024-03-25T09:23:01.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:00] INFO grpc.py:704: Received request to add bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID dd79c772-7cf8-4fed-9a85-db14e97b125a 2024-03-25T09:23:01.065 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:00] INFO grpc.py:727: subsystem_add_ns: 13 2024-03-25T09:23:01.065 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:01.065 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:01.065 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:23:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:01 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 98 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:01.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:01 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 98 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:01.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:01.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:01.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:23:01.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:01 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 98 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:01.564 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:01.564 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:01.564 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage34 2024-03-25T09:23:01.564 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage34 --load-balancing-group 2 2024-03-25T09:23:01.643 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:01Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:02 smithi040 ceph-mon[33094]: pgmap v396: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s rd, 1.7 KiB/s wr, 55 op/s 2024-03-25T09:23:02.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:02.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:02.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:23:02.346 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:02 smithi019 ceph-mon[29386]: pgmap v396: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s rd, 1.7 KiB/s wr, 55 op/s 2024-03-25T09:23:02.374 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:02 smithi059 ceph-mon[32732]: pgmap v396: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s rd, 1.7 KiB/s wr, 55 op/s 2024-03-25T09:23:02.374 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 14 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-25T09:23:02.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:02] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:23:02.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:02] INFO grpc.py:294: Received request to create bdev bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7 from mypool/myimage34 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:02.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:02.358805] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7 rbd disk to lun 2024-03-25T09:23:02.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:02] INFO grpc.py:333: bdev_rbd_create: bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7, cluster_name cluster_context_2_0 2024-03-25T09:23:02.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:02] INFO grpc.py:704: Received request to add bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID e03ab02b-edc2-4cb3-981a-35a3c60cebe7 2024-03-25T09:23:02.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:02] INFO grpc.py:727: subsystem_add_ns: 14 2024-03-25T09:23:02.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:02] INFO grpc.py:826: Received request to add a namespace using NSID 14 and UUID e03ab02b-edc2-4cb3-981a-35a3c60cebe7 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:02.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:02] INFO grpc.py:294: Received request to create bdev bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7 from mypool/myimage34 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:02.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:02.384902] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7 rbd disk to lun 2024-03-25T09:23:02.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:02] INFO grpc.py:333: bdev_rbd_create: bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7, cluster_name cluster_context_2_0 2024-03-25T09:23:02.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:02] INFO grpc.py:704: Received request to add bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 14 and UUID e03ab02b-edc2-4cb3-981a-35a3c60cebe7 2024-03-25T09:23:02.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:02] INFO grpc.py:727: subsystem_add_ns: 14 2024-03-25T09:23:02.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:02] INFO grpc.py:826: Received request to add a namespace using NSID 14 and UUID e03ab02b-edc2-4cb3-981a-35a3c60cebe7 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:02.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:02] INFO grpc.py:294: Received request to create bdev bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7 from mypool/myimage34 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:02.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:02.383122] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7 rbd disk to lun 2024-03-25T09:23:02.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:02] INFO grpc.py:333: bdev_rbd_create: bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7, cluster_name cluster_context_2_0 2024-03-25T09:23:02.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:02] INFO grpc.py:704: Received request to add bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 14 and UUID e03ab02b-edc2-4cb3-981a-35a3c60cebe7 2024-03-25T09:23:02.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:02] INFO grpc.py:727: subsystem_add_ns: 14 2024-03-25T09:23:03.145 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:02.781+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:03.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:03.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:03.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:23:03.316 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:03.316 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:03.316 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage35 2024-03-25T09:23:03.316 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage35 --load-balancing-group 3 2024-03-25T09:23:03.391 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:03Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:03.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:03.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:03.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:23:04.098 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 15 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-25T09:23:04.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:04 smithi040 ceph-mon[33094]: pgmap v397: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 1.8 KiB/s wr, 68 op/s 2024-03-25T09:23:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:23:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:04] INFO grpc.py:826: Received request to add a namespace using NSID 15 and UUID 169d87cc-4d44-45e6-8a50-fc26ccf7e965 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:04] INFO grpc.py:294: Received request to create bdev bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965 from mypool/myimage35 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:04.107274] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965 rbd disk to lun 2024-03-25T09:23:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:04] INFO grpc.py:333: bdev_rbd_create: bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965, cluster_name cluster_context_3_0 2024-03-25T09:23:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:04] INFO grpc.py:704: Received request to add bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 15 and UUID 169d87cc-4d44-45e6-8a50-fc26ccf7e965 2024-03-25T09:23:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:04] INFO grpc.py:727: subsystem_add_ns: 15 2024-03-25T09:23:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:04 smithi019 ceph-mon[29386]: pgmap v397: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 1.8 KiB/s wr, 68 op/s 2024-03-25T09:23:04.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:04] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:23:04.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:04] INFO grpc.py:294: Received request to create bdev bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965 from mypool/myimage35 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:04.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:04.082579] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965 rbd disk to lun 2024-03-25T09:23:04.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:04] INFO grpc.py:333: bdev_rbd_create: bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965, cluster_name cluster_context_3_0 2024-03-25T09:23:04.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:04] INFO grpc.py:704: Received request to add bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID 169d87cc-4d44-45e6-8a50-fc26ccf7e965 2024-03-25T09:23:04.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:04] INFO grpc.py:727: subsystem_add_ns: 15 2024-03-25T09:23:04.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:04 smithi059 ceph-mon[32732]: pgmap v397: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 1.8 KiB/s wr, 68 op/s 2024-03-25T09:23:04.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:04] INFO grpc.py:826: Received request to add a namespace using NSID 15 and UUID 169d87cc-4d44-45e6-8a50-fc26ccf7e965 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:04.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:04] INFO grpc.py:294: Received request to create bdev bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965 from mypool/myimage35 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:04.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:04.109593] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965 rbd disk to lun 2024-03-25T09:23:04.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:04] INFO grpc.py:333: bdev_rbd_create: bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965, cluster_name cluster_context_3_0 2024-03-25T09:23:04.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:04] INFO grpc.py:704: Received request to add bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 15 and UUID 169d87cc-4d44-45e6-8a50-fc26ccf7e965 2024-03-25T09:23:04.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:04] INFO grpc.py:727: subsystem_add_ns: 15 2024-03-25T09:23:04.927 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:04.927 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:04.927 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage36 2024-03-25T09:23:04.927 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage36 --load-balancing-group 1 2024-03-25T09:23:05.006 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:05Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:05.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:05.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:05.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:23:05.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:05.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:05.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:23:05.726 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 16 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-25T09:23:06.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:05] INFO grpc.py:826: Received request to add a namespace using NSID 16 and UUID ab28eebb-ebca-411f-b32a-388f2d3fd613 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:06.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:05] INFO grpc.py:294: Received request to create bdev bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613 from mypool/myimage36 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:06.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:05.738732] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613 rbd disk to lun 2024-03-25T09:23:06.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:05] INFO grpc.py:333: bdev_rbd_create: bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613, cluster_name cluster_context_1_0 2024-03-25T09:23:06.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:05] INFO grpc.py:704: Received request to add bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 16 and UUID ab28eebb-ebca-411f-b32a-388f2d3fd613 2024-03-25T09:23:06.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:05] INFO grpc.py:727: subsystem_add_ns: 16 2024-03-25T09:23:06.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:05] INFO grpc.py:826: Received request to add a namespace using NSID 16 and UUID ab28eebb-ebca-411f-b32a-388f2d3fd613 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:05] INFO grpc.py:294: Received request to create bdev bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613 from mypool/myimage36 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:05.736840] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613 rbd disk to lun 2024-03-25T09:23:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:05] INFO grpc.py:333: bdev_rbd_create: bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613, cluster_name cluster_context_1_0 2024-03-25T09:23:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:05] INFO grpc.py:704: Received request to add bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 16 and UUID ab28eebb-ebca-411f-b32a-388f2d3fd613 2024-03-25T09:23:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:05] INFO grpc.py:727: subsystem_add_ns: 16 2024-03-25T09:23:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:23:06.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:05] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:23:06.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:05] INFO grpc.py:294: Received request to create bdev bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613 from mypool/myimage36 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:06.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:05.710529] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613 rbd disk to lun 2024-03-25T09:23:06.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:05] INFO grpc.py:333: bdev_rbd_create: bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613, cluster_name cluster_context_1_0 2024-03-25T09:23:06.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:05] INFO grpc.py:704: Received request to add bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID ab28eebb-ebca-411f-b32a-388f2d3fd613 2024-03-25T09:23:06.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:05] INFO grpc.py:727: subsystem_add_ns: 16 2024-03-25T09:23:06.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:06 smithi019 ceph-mon[29386]: pgmap v398: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 2.4 KiB/s wr, 81 op/s 2024-03-25T09:23:06.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:06 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 103 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:06 smithi059 ceph-mon[32732]: pgmap v398: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 2.4 KiB/s wr, 81 op/s 2024-03-25T09:23:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:06 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 103 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:06 smithi040 ceph-mon[33094]: pgmap v398: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 2.4 KiB/s wr, 81 op/s 2024-03-25T09:23:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:06 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 103 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:06.587 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:06.588 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:06.588 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage37 2024-03-25T09:23:06.588 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage37 --load-balancing-group 2 2024-03-25T09:23:06.673 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:06Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:07.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:07.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:07.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:23:07.363 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 17 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-25T09:23:07.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:07.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:07.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:23:07.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:07] INFO grpc.py:826: Received request to add a namespace using NSID 17 and UUID da521597-93a5-4fb1-a071-740e044cbe6d to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:07.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:07] INFO grpc.py:294: Received request to create bdev bdev_da521597-93a5-4fb1-a071-740e044cbe6d from mypool/myimage37 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:07.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:07.374766] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_da521597-93a5-4fb1-a071-740e044cbe6d rbd disk to lun 2024-03-25T09:23:07.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:07] INFO grpc.py:333: bdev_rbd_create: bdev_da521597-93a5-4fb1-a071-740e044cbe6d, cluster_name cluster_context_2_0 2024-03-25T09:23:07.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:07] INFO grpc.py:704: Received request to add bdev_da521597-93a5-4fb1-a071-740e044cbe6d to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 17 and UUID da521597-93a5-4fb1-a071-740e044cbe6d 2024-03-25T09:23:07.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:07] INFO grpc.py:727: subsystem_add_ns: 17 2024-03-25T09:23:07.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:07] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:23:07.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:07] INFO grpc.py:294: Received request to create bdev bdev_da521597-93a5-4fb1-a071-740e044cbe6d from mypool/myimage37 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:07.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:07.347832] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_da521597-93a5-4fb1-a071-740e044cbe6d rbd disk to lun 2024-03-25T09:23:07.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:07] INFO grpc.py:333: bdev_rbd_create: bdev_da521597-93a5-4fb1-a071-740e044cbe6d, cluster_name cluster_context_2_0 2024-03-25T09:23:07.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:07] INFO grpc.py:704: Received request to add bdev_da521597-93a5-4fb1-a071-740e044cbe6d to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID da521597-93a5-4fb1-a071-740e044cbe6d 2024-03-25T09:23:07.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:07] INFO grpc.py:727: subsystem_add_ns: 17 2024-03-25T09:23:07.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:07] INFO grpc.py:826: Received request to add a namespace using NSID 17 and UUID da521597-93a5-4fb1-a071-740e044cbe6d to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:07.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:07] INFO grpc.py:294: Received request to create bdev bdev_da521597-93a5-4fb1-a071-740e044cbe6d from mypool/myimage37 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:07.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:07.372740] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_da521597-93a5-4fb1-a071-740e044cbe6d rbd disk to lun 2024-03-25T09:23:07.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:07] INFO grpc.py:333: bdev_rbd_create: bdev_da521597-93a5-4fb1-a071-740e044cbe6d, cluster_name cluster_context_2_0 2024-03-25T09:23:07.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:07] INFO grpc.py:704: Received request to add bdev_da521597-93a5-4fb1-a071-740e044cbe6d to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 17 and UUID da521597-93a5-4fb1-a071-740e044cbe6d 2024-03-25T09:23:07.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:07] INFO grpc.py:727: subsystem_add_ns: 17 2024-03-25T09:23:08.065 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:07.781+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:08.164 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:08.164 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:08.164 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage38 2024-03-25T09:23:08.164 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage38 --load-balancing-group 3 2024-03-25T09:23:08.257 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:08Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:08.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:08 smithi040 ceph-mon[33094]: pgmap v399: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 1.7 KiB/s wr, 62 op/s 2024-03-25T09:23:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:08.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:23:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:08 smithi019 ceph-mon[29386]: pgmap v399: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 1.7 KiB/s wr, 62 op/s 2024-03-25T09:23:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:08 smithi059 ceph-mon[32732]: pgmap v399: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 1.7 KiB/s wr, 62 op/s 2024-03-25T09:23:08.953 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 18 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-25T09:23:09.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:09.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:09.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:23:09.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:08] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:23:09.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:08] INFO grpc.py:294: Received request to create bdev bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 from mypool/myimage38 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:09.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:08.937411] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 rbd disk to lun 2024-03-25T09:23:09.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:08] INFO grpc.py:333: bdev_rbd_create: bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7, cluster_name cluster_context_3_0 2024-03-25T09:23:09.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:08] INFO grpc.py:704: Received request to add bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 2024-03-25T09:23:09.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:08] INFO grpc.py:727: subsystem_add_ns: 18 2024-03-25T09:23:09.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:08 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:08] INFO grpc.py:826: Received request to add a namespace using NSID 18 and UUID f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:09.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:08 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:08] INFO grpc.py:294: Received request to create bdev bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 from mypool/myimage38 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:09.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:08 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:08.963087] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 rbd disk to lun 2024-03-25T09:23:09.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:08 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:08] INFO grpc.py:333: bdev_rbd_create: bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7, cluster_name cluster_context_3_0 2024-03-25T09:23:09.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:08 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:08] INFO grpc.py:704: Received request to add bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 18 and UUID f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 2024-03-25T09:23:09.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:08 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:08] INFO grpc.py:727: subsystem_add_ns: 18 2024-03-25T09:23:09.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:09.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:09.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:23:09.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:08] INFO grpc.py:826: Received request to add a namespace using NSID 18 and UUID f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:09.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:08] INFO grpc.py:294: Received request to create bdev bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 from mypool/myimage38 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:09.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:08.959405] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 rbd disk to lun 2024-03-25T09:23:09.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:08] INFO grpc.py:333: bdev_rbd_create: bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7, cluster_name cluster_context_3_0 2024-03-25T09:23:09.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:08] INFO grpc.py:704: Received request to add bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 18 and UUID f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7 2024-03-25T09:23:09.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:08] INFO grpc.py:727: subsystem_add_ns: 18 2024-03-25T09:23:09.816 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:09.816 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:09.816 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage39 2024-03-25T09:23:09.816 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage39 --load-balancing-group 1 2024-03-25T09:23:09.904 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:09Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:10.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:10 smithi040 ceph-mon[33094]: pgmap v400: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 2.3 KiB/s wr, 68 op/s 2024-03-25T09:23:10.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:10.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:10.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:23:10.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:10 smithi019 ceph-mon[29386]: pgmap v400: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 2.3 KiB/s wr, 68 op/s 2024-03-25T09:23:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:10 smithi059 ceph-mon[32732]: pgmap v400: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 2.3 KiB/s wr, 68 op/s 2024-03-25T09:23:10.616 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 19 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-25T09:23:10.862 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:10] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:23:10.862 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:10] INFO grpc.py:294: Received request to create bdev bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b from mypool/myimage39 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:10.862 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:10.600042] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b rbd disk to lun 2024-03-25T09:23:10.863 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:10] INFO grpc.py:333: bdev_rbd_create: bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b, cluster_name cluster_context_1_0 2024-03-25T09:23:10.863 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:10] INFO grpc.py:704: Received request to add bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID 23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b 2024-03-25T09:23:10.863 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:10] INFO grpc.py:727: subsystem_add_ns: 19 2024-03-25T09:23:10.863 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:11.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:10] INFO grpc.py:826: Received request to add a namespace using NSID 19 and UUID 23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:11.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:10] INFO grpc.py:294: Received request to create bdev bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b from mypool/myimage39 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:10.627912] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b rbd disk to lun 2024-03-25T09:23:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:10] INFO grpc.py:333: bdev_rbd_create: bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b, cluster_name cluster_context_1_0 2024-03-25T09:23:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:10] INFO grpc.py:704: Received request to add bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 19 and UUID 23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b 2024-03-25T09:23:11.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:10 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:10] INFO grpc.py:727: subsystem_add_ns: 19 2024-03-25T09:23:11.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:10] INFO grpc.py:826: Received request to add a namespace using NSID 19 and UUID 23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:11.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:10] INFO grpc.py:294: Received request to create bdev bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b from mypool/myimage39 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:11.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:10.623007] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b rbd disk to lun 2024-03-25T09:23:11.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:10] INFO grpc.py:333: bdev_rbd_create: bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b, cluster_name cluster_context_1_0 2024-03-25T09:23:11.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:10] INFO grpc.py:704: Received request to add bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 19 and UUID 23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b 2024-03-25T09:23:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:10] INFO grpc.py:727: subsystem_add_ns: 19 2024-03-25T09:23:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:23:11.433 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:11.434 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:11.434 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage40 2024-03-25T09:23:11.434 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage40 --load-balancing-group 2 2024-03-25T09:23:11.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:11.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:11.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:23:11.512 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:11Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:12.233 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:12 smithi040 ceph-mon[33094]: pgmap v401: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s rd, 1.7 KiB/s wr, 69 op/s 2024-03-25T09:23:12.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:12.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:12.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-25T09:23:12.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:12] INFO grpc.py:826: Received request to add a namespace using NSID 20 and UUID f14b3c52-f718-4626-b469-70f2660a35bd to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:12.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:12] INFO grpc.py:294: Received request to create bdev bdev_f14b3c52-f718-4626-b469-70f2660a35bd from mypool/myimage40 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:12.234 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 20 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-25T09:23:12.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:12 smithi019 ceph-mon[29386]: pgmap v401: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s rd, 1.7 KiB/s wr, 69 op/s 2024-03-25T09:23:12.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:12] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:23:12.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:12] INFO grpc.py:294: Received request to create bdev bdev_f14b3c52-f718-4626-b469-70f2660a35bd from mypool/myimage40 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:12.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:12.218112] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f14b3c52-f718-4626-b469-70f2660a35bd rbd disk to lun 2024-03-25T09:23:12.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:12] INFO grpc.py:333: bdev_rbd_create: bdev_f14b3c52-f718-4626-b469-70f2660a35bd, cluster_name cluster_context_2_0 2024-03-25T09:23:12.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:12] INFO grpc.py:704: Received request to add bdev_f14b3c52-f718-4626-b469-70f2660a35bd to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID f14b3c52-f718-4626-b469-70f2660a35bd 2024-03-25T09:23:12.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:12] INFO grpc.py:727: subsystem_add_ns: 20 2024-03-25T09:23:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:12 smithi059 ceph-mon[32732]: pgmap v401: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s rd, 1.7 KiB/s wr, 69 op/s 2024-03-25T09:23:12.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:12] INFO grpc.py:826: Received request to add a namespace using NSID 20 and UUID f14b3c52-f718-4626-b469-70f2660a35bd to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-25T09:23:12.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:12] INFO grpc.py:294: Received request to create bdev bdev_f14b3c52-f718-4626-b469-70f2660a35bd from mypool/myimage40 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:12.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:12.243523] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f14b3c52-f718-4626-b469-70f2660a35bd rbd disk to lun 2024-03-25T09:23:12.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:12] INFO grpc.py:333: bdev_rbd_create: bdev_f14b3c52-f718-4626-b469-70f2660a35bd, cluster_name cluster_context_2_0 2024-03-25T09:23:12.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:12] INFO grpc.py:704: Received request to add bdev_f14b3c52-f718-4626-b469-70f2660a35bd to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 20 and UUID f14b3c52-f718-4626-b469-70f2660a35bd 2024-03-25T09:23:12.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:12] INFO grpc.py:727: subsystem_add_ns: 20 2024-03-25T09:23:12.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:12.242790] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f14b3c52-f718-4626-b469-70f2660a35bd rbd disk to lun 2024-03-25T09:23:12.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:12] INFO grpc.py:333: bdev_rbd_create: bdev_f14b3c52-f718-4626-b469-70f2660a35bd, cluster_name cluster_context_2_0 2024-03-25T09:23:12.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:12] INFO grpc.py:704: Received request to add bdev_f14b3c52-f718-4626-b469-70f2660a35bd to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 20 and UUID f14b3c52-f718-4626-b469-70f2660a35bd 2024-03-25T09:23:12.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:12] INFO grpc.py:727: subsystem_add_ns: 20 2024-03-25T09:23:13.027 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:13.027 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:23:13.027 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-25T09:23:13.027 INFO:tasks.workunit.client.3.smithi129.stderr:++ seq 1 20 2024-03-25T09:23:13.028 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:13.028 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage41 2024-03-25T09:23:13.028 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage41 --load-balancing-group 3 2024-03-25T09:23:13.104 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:13Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:13.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:13.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:13.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-25T09:23:13.192 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:12.781+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:13.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:13.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:13.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-25T09:23:13.821 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-25T09:23:14.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:13] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:14.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:13] INFO grpc.py:294: Received request to create bdev bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 from mypool/myimage41 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:14.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:13.806275] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 rbd disk to lun 2024-03-25T09:23:14.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:13] INFO grpc.py:333: bdev_rbd_create: bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813, cluster_name cluster_context_3_0 2024-03-25T09:23:14.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:13] INFO grpc.py:704: Received request to add bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 2024-03-25T09:23:14.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:13] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:23:14.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:14 smithi059 ceph-mon[32732]: pgmap v402: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:23:14.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:13] INFO grpc.py:826: Received request to add a namespace using NSID 1 and UUID a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:14.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:13] INFO grpc.py:294: Received request to create bdev bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 from mypool/myimage41 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:14.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:13.831235] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 rbd disk to lun 2024-03-25T09:23:14.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:13] INFO grpc.py:333: bdev_rbd_create: bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813, cluster_name cluster_context_3_0 2024-03-25T09:23:14.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:13] INFO grpc.py:704: Received request to add bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 1 and UUID a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 2024-03-25T09:23:14.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:13] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:23:14.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:14 smithi040 ceph-mon[33094]: pgmap v402: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:23:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:13] INFO grpc.py:826: Received request to add a namespace using NSID 1 and UUID a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:13] INFO grpc.py:294: Received request to create bdev bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 from mypool/myimage41 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:13.832038] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 rbd disk to lun 2024-03-25T09:23:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:13] INFO grpc.py:333: bdev_rbd_create: bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813, cluster_name cluster_context_3_0 2024-03-25T09:23:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:13] INFO grpc.py:704: Received request to add bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 1 and UUID a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813 2024-03-25T09:23:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:13] INFO grpc.py:727: subsystem_add_ns: 1 2024-03-25T09:23:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}]}] 2024-03-25T09:23:14.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:14 smithi019 ceph-mon[29386]: pgmap v402: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-25T09:23:14.670 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:14.671 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:14.671 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage42 2024-03-25T09:23:14.671 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage42 --load-balancing-group 1 2024-03-25T09:23:14.750 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:14Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:15.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:15.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:15.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}]}] 2024-03-25T09:23:15.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:15 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 108 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:15.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:15] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:15.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:15] INFO grpc.py:294: Received request to create bdev bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b from mypool/myimage42 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:15.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:15.401862] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b rbd disk to lun 2024-03-25T09:23:15.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:15] INFO grpc.py:333: bdev_rbd_create: bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b, cluster_name cluster_context_1_0 2024-03-25T09:23:15.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:15] INFO grpc.py:704: Received request to add bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID 865c2cfb-34c8-42ae-8d01-e76ef759818b 2024-03-25T09:23:15.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:15] INFO grpc.py:727: subsystem_add_ns: 2 2024-03-25T09:23:15.417 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-25T09:23:15.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:15 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 108 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:15.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:15.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:15.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}]}] 2024-03-25T09:23:15.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:15] INFO grpc.py:826: Received request to add a namespace using NSID 2 and UUID 865c2cfb-34c8-42ae-8d01-e76ef759818b to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:15.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:15] INFO grpc.py:294: Received request to create bdev bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b from mypool/myimage42 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:15.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:15.427427] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b rbd disk to lun 2024-03-25T09:23:15.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:15] INFO grpc.py:333: bdev_rbd_create: bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b, cluster_name cluster_context_1_0 2024-03-25T09:23:15.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:15] INFO grpc.py:704: Received request to add bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 2 and UUID 865c2cfb-34c8-42ae-8d01-e76ef759818b 2024-03-25T09:23:15.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:15] INFO grpc.py:727: subsystem_add_ns: 2 2024-03-25T09:23:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:15 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 108 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:15] INFO grpc.py:826: Received request to add a namespace using NSID 2 and UUID 865c2cfb-34c8-42ae-8d01-e76ef759818b to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:15] INFO grpc.py:294: Received request to create bdev bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b from mypool/myimage42 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:15.428311] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b rbd disk to lun 2024-03-25T09:23:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:15] INFO grpc.py:333: bdev_rbd_create: bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b, cluster_name cluster_context_1_0 2024-03-25T09:23:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:15] INFO grpc.py:704: Received request to add bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 2 and UUID 865c2cfb-34c8-42ae-8d01-e76ef759818b 2024-03-25T09:23:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:15] INFO grpc.py:727: subsystem_add_ns: 2 2024-03-25T09:23:16.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:16.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:16.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}]}] 2024-03-25T09:23:16.296 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:16.296 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:16.296 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage43 2024-03-25T09:23:16.296 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage43 --load-balancing-group 2 2024-03-25T09:23:16.382 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:16Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:16.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:16 smithi019 ceph-mon[29386]: pgmap v403: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 2.1 KiB/s wr, 64 op/s 2024-03-25T09:23:16.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:16 smithi059 ceph-mon[32732]: pgmap v403: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 2.1 KiB/s wr, 64 op/s 2024-03-25T09:23:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:16 smithi040 ceph-mon[33094]: pgmap v403: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 2.1 KiB/s wr, 64 op/s 2024-03-25T09:23:17.086 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-25T09:23:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}]}] 2024-03-25T09:23:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:17] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:17] INFO grpc.py:294: Received request to create bdev bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb from mypool/myimage43 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:17.071366] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb rbd disk to lun 2024-03-25T09:23:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:17] INFO grpc.py:333: bdev_rbd_create: bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb, cluster_name cluster_context_2_0 2024-03-25T09:23:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:17] INFO grpc.py:704: Received request to add bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID acfee7b5-f951-45a0-b42d-b09f604dafcb 2024-03-25T09:23:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:17] INFO grpc.py:727: subsystem_add_ns: 3 2024-03-25T09:23:17.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:17] INFO grpc.py:826: Received request to add a namespace using NSID 3 and UUID acfee7b5-f951-45a0-b42d-b09f604dafcb to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:17.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:17] INFO grpc.py:294: Received request to create bdev bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb from mypool/myimage43 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:17.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:17.096350] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb rbd disk to lun 2024-03-25T09:23:17.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:17] INFO grpc.py:333: bdev_rbd_create: bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb, cluster_name cluster_context_2_0 2024-03-25T09:23:17.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:17] INFO grpc.py:704: Received request to add bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 3 and UUID acfee7b5-f951-45a0-b42d-b09f604dafcb 2024-03-25T09:23:17.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:17] INFO grpc.py:727: subsystem_add_ns: 3 2024-03-25T09:23:17.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:17.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:17.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}]}] 2024-03-25T09:23:17.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:17] INFO grpc.py:826: Received request to add a namespace using NSID 3 and UUID acfee7b5-f951-45a0-b42d-b09f604dafcb to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:17.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:17] INFO grpc.py:294: Received request to create bdev bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb from mypool/myimage43 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:17.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:17.097272] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb rbd disk to lun 2024-03-25T09:23:17.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:17] INFO grpc.py:333: bdev_rbd_create: bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb, cluster_name cluster_context_2_0 2024-03-25T09:23:17.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:17] INFO grpc.py:704: Received request to add bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 3 and UUID acfee7b5-f951-45a0-b42d-b09f604dafcb 2024-03-25T09:23:17.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:17] INFO grpc.py:727: subsystem_add_ns: 3 2024-03-25T09:23:17.906 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:17.906 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:17.906 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage44 2024-03-25T09:23:17.906 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage44 --load-balancing-group 3 2024-03-25T09:23:17.981 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:17Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:18.064 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:17.781+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:18.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:18 smithi040 ceph-mon[33094]: pgmap v404: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 1.6 KiB/s wr, 61 op/s 2024-03-25T09:23:18.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:18.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:18.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}]}] 2024-03-25T09:23:18.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:18 smithi019 ceph-mon[29386]: pgmap v404: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 1.6 KiB/s wr, 61 op/s 2024-03-25T09:23:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:18 smithi059 ceph-mon[32732]: pgmap v404: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 1.6 KiB/s wr, 61 op/s 2024-03-25T09:23:18.678 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-25T09:23:18.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:18] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:18.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:18] INFO grpc.py:294: Received request to create bdev bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39 from mypool/myimage44 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:18.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:18.663728] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39 rbd disk to lun 2024-03-25T09:23:18.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:18] INFO grpc.py:333: bdev_rbd_create: bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39, cluster_name cluster_context_3_0 2024-03-25T09:23:18.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:18] INFO grpc.py:704: Received request to add bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID 4a34c4b4-f560-4567-b539-6bc6744c9b39 2024-03-25T09:23:18.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:18] INFO grpc.py:727: subsystem_add_ns: 4 2024-03-25T09:23:18.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:19.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:18 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:18] INFO grpc.py:826: Received request to add a namespace using NSID 4 and UUID 4a34c4b4-f560-4567-b539-6bc6744c9b39 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:19.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:18 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:18] INFO grpc.py:294: Received request to create bdev bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39 from mypool/myimage44 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:19.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:18 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:18.689542] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39 rbd disk to lun 2024-03-25T09:23:19.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:18 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:18] INFO grpc.py:333: bdev_rbd_create: bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39, cluster_name cluster_context_3_0 2024-03-25T09:23:19.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:18 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:18] INFO grpc.py:704: Received request to add bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 4 and UUID 4a34c4b4-f560-4567-b539-6bc6744c9b39 2024-03-25T09:23:19.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:18 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:18] INFO grpc.py:727: subsystem_add_ns: 4 2024-03-25T09:23:19.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:18] INFO grpc.py:826: Received request to add a namespace using NSID 4 and UUID 4a34c4b4-f560-4567-b539-6bc6744c9b39 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:19.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:18] INFO grpc.py:294: Received request to create bdev bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39 from mypool/myimage44 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:19.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:18.688248] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39 rbd disk to lun 2024-03-25T09:23:19.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:18] INFO grpc.py:333: bdev_rbd_create: bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39, cluster_name cluster_context_3_0 2024-03-25T09:23:19.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:18] INFO grpc.py:704: Received request to add bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 4 and UUID 4a34c4b4-f560-4567-b539-6bc6744c9b39 2024-03-25T09:23:19.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:18] INFO grpc.py:727: subsystem_add_ns: 4 2024-03-25T09:23:19.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:19.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}]}] 2024-03-25T09:23:19.507 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:19.507 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:19.507 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage45 2024-03-25T09:23:19.507 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage45 --load-balancing-group 1 2024-03-25T09:23:19.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:19.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:19.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}]}] 2024-03-25T09:23:19.588 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:19Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:20.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:20 smithi040 ceph-mon[33094]: pgmap v405: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 129 KiB/s rd, 2.2 KiB/s wr, 77 op/s 2024-03-25T09:23:20.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:20.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:20.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}]}] 2024-03-25T09:23:20.312 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 5 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-25T09:23:20.323 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:20 smithi059 ceph-mon[32732]: pgmap v405: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 129 KiB/s rd, 2.2 KiB/s wr, 77 op/s 2024-03-25T09:23:20.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:20] INFO grpc.py:826: Received request to add a namespace using NSID 5 and UUID f2ad3452-90c9-4131-b6f0-d56addb6353c to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:20.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:20] INFO grpc.py:294: Received request to create bdev bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c from mypool/myimage45 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:20.323 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:20.322547] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c rbd disk to lun 2024-03-25T09:23:20.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:20 smithi019 ceph-mon[29386]: pgmap v405: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 129 KiB/s rd, 2.2 KiB/s wr, 77 op/s 2024-03-25T09:23:20.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:20] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:20.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:20] INFO grpc.py:294: Received request to create bdev bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c from mypool/myimage45 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:20.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:20.296941] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c rbd disk to lun 2024-03-25T09:23:20.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:20] INFO grpc.py:333: bdev_rbd_create: bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c, cluster_name cluster_context_1_0 2024-03-25T09:23:20.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:20] INFO grpc.py:704: Received request to add bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID f2ad3452-90c9-4131-b6f0-d56addb6353c 2024-03-25T09:23:20.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:20] INFO grpc.py:727: subsystem_add_ns: 5 2024-03-25T09:23:20.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:20] INFO grpc.py:333: bdev_rbd_create: bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c, cluster_name cluster_context_1_0 2024-03-25T09:23:20.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:20] INFO grpc.py:704: Received request to add bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 5 and UUID f2ad3452-90c9-4131-b6f0-d56addb6353c 2024-03-25T09:23:20.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:20 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:20] INFO grpc.py:727: subsystem_add_ns: 5 2024-03-25T09:23:20.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:20] INFO grpc.py:826: Received request to add a namespace using NSID 5 and UUID f2ad3452-90c9-4131-b6f0-d56addb6353c to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:20.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:20] INFO grpc.py:294: Received request to create bdev bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c from mypool/myimage45 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:20.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:20.319534] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c rbd disk to lun 2024-03-25T09:23:20.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:20] INFO grpc.py:333: bdev_rbd_create: bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c, cluster_name cluster_context_1_0 2024-03-25T09:23:20.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:20] INFO grpc.py:704: Received request to add bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 5 and UUID f2ad3452-90c9-4131-b6f0-d56addb6353c 2024-03-25T09:23:20.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:20] INFO grpc.py:727: subsystem_add_ns: 5 2024-03-25T09:23:21.082 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:21.082 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:21.082 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage46 2024-03-25T09:23:21.082 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage46 --load-balancing-group 2 2024-03-25T09:23:21.161 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:21Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:21.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:21 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 118 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:21.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:21.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:21.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}]}] 2024-03-25T09:23:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:21 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 118 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:21.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:21.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:21.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}]}] 2024-03-25T09:23:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:21 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 118 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:21.900 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 6 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-25T09:23:22.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:22 smithi019 ceph-mon[29386]: pgmap v406: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 1.6 KiB/s wr, 66 op/s 2024-03-25T09:23:22.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:21] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:22.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:21] INFO grpc.py:294: Received request to create bdev bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c from mypool/myimage46 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:22.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:21.885167] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c rbd disk to lun 2024-03-25T09:23:22.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:21] INFO grpc.py:333: bdev_rbd_create: bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c, cluster_name cluster_context_2_0 2024-03-25T09:23:22.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:21] INFO grpc.py:704: Received request to add bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID 112277d6-d6c6-4116-af7d-f4fc49f0462c 2024-03-25T09:23:22.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:21] INFO grpc.py:727: subsystem_add_ns: 6 2024-03-25T09:23:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:22 smithi059 ceph-mon[32732]: pgmap v406: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 1.6 KiB/s wr, 66 op/s 2024-03-25T09:23:22.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:21] INFO grpc.py:826: Received request to add a namespace using NSID 6 and UUID 112277d6-d6c6-4116-af7d-f4fc49f0462c to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:22.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:21] INFO grpc.py:294: Received request to create bdev bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c from mypool/myimage46 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:22.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:21.910309] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c rbd disk to lun 2024-03-25T09:23:22.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:21] INFO grpc.py:333: bdev_rbd_create: bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c, cluster_name cluster_context_2_0 2024-03-25T09:23:22.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:21] INFO grpc.py:704: Received request to add bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 6 and UUID 112277d6-d6c6-4116-af7d-f4fc49f0462c 2024-03-25T09:23:22.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:21] INFO grpc.py:727: subsystem_add_ns: 6 2024-03-25T09:23:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:22 smithi040 ceph-mon[33094]: pgmap v406: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 1.6 KiB/s wr, 66 op/s 2024-03-25T09:23:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:21] INFO grpc.py:826: Received request to add a namespace using NSID 6 and UUID 112277d6-d6c6-4116-af7d-f4fc49f0462c to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:21] INFO grpc.py:294: Received request to create bdev bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c from mypool/myimage46 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:21.906972] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c rbd disk to lun 2024-03-25T09:23:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:21] INFO grpc.py:333: bdev_rbd_create: bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c, cluster_name cluster_context_2_0 2024-03-25T09:23:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:21] INFO grpc.py:704: Received request to add bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 6 and UUID 112277d6-d6c6-4116-af7d-f4fc49f0462c 2024-03-25T09:23:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:21] INFO grpc.py:727: subsystem_add_ns: 6 2024-03-25T09:23:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:22.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}]}] 2024-03-25T09:23:22.666 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:22.667 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:22.667 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage47 2024-03-25T09:23:22.667 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage47 --load-balancing-group 3 2024-03-25T09:23:22.750 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:22Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:23.243 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:22.782+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:23.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:23.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:23.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}]}] 2024-03-25T09:23:23.507 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:23.508 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:23.508 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}]}] 2024-03-25T09:23:23.508 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:23] INFO grpc.py:826: Received request to add a namespace using NSID 7 and UUID 9d1ef92b-a4aa-4e44-ad5c-32586fb79017 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:23.508 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:23] INFO grpc.py:294: Received request to create bdev bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017 from mypool/myimage47 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:23.508 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 7 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-25T09:23:23.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:23.520128] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017 rbd disk to lun 2024-03-25T09:23:23.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:23] INFO grpc.py:333: bdev_rbd_create: bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017, cluster_name cluster_context_3_0 2024-03-25T09:23:23.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:23] INFO grpc.py:704: Received request to add bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 7 and UUID 9d1ef92b-a4aa-4e44-ad5c-32586fb79017 2024-03-25T09:23:23.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:23] INFO grpc.py:727: subsystem_add_ns: 7 2024-03-25T09:23:23.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:23] INFO grpc.py:826: Received request to add a namespace using NSID 7 and UUID 9d1ef92b-a4aa-4e44-ad5c-32586fb79017 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:23.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:23] INFO grpc.py:294: Received request to create bdev bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017 from mypool/myimage47 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:23.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:23.514672] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017 rbd disk to lun 2024-03-25T09:23:23.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:23] INFO grpc.py:333: bdev_rbd_create: bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017, cluster_name cluster_context_3_0 2024-03-25T09:23:23.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:23] INFO grpc.py:704: Received request to add bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 7 and UUID 9d1ef92b-a4aa-4e44-ad5c-32586fb79017 2024-03-25T09:23:23.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:23] INFO grpc.py:727: subsystem_add_ns: 7 2024-03-25T09:23:23.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:23] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:23.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:23] INFO grpc.py:294: Received request to create bdev bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017 from mypool/myimage47 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:23.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:23.492522] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017 rbd disk to lun 2024-03-25T09:23:23.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:23] INFO grpc.py:333: bdev_rbd_create: bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017, cluster_name cluster_context_3_0 2024-03-25T09:23:23.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:23] INFO grpc.py:704: Received request to add bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID 9d1ef92b-a4aa-4e44-ad5c-32586fb79017 2024-03-25T09:23:23.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:23] INFO grpc.py:727: subsystem_add_ns: 7 2024-03-25T09:23:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:24 smithi040 ceph-mon[33094]: pgmap v407: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 1.6 KiB/s wr, 65 op/s 2024-03-25T09:23:24.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:24.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:24.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}]}] 2024-03-25T09:23:24.294 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:24.294 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:24.294 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage48 2024-03-25T09:23:24.294 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage48 --load-balancing-group 1 2024-03-25T09:23:24.384 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:24Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:24.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:24 smithi019 ceph-mon[29386]: pgmap v407: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 1.6 KiB/s wr, 65 op/s 2024-03-25T09:23:24.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:24 smithi059 ceph-mon[32732]: pgmap v407: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 1.6 KiB/s wr, 65 op/s 2024-03-25T09:23:25.088 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 8 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-25T09:23:25.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:25.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:25.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}]}] 2024-03-25T09:23:25.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:25] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:25.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:25] INFO grpc.py:294: Received request to create bdev bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd from mypool/myimage48 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:25.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:25.073512] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd rbd disk to lun 2024-03-25T09:23:25.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:25] INFO grpc.py:333: bdev_rbd_create: bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd, cluster_name cluster_context_1_0 2024-03-25T09:23:25.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:25] INFO grpc.py:704: Received request to add bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID 63f2150c-8681-4a84-86c2-5ce8bd7d9cbd 2024-03-25T09:23:25.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:25] INFO grpc.py:727: subsystem_add_ns: 8 2024-03-25T09:23:25.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:25] INFO grpc.py:826: Received request to add a namespace using NSID 8 and UUID 63f2150c-8681-4a84-86c2-5ce8bd7d9cbd to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:25.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:25] INFO grpc.py:294: Received request to create bdev bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd from mypool/myimage48 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:25.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:25.095586] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd rbd disk to lun 2024-03-25T09:23:25.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:25] INFO grpc.py:333: bdev_rbd_create: bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd, cluster_name cluster_context_1_0 2024-03-25T09:23:25.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:25] INFO grpc.py:704: Received request to add bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 8 and UUID 63f2150c-8681-4a84-86c2-5ce8bd7d9cbd 2024-03-25T09:23:25.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:25] INFO grpc.py:727: subsystem_add_ns: 8 2024-03-25T09:23:25.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:25.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:25.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}]}] 2024-03-25T09:23:25.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:25] INFO grpc.py:826: Received request to add a namespace using NSID 8 and UUID 63f2150c-8681-4a84-86c2-5ce8bd7d9cbd to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:25.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:25] INFO grpc.py:294: Received request to create bdev bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd from mypool/myimage48 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:25.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:25.098400] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd rbd disk to lun 2024-03-25T09:23:25.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:25] INFO grpc.py:333: bdev_rbd_create: bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd, cluster_name cluster_context_1_0 2024-03-25T09:23:25.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:25] INFO grpc.py:704: Received request to add bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 8 and UUID 63f2150c-8681-4a84-86c2-5ce8bd7d9cbd 2024-03-25T09:23:25.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:25] INFO grpc.py:727: subsystem_add_ns: 8 2024-03-25T09:23:25.831 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:25.831 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:25.831 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage49 2024-03-25T09:23:25.831 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage49 --load-balancing-group 2 2024-03-25T09:23:25.919 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:25Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:26.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-mon[29386]: pgmap v408: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 129 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-25T09:23:26.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 123 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:26.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-mon[33094]: pgmap v408: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 129 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-25T09:23:26.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 123 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:26.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:26.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:26.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}]}] 2024-03-25T09:23:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:26 smithi059 ceph-mon[32732]: pgmap v408: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 129 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-25T09:23:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:26 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 123 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:26.686 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 9 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-25T09:23:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:26] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:26] INFO grpc.py:294: Received request to create bdev bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee from mypool/myimage49 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:26.671587] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee rbd disk to lun 2024-03-25T09:23:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:26] INFO grpc.py:333: bdev_rbd_create: bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee, cluster_name cluster_context_2_0 2024-03-25T09:23:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:26] INFO grpc.py:704: Received request to add bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID a647aac4-e136-4fe9-b55f-3aab19d8ceee 2024-03-25T09:23:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:26] INFO grpc.py:727: subsystem_add_ns: 9 2024-03-25T09:23:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:27.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:26] INFO grpc.py:826: Received request to add a namespace using NSID 9 and UUID a647aac4-e136-4fe9-b55f-3aab19d8ceee to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:27.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:26] INFO grpc.py:294: Received request to create bdev bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee from mypool/myimage49 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:27.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:26.696010] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee rbd disk to lun 2024-03-25T09:23:27.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:26] INFO grpc.py:333: bdev_rbd_create: bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee, cluster_name cluster_context_2_0 2024-03-25T09:23:27.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:26] INFO grpc.py:704: Received request to add bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 9 and UUID a647aac4-e136-4fe9-b55f-3aab19d8ceee 2024-03-25T09:23:27.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:26 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:26] INFO grpc.py:727: subsystem_add_ns: 9 2024-03-25T09:23:27.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:26] INFO grpc.py:826: Received request to add a namespace using NSID 9 and UUID a647aac4-e136-4fe9-b55f-3aab19d8ceee to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:27.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:26] INFO grpc.py:294: Received request to create bdev bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee from mypool/myimage49 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:27.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:26.694925] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee rbd disk to lun 2024-03-25T09:23:27.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:26] INFO grpc.py:333: bdev_rbd_create: bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee, cluster_name cluster_context_2_0 2024-03-25T09:23:27.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:26] INFO grpc.py:704: Received request to add bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 9 and UUID a647aac4-e136-4fe9-b55f-3aab19d8ceee 2024-03-25T09:23:27.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:26] INFO grpc.py:727: subsystem_add_ns: 9 2024-03-25T09:23:27.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:27.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}]}] 2024-03-25T09:23:27.523 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:27.523 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:27.523 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage50 2024-03-25T09:23:27.523 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage50 --load-balancing-group 3 2024-03-25T09:23:27.610 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:27Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:27.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:27.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:27.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}]}] 2024-03-25T09:23:28.065 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:27.782+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:28.317 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:28 smithi019 ceph-mon[29386]: pgmap v409: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 1.7 KiB/s wr, 72 op/s 2024-03-25T09:23:28.317 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:28] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:28.317 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:28] INFO grpc.py:294: Received request to create bdev bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf from mypool/myimage50 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:28.317 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:28.308902] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf rbd disk to lun 2024-03-25T09:23:28.317 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:28] INFO grpc.py:333: bdev_rbd_create: bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf, cluster_name cluster_context_3_0 2024-03-25T09:23:28.317 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:28] INFO grpc.py:704: Received request to add bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID 4d16afb7-d6ac-4790-85dd-ee7d5289e0cf 2024-03-25T09:23:28.317 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:28] INFO grpc.py:727: subsystem_add_ns: 10 2024-03-25T09:23:28.323 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:28 smithi059 ceph-mon[32732]: pgmap v409: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 1.7 KiB/s wr, 72 op/s 2024-03-25T09:23:28.325 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:28 smithi040 ceph-mon[33094]: pgmap v409: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 1.7 KiB/s wr, 72 op/s 2024-03-25T09:23:28.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:28.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:28.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}]}] 2024-03-25T09:23:28.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:28] INFO grpc.py:826: Received request to add a namespace using NSID 10 and UUID 4d16afb7-d6ac-4790-85dd-ee7d5289e0cf to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:28.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:28] INFO grpc.py:294: Received request to create bdev bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf from mypool/myimage50 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:28.326 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 10 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-25T09:23:28.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:28 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:28] INFO grpc.py:826: Received request to add a namespace using NSID 10 and UUID 4d16afb7-d6ac-4790-85dd-ee7d5289e0cf to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:28.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:28 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:28] INFO grpc.py:294: Received request to create bdev bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf from mypool/myimage50 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:28.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:28 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:28.332222] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf rbd disk to lun 2024-03-25T09:23:28.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:28 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:28] INFO grpc.py:333: bdev_rbd_create: bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf, cluster_name cluster_context_3_0 2024-03-25T09:23:28.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:28 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:28] INFO grpc.py:704: Received request to add bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 10 and UUID 4d16afb7-d6ac-4790-85dd-ee7d5289e0cf 2024-03-25T09:23:28.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:28 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:28] INFO grpc.py:727: subsystem_add_ns: 10 2024-03-25T09:23:28.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:28.334278] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf rbd disk to lun 2024-03-25T09:23:28.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:28] INFO grpc.py:333: bdev_rbd_create: bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf, cluster_name cluster_context_3_0 2024-03-25T09:23:28.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:28] INFO grpc.py:704: Received request to add bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 10 and UUID 4d16afb7-d6ac-4790-85dd-ee7d5289e0cf 2024-03-25T09:23:28.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:28] INFO grpc.py:727: subsystem_add_ns: 10 2024-03-25T09:23:29.194 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:29.194 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:29.194 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage51 2024-03-25T09:23:29.194 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage51 --load-balancing-group 1 2024-03-25T09:23:29.285 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:29Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:29.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:29 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:23:29.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:29.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:29.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}]}] 2024-03-25T09:23:29.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:29 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:23:29.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:29.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:29.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}]}] 2024-03-25T09:23:29.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:29 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:23:30.029 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 11 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-25T09:23:30.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:23:30.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:23:30.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:23:30.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-mon[29386]: pgmap v410: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s rd, 2.2 KiB/s wr, 69 op/s 2024-03-25T09:23:30.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:30] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:30.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:30] INFO grpc.py:294: Received request to create bdev bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 from mypool/myimage51 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:30.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:30.012642] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 rbd disk to lun 2024-03-25T09:23:30.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:30] INFO grpc.py:333: bdev_rbd_create: bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17, cluster_name cluster_context_1_0 2024-03-25T09:23:30.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:30] INFO grpc.py:704: Received request to add bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 2024-03-25T09:23:30.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:30] INFO grpc.py:727: subsystem_add_ns: 11 2024-03-25T09:23:30.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:23:30.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:23:30.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:23:30.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-mon[33094]: pgmap v410: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s rd, 2.2 KiB/s wr, 69 op/s 2024-03-25T09:23:30.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:30] INFO grpc.py:826: Received request to add a namespace using NSID 11 and UUID cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:30.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:30] INFO grpc.py:294: Received request to create bdev bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 from mypool/myimage51 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:30.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:30.038496] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 rbd disk to lun 2024-03-25T09:23:30.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:30] INFO grpc.py:333: bdev_rbd_create: bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17, cluster_name cluster_context_1_0 2024-03-25T09:23:30.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:30] INFO grpc.py:704: Received request to add bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 11 and UUID cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 2024-03-25T09:23:30.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:30] INFO grpc.py:727: subsystem_add_ns: 11 2024-03-25T09:23:30.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:30.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:30.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}]}] 2024-03-25T09:23:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:30 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:23:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:30 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:23:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:30 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:23:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:30 smithi059 ceph-mon[32732]: pgmap v410: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s rd, 2.2 KiB/s wr, 69 op/s 2024-03-25T09:23:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:30 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:30] INFO grpc.py:826: Received request to add a namespace using NSID 11 and UUID cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:30 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:30] INFO grpc.py:294: Received request to create bdev bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 from mypool/myimage51 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:30 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:30.036707] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 rbd disk to lun 2024-03-25T09:23:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:30 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:30] INFO grpc.py:333: bdev_rbd_create: bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17, cluster_name cluster_context_1_0 2024-03-25T09:23:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:30 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:30] INFO grpc.py:704: Received request to add bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 11 and UUID cd4f7186-6ab9-492e-bd7a-e0fe92d12b17 2024-03-25T09:23:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:30 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:30] INFO grpc.py:727: subsystem_add_ns: 11 2024-03-25T09:23:30.847 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:30.847 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:30.847 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage52 2024-03-25T09:23:30.847 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage52 --load-balancing-group 2 2024-03-25T09:23:30.926 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:30Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:31.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:31.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:31.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}]}] 2024-03-25T09:23:31.645 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:31.645 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:31.645 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}]}] 2024-03-25T09:23:31.645 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:31] INFO grpc.py:826: Received request to add a namespace using NSID 12 and UUID 9f904d8b-a338-41f5-9e74-b160cf3fdaf8 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:31.645 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:31] INFO grpc.py:294: Received request to create bdev bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8 from mypool/myimage52 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:31.646 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 12 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-25T09:23:31.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:31] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:31.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:31] INFO grpc.py:294: Received request to create bdev bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8 from mypool/myimage52 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:31.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:31.628926] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8 rbd disk to lun 2024-03-25T09:23:31.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:31] INFO grpc.py:333: bdev_rbd_create: bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8, cluster_name cluster_context_2_0 2024-03-25T09:23:31.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:31] INFO grpc.py:704: Received request to add bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID 9f904d8b-a338-41f5-9e74-b160cf3fdaf8 2024-03-25T09:23:31.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:31] INFO grpc.py:727: subsystem_add_ns: 12 2024-03-25T09:23:32.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:31.652758] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8 rbd disk to lun 2024-03-25T09:23:32.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:31] INFO grpc.py:333: bdev_rbd_create: bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8, cluster_name cluster_context_2_0 2024-03-25T09:23:32.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:31] INFO grpc.py:704: Received request to add bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 12 and UUID 9f904d8b-a338-41f5-9e74-b160cf3fdaf8 2024-03-25T09:23:32.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:31] INFO grpc.py:727: subsystem_add_ns: 12 2024-03-25T09:23:32.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:31] INFO grpc.py:826: Received request to add a namespace using NSID 12 and UUID 9f904d8b-a338-41f5-9e74-b160cf3fdaf8 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:32.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:31] INFO grpc.py:294: Received request to create bdev bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8 from mypool/myimage52 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:32.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:31.654826] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8 rbd disk to lun 2024-03-25T09:23:32.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:31] INFO grpc.py:333: bdev_rbd_create: bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8, cluster_name cluster_context_2_0 2024-03-25T09:23:32.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:31] INFO grpc.py:704: Received request to add bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 12 and UUID 9f904d8b-a338-41f5-9e74-b160cf3fdaf8 2024-03-25T09:23:32.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:31] INFO grpc.py:727: subsystem_add_ns: 12 2024-03-25T09:23:32.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:32 smithi019 ceph-mon[29386]: pgmap v411: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:23:32.488 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:32.488 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:32.489 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage53 2024-03-25T09:23:32.489 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage53 --load-balancing-group 3 2024-03-25T09:23:32.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:32 smithi059 ceph-mon[32732]: pgmap v411: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:23:32.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:32 smithi040 ceph-mon[33094]: pgmap v411: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:23:32.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:32.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:32.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}]}] 2024-03-25T09:23:32.570 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:32Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:33.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:33.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:33.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}]}] 2024-03-25T09:23:33.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:33] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:32.781+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:33.285 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 13 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-25T09:23:33.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:33] INFO grpc.py:294: Received request to create bdev bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac from mypool/myimage53 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:33.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:33.268986] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac rbd disk to lun 2024-03-25T09:23:33.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:33] INFO grpc.py:333: bdev_rbd_create: bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac, cluster_name cluster_context_3_0 2024-03-25T09:23:33.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:33] INFO grpc.py:704: Received request to add bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID 2f7df32b-72a7-4a80-aea4-f802514d95ac 2024-03-25T09:23:33.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:33] INFO grpc.py:727: subsystem_add_ns: 13 2024-03-25T09:23:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:33] INFO grpc.py:826: Received request to add a namespace using NSID 13 and UUID 2f7df32b-72a7-4a80-aea4-f802514d95ac to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:33] INFO grpc.py:294: Received request to create bdev bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac from mypool/myimage53 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:33.292141] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac rbd disk to lun 2024-03-25T09:23:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:33] INFO grpc.py:333: bdev_rbd_create: bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac, cluster_name cluster_context_3_0 2024-03-25T09:23:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:33] INFO grpc.py:704: Received request to add bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 13 and UUID 2f7df32b-72a7-4a80-aea4-f802514d95ac 2024-03-25T09:23:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:33] INFO grpc.py:727: subsystem_add_ns: 13 2024-03-25T09:23:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:33.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}]}] 2024-03-25T09:23:33.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:33] INFO grpc.py:826: Received request to add a namespace using NSID 13 and UUID 2f7df32b-72a7-4a80-aea4-f802514d95ac to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:33.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:33] INFO grpc.py:294: Received request to create bdev bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac from mypool/myimage53 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:33.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:33.295091] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac rbd disk to lun 2024-03-25T09:23:33.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:33] INFO grpc.py:333: bdev_rbd_create: bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac, cluster_name cluster_context_3_0 2024-03-25T09:23:33.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:33] INFO grpc.py:704: Received request to add bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 13 and UUID 2f7df32b-72a7-4a80-aea4-f802514d95ac 2024-03-25T09:23:33.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:33] INFO grpc.py:727: subsystem_add_ns: 13 2024-03-25T09:23:34.233 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:34.233 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:34.233 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage54 2024-03-25T09:23:34.233 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage54 --load-balancing-group 1 2024-03-25T09:23:34.320 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:34Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:34.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:34 smithi019 ceph-mon[29386]: pgmap v412: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-25T09:23:34.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:34 smithi059 ceph-mon[32732]: pgmap v412: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-25T09:23:34.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:34 smithi040 ceph-mon[33094]: pgmap v412: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-25T09:23:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}]}] 2024-03-25T09:23:35.038 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 14 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-25T09:23:35.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:35.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:35.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}]}] 2024-03-25T09:23:35.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:35] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:35.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:35] INFO grpc.py:294: Received request to create bdev bdev_f98d9d61-ba09-4787-8d61-79740491a3ab from mypool/myimage54 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:35.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:35.021191] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f98d9d61-ba09-4787-8d61-79740491a3ab rbd disk to lun 2024-03-25T09:23:35.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:35] INFO grpc.py:333: bdev_rbd_create: bdev_f98d9d61-ba09-4787-8d61-79740491a3ab, cluster_name cluster_context_1_0 2024-03-25T09:23:35.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:35] INFO grpc.py:704: Received request to add bdev_f98d9d61-ba09-4787-8d61-79740491a3ab to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID f98d9d61-ba09-4787-8d61-79740491a3ab 2024-03-25T09:23:35.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:35] INFO grpc.py:727: subsystem_add_ns: 14 2024-03-25T09:23:35.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:35] INFO grpc.py:826: Received request to add a namespace using NSID 14 and UUID f98d9d61-ba09-4787-8d61-79740491a3ab to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:35.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:35] INFO grpc.py:294: Received request to create bdev bdev_f98d9d61-ba09-4787-8d61-79740491a3ab from mypool/myimage54 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:35.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:35.047610] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f98d9d61-ba09-4787-8d61-79740491a3ab rbd disk to lun 2024-03-25T09:23:35.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:35] INFO grpc.py:333: bdev_rbd_create: bdev_f98d9d61-ba09-4787-8d61-79740491a3ab, cluster_name cluster_context_1_0 2024-03-25T09:23:35.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:35] INFO grpc.py:704: Received request to add bdev_f98d9d61-ba09-4787-8d61-79740491a3ab to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 14 and UUID f98d9d61-ba09-4787-8d61-79740491a3ab 2024-03-25T09:23:35.312 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:35] INFO grpc.py:727: subsystem_add_ns: 14 2024-03-25T09:23:35.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:35] INFO grpc.py:826: Received request to add a namespace using NSID 14 and UUID f98d9d61-ba09-4787-8d61-79740491a3ab to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:35.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:35] INFO grpc.py:294: Received request to create bdev bdev_f98d9d61-ba09-4787-8d61-79740491a3ab from mypool/myimage54 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:35.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:35.048238] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_f98d9d61-ba09-4787-8d61-79740491a3ab rbd disk to lun 2024-03-25T09:23:35.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:35] INFO grpc.py:333: bdev_rbd_create: bdev_f98d9d61-ba09-4787-8d61-79740491a3ab, cluster_name cluster_context_1_0 2024-03-25T09:23:35.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:35] INFO grpc.py:704: Received request to add bdev_f98d9d61-ba09-4787-8d61-79740491a3ab to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 14 and UUID f98d9d61-ba09-4787-8d61-79740491a3ab 2024-03-25T09:23:35.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:35] INFO grpc.py:727: subsystem_add_ns: 14 2024-03-25T09:23:35.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:35 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 128 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:35.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:35 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 128 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:35.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:35.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:35.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}]}] 2024-03-25T09:23:35.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:35 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 128 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:35.833 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:35.833 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:35.833 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage55 2024-03-25T09:23:35.833 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage55 --load-balancing-group 2 2024-03-25T09:23:35.917 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:35Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:36 smithi040 ceph-mon[33094]: pgmap v413: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 136 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-25T09:23:36.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:36.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:36.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}]}] 2024-03-25T09:23:36.628 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:36 smithi019 ceph-mon[29386]: pgmap v413: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 136 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-25T09:23:36.657 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:36 smithi059 ceph-mon[32732]: pgmap v413: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 136 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-25T09:23:36.657 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 15 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-25T09:23:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:36] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:36.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:36] INFO grpc.py:294: Received request to create bdev bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 from mypool/myimage55 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:36.642193] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 rbd disk to lun 2024-03-25T09:23:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:36] INFO grpc.py:333: bdev_rbd_create: bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6, cluster_name cluster_context_2_0 2024-03-25T09:23:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:36] INFO grpc.py:704: Received request to add bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID 4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 2024-03-25T09:23:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:36] INFO grpc.py:727: subsystem_add_ns: 15 2024-03-25T09:23:37.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:36] INFO grpc.py:826: Received request to add a namespace using NSID 15 and UUID 4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:37.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:36] INFO grpc.py:294: Received request to create bdev bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 from mypool/myimage55 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:37.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:36.667974] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 rbd disk to lun 2024-03-25T09:23:37.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:36] INFO grpc.py:333: bdev_rbd_create: bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6, cluster_name cluster_context_2_0 2024-03-25T09:23:37.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:36] INFO grpc.py:704: Received request to add bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 15 and UUID 4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 2024-03-25T09:23:37.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:36] INFO grpc.py:727: subsystem_add_ns: 15 2024-03-25T09:23:37.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:36] INFO grpc.py:826: Received request to add a namespace using NSID 15 and UUID 4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:37.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:36] INFO grpc.py:294: Received request to create bdev bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 from mypool/myimage55 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:37.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:36.669459] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 rbd disk to lun 2024-03-25T09:23:37.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:36] INFO grpc.py:333: bdev_rbd_create: bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6, cluster_name cluster_context_2_0 2024-03-25T09:23:37.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:36] INFO grpc.py:704: Received request to add bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 15 and UUID 4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6 2024-03-25T09:23:37.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:36] INFO grpc.py:727: subsystem_add_ns: 15 2024-03-25T09:23:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}]}] 2024-03-25T09:23:37.492 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:37.492 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:37.493 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage56 2024-03-25T09:23:37.493 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage56 --load-balancing-group 3 2024-03-25T09:23:37.574 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:37Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:37.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:37.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:37.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}]}] 2024-03-25T09:23:38.066 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:37.782+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:38.311 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 16 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-25T09:23:38.319 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:38 smithi059 ceph-mon[32732]: pgmap v414: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:23:38.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:38] INFO grpc.py:826: Received request to add a namespace using NSID 16 and UUID d94c813c-d553-4574-8478-3ae3e0121084 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:38.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:38] INFO grpc.py:294: Received request to create bdev bdev_d94c813c-d553-4574-8478-3ae3e0121084 from mypool/myimage56 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:38.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:38.319916] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_d94c813c-d553-4574-8478-3ae3e0121084 rbd disk to lun 2024-03-25T09:23:38.320 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:38 smithi040 ceph-mon[33094]: pgmap v414: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:23:38.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:38.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:38.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}]}] 2024-03-25T09:23:38.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:38] INFO grpc.py:826: Received request to add a namespace using NSID 16 and UUID d94c813c-d553-4574-8478-3ae3e0121084 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:38.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:38] INFO grpc.py:294: Received request to create bdev bdev_d94c813c-d553-4574-8478-3ae3e0121084 from mypool/myimage56 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:38.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:38.321219] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_d94c813c-d553-4574-8478-3ae3e0121084 rbd disk to lun 2024-03-25T09:23:38.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:38] INFO grpc.py:333: bdev_rbd_create: bdev_d94c813c-d553-4574-8478-3ae3e0121084, cluster_name cluster_context_3_0 2024-03-25T09:23:38.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:38] INFO grpc.py:704: Received request to add bdev_d94c813c-d553-4574-8478-3ae3e0121084 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 16 and UUID d94c813c-d553-4574-8478-3ae3e0121084 2024-03-25T09:23:38.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:38 smithi019 ceph-mon[29386]: pgmap v414: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:23:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:38] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:38] INFO grpc.py:294: Received request to create bdev bdev_d94c813c-d553-4574-8478-3ae3e0121084 from mypool/myimage56 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:38.266496] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_d94c813c-d553-4574-8478-3ae3e0121084 rbd disk to lun 2024-03-25T09:23:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:38] INFO grpc.py:333: bdev_rbd_create: bdev_d94c813c-d553-4574-8478-3ae3e0121084, cluster_name cluster_context_3_0 2024-03-25T09:23:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:38] INFO grpc.py:704: Received request to add bdev_d94c813c-d553-4574-8478-3ae3e0121084 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID d94c813c-d553-4574-8478-3ae3e0121084 2024-03-25T09:23:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:38] INFO grpc.py:727: subsystem_add_ns: 16 2024-03-25T09:23:38.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:38] INFO grpc.py:333: bdev_rbd_create: bdev_d94c813c-d553-4574-8478-3ae3e0121084, cluster_name cluster_context_3_0 2024-03-25T09:23:38.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:38] INFO grpc.py:704: Received request to add bdev_d94c813c-d553-4574-8478-3ae3e0121084 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 16 and UUID d94c813c-d553-4574-8478-3ae3e0121084 2024-03-25T09:23:38.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:38] INFO grpc.py:727: subsystem_add_ns: 16 2024-03-25T09:23:38.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:38] INFO grpc.py:727: subsystem_add_ns: 16 2024-03-25T09:23:39.102 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:39.102 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:39.102 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage57 2024-03-25T09:23:39.102 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage57 --load-balancing-group 1 2024-03-25T09:23:39.190 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:39Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:39.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:39.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:39.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}]}] 2024-03-25T09:23:39.663 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:39.663 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:39.663 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}]}] 2024-03-25T09:23:39.893 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 17 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-25T09:23:40.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:39] INFO grpc.py:826: Received request to add a namespace using NSID 17 and UUID 227db23a-385d-43e4-a0c7-d15fbb3badfc to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:40.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:39] INFO grpc.py:294: Received request to create bdev bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc from mypool/myimage57 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:40.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:39.903711] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc rbd disk to lun 2024-03-25T09:23:40.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:39] INFO grpc.py:333: bdev_rbd_create: bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc, cluster_name cluster_context_1_0 2024-03-25T09:23:40.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:39] INFO grpc.py:704: Received request to add bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 17 and UUID 227db23a-385d-43e4-a0c7-d15fbb3badfc 2024-03-25T09:23:40.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:39] INFO grpc.py:727: subsystem_add_ns: 17 2024-03-25T09:23:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:40 smithi019 ceph-mon[29386]: pgmap v415: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s rd, 1.9 KiB/s wr, 52 op/s 2024-03-25T09:23:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:39] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:39] INFO grpc.py:294: Received request to create bdev bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc from mypool/myimage57 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:39.878689] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc rbd disk to lun 2024-03-25T09:23:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:39] INFO grpc.py:333: bdev_rbd_create: bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc, cluster_name cluster_context_1_0 2024-03-25T09:23:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:39] INFO grpc.py:704: Received request to add bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID 227db23a-385d-43e4-a0c7-d15fbb3badfc 2024-03-25T09:23:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:39] INFO grpc.py:727: subsystem_add_ns: 17 2024-03-25T09:23:40.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:40 smithi040 ceph-mon[33094]: pgmap v415: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s rd, 1.9 KiB/s wr, 52 op/s 2024-03-25T09:23:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:39] INFO grpc.py:826: Received request to add a namespace using NSID 17 and UUID 227db23a-385d-43e4-a0c7-d15fbb3badfc to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:39] INFO grpc.py:294: Received request to create bdev bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc from mypool/myimage57 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:39.900541] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc rbd disk to lun 2024-03-25T09:23:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:39] INFO grpc.py:333: bdev_rbd_create: bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc, cluster_name cluster_context_1_0 2024-03-25T09:23:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:39] INFO grpc.py:704: Received request to add bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 17 and UUID 227db23a-385d-43e4-a0c7-d15fbb3badfc 2024-03-25T09:23:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:39] INFO grpc.py:727: subsystem_add_ns: 17 2024-03-25T09:23:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}]}] 2024-03-25T09:23:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:40 smithi059 ceph-mon[32732]: pgmap v415: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s rd, 1.9 KiB/s wr, 52 op/s 2024-03-25T09:23:40.712 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:40.712 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:40.712 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage58 2024-03-25T09:23:40.712 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage58 --load-balancing-group 2 2024-03-25T09:23:40.798 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:40Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:41.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:41 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 138 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:41.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:41 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 138 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:41.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:41.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:41.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}]}] 2024-03-25T09:23:41.475 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:41 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 138 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:41.476 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 18 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-25T09:23:41.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:41.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:41.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}]}] 2024-03-25T09:23:41.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:41] INFO grpc.py:826: Received request to add a namespace using NSID 18 and UUID 8ead3d18-f904-4e45-a1fc-02b8326ad2c8 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:41.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:41] INFO grpc.py:294: Received request to create bdev bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8 from mypool/myimage58 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:41.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:41.487179] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8 rbd disk to lun 2024-03-25T09:23:41.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:41] INFO grpc.py:333: bdev_rbd_create: bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8, cluster_name cluster_context_2_0 2024-03-25T09:23:41.763 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:41] INFO grpc.py:704: Received request to add bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 18 and UUID 8ead3d18-f904-4e45-a1fc-02b8326ad2c8 2024-03-25T09:23:41.763 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:41] INFO grpc.py:727: subsystem_add_ns: 18 2024-03-25T09:23:41.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:41] INFO grpc.py:826: Received request to add a namespace using NSID 18 and UUID 8ead3d18-f904-4e45-a1fc-02b8326ad2c8 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:41.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:41] INFO grpc.py:294: Received request to create bdev bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8 from mypool/myimage58 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:41.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:41.483497] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8 rbd disk to lun 2024-03-25T09:23:41.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:41] INFO grpc.py:333: bdev_rbd_create: bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8, cluster_name cluster_context_2_0 2024-03-25T09:23:41.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:41] INFO grpc.py:704: Received request to add bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 18 and UUID 8ead3d18-f904-4e45-a1fc-02b8326ad2c8 2024-03-25T09:23:41.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:41] INFO grpc.py:727: subsystem_add_ns: 18 2024-03-25T09:23:41.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:41] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:41.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:41] INFO grpc.py:294: Received request to create bdev bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8 from mypool/myimage58 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:41.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:41.460529] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8 rbd disk to lun 2024-03-25T09:23:41.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:41] INFO grpc.py:333: bdev_rbd_create: bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8, cluster_name cluster_context_2_0 2024-03-25T09:23:41.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:41] INFO grpc.py:704: Received request to add bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID 8ead3d18-f904-4e45-a1fc-02b8326ad2c8 2024-03-25T09:23:41.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:41] INFO grpc.py:727: subsystem_add_ns: 18 2024-03-25T09:23:42.272 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:42.272 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:42.272 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage59 2024-03-25T09:23:42.272 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage59 --load-balancing-group 3 2024-03-25T09:23:42.366 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:42Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:42.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:42 smithi019 ceph-mon[29386]: pgmap v416: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 1.6 KiB/s wr, 62 op/s 2024-03-25T09:23:42.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:42 smithi059 ceph-mon[32732]: pgmap v416: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 1.6 KiB/s wr, 62 op/s 2024-03-25T09:23:42.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:42 smithi040 ceph-mon[33094]: pgmap v416: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 1.6 KiB/s wr, 62 op/s 2024-03-25T09:23:42.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:42.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:42.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}]}] 2024-03-25T09:23:43.089 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:42.783+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:43.091 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 19 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-25T09:23:43.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:43.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:43.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}]}] 2024-03-25T09:23:43.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:43] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:43.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:43] INFO grpc.py:294: Received request to create bdev bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239 from mypool/myimage59 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:43.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:43.076378] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239 rbd disk to lun 2024-03-25T09:23:43.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:43] INFO grpc.py:333: bdev_rbd_create: bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239, cluster_name cluster_context_3_0 2024-03-25T09:23:43.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:43] INFO grpc.py:704: Received request to add bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID a641cd3c-533e-45f4-8c2a-fe9277ce1239 2024-03-25T09:23:43.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:43] INFO grpc.py:727: subsystem_add_ns: 19 2024-03-25T09:23:43.361 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:43] INFO grpc.py:826: Received request to add a namespace using NSID 19 and UUID a641cd3c-533e-45f4-8c2a-fe9277ce1239 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:43.361 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:43] INFO grpc.py:294: Received request to create bdev bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239 from mypool/myimage59 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:43.361 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:43.098695] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239 rbd disk to lun 2024-03-25T09:23:43.361 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:43] INFO grpc.py:333: bdev_rbd_create: bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239, cluster_name cluster_context_3_0 2024-03-25T09:23:43.361 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:43] INFO grpc.py:704: Received request to add bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 19 and UUID a641cd3c-533e-45f4-8c2a-fe9277ce1239 2024-03-25T09:23:43.361 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:43] INFO grpc.py:727: subsystem_add_ns: 19 2024-03-25T09:23:43.362 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:43.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:43] INFO grpc.py:826: Received request to add a namespace using NSID 19 and UUID a641cd3c-533e-45f4-8c2a-fe9277ce1239 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:43.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:43] INFO grpc.py:294: Received request to create bdev bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239 from mypool/myimage59 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:43.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:43.100105] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239 rbd disk to lun 2024-03-25T09:23:43.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:43] INFO grpc.py:333: bdev_rbd_create: bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239, cluster_name cluster_context_3_0 2024-03-25T09:23:43.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:43] INFO grpc.py:704: Received request to add bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 19 and UUID a641cd3c-533e-45f4-8c2a-fe9277ce1239 2024-03-25T09:23:43.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:43] INFO grpc.py:727: subsystem_add_ns: 19 2024-03-25T09:23:43.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:43.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}]}] 2024-03-25T09:23:43.991 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:43.992 INFO:tasks.workunit.client.3.smithi129.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-25T09:23:43.992 INFO:tasks.workunit.client.3.smithi129.stderr:+ image=myimage60 2024-03-25T09:23:43.992 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage60 --load-balancing-group 1 2024-03-25T09:23:44.090 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:44Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:44 smithi019 ceph-mon[29386]: pgmap v417: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:23:44.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:44 smithi040 ceph-mon[33094]: pgmap v417: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:23:44.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:44.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:44.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}]}] 2024-03-25T09:23:44.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:44 smithi059 ceph-mon[32732]: pgmap v417: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-25T09:23:44.817 INFO:tasks.workunit.client.3.smithi129.stdout:Adding namespace 20 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-25T09:23:45.053 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:44] INFO grpc.py:826: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:45.054 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:44] INFO grpc.py:294: Received request to create bdev bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603 from mypool/myimage60 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:45.054 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [2024-03-25 09:23:44.801923] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603 rbd disk to lun 2024-03-25T09:23:45.054 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:44] INFO grpc.py:333: bdev_rbd_create: bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603, cluster_name cluster_context_1_0 2024-03-25T09:23:45.054 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:44] INFO grpc.py:704: Received request to add bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID 79bf4b6e-621f-48b3-8331-1a0e6950f603 2024-03-25T09:23:45.054 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:44] INFO grpc.py:727: subsystem_add_ns: 20 2024-03-25T09:23:45.054 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:45.261 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:44] INFO grpc.py:826: Received request to add a namespace using NSID 20 and UUID 79bf4b6e-621f-48b3-8331-1a0e6950f603 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:45.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:44] INFO grpc.py:294: Received request to create bdev bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603 from mypool/myimage60 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:45.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [2024-03-25 09:23:44.827394] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603 rbd disk to lun 2024-03-25T09:23:45.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:44] INFO grpc.py:333: bdev_rbd_create: bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603, cluster_name cluster_context_1_0 2024-03-25T09:23:45.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:44] INFO grpc.py:704: Received request to add bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 20 and UUID 79bf4b6e-621f-48b3-8331-1a0e6950f603 2024-03-25T09:23:45.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:44] INFO grpc.py:727: subsystem_add_ns: 20 2024-03-25T09:23:45.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:44] INFO grpc.py:826: Received request to add a namespace using NSID 20 and UUID 79bf4b6e-621f-48b3-8331-1a0e6950f603 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-25T09:23:45.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:44] INFO grpc.py:294: Received request to create bdev bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603 from mypool/myimage60 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-25T09:23:45.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [2024-03-25 09:23:44.823459] bdev_rbd.c:1227:bdev_rbd_create: *NOTICE*: Add bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603 rbd disk to lun 2024-03-25T09:23:45.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:44] INFO grpc.py:333: bdev_rbd_create: bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603, cluster_name cluster_context_1_0 2024-03-25T09:23:45.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:44] INFO grpc.py:704: Received request to add bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 20 and UUID 79bf4b6e-621f-48b3-8331-1a0e6950f603 2024-03-25T09:23:45.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:44] INFO grpc.py:727: subsystem_add_ns: 20 2024-03-25T09:23:45.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:45.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:45.650 INFO:tasks.workunit.client.3.smithi129.stderr:+ (( image_index++ )) 2024-03-25T09:23:45.650 INFO:tasks.workunit.client.3.smithi129.stderr:+ list_subsystems 2024-03-25T09:23:45.651 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:23:45.651 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.19 2024-03-25T09:23:45.651 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 --format json subsystem list 2024-03-25T09:23:45.745 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:45Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:45.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:45.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:45.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:46.393 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:46 smithi019 ceph-mon[29386]: pgmap v418: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-25T09:23:46.393 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:46 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 143 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:46.400 INFO:tasks.workunit.client.3.smithi129.stdout:{ 2024-03-25T09:23:46.400 INFO:tasks.workunit.client.3.smithi129.stdout: "error_message": "Success", 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "subsystems": [ 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph48566432277082", 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 4081, 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 6120, 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 20, 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-25T09:23:46.401 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph21611557036653", 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 4081, 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 6120, 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 20, 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph70543347611932", 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:23:46.402 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 4081, 2024-03-25T09:23:46.403 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 6120, 2024-03-25T09:23:46.403 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 20, 2024-03-25T09:23:46.403 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:23:46.403 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256 2024-03-25T09:23:46.403 INFO:tasks.workunit.client.3.smithi129.stdout: } 2024-03-25T09:23:46.403 INFO:tasks.workunit.client.3.smithi129.stdout: ], 2024-03-25T09:23:46.403 INFO:tasks.workunit.client.3.smithi129.stdout: "status": 0 2024-03-25T09:23:46.403 INFO:tasks.workunit.client.3.smithi129.stdout:} 2024-03-25T09:23:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:46 smithi059 ceph-mon[32732]: pgmap v418: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-25T09:23:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:46 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 143 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:46 smithi040 ceph-mon[33094]: pgmap v418: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-25T09:23:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:46 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 143 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:46.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:46.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:46.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:46.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:46] INFO grpc.py:2200: Received request to list the subsystem, context: 2024-03-25T09:23:46.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:46] INFO grpc.py:2208: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid' 2024-03-25T09:23:46.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: : '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:46.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:46] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:23:46.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:46] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:23:46.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:46] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:23:47.309 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:23:47.309 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.40 2024-03-25T09:23:47.309 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.40 --server-port 5500 --format json subsystem list 2024-03-25T09:23:47.396 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:47Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:47.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:47.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:47.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:47.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:47.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:47.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:48.067 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:47.783+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:48.082 INFO:tasks.workunit.client.3.smithi129.stdout:{ 2024-03-25T09:23:48.082 INFO:tasks.workunit.client.3.smithi129.stdout: "error_message": "Success", 2024-03-25T09:23:48.082 INFO:tasks.workunit.client.3.smithi129.stdout: "subsystems": [ 2024-03-25T09:23:48.082 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:23:48.082 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph48566432277082", 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 2041, 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 4080, 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 20, 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph21611557036653", 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 2041, 2024-03-25T09:23:48.083 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 4080, 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 20, 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph70543347611932", 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 2041, 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 4080, 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 20, 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: } 2024-03-25T09:23:48.084 INFO:tasks.workunit.client.3.smithi129.stdout: ], 2024-03-25T09:23:48.085 INFO:tasks.workunit.client.3.smithi129.stdout: "status": 0 2024-03-25T09:23:48.085 INFO:tasks.workunit.client.3.smithi129.stdout:} 2024-03-25T09:23:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:48 smithi019 ceph-mon[29386]: pgmap v419: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-25T09:23:48.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:48 smithi059 ceph-mon[32732]: pgmap v419: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-25T09:23:48.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:48 smithi040 ceph-mon[33094]: pgmap v419: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-25T09:23:48.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:48] INFO grpc.py:2200: Received request to list the subsystem, context: 2024-03-25T09:23:48.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:48] INFO grpc.py:2208: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid' 2024-03-25T09:23:48.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: : '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:48.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:48] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:23:48.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:48] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:23:48.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:48] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:23:48.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:48.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:48.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:48.855 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-25T09:23:48.856 INFO:tasks.workunit.client.3.smithi129.stderr:+ ip=172.21.15.59 2024-03-25T09:23:48.856 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.59 --server-port 5500 --format json subsystem list 2024-03-25T09:23:48.930 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:48Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:49.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:49.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:49.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:49.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:49.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:49.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:49.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:49] INFO grpc.py:2200: Received request to list the subsystem, context: 2024-03-25T09:23:49.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:49] INFO grpc.py:2208: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035 2024-03-25T09:23:49.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:49.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:49] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:23:49.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:49] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:23:49.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:49] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:23:49.651 INFO:tasks.workunit.client.3.smithi129.stdout:{ 2024-03-25T09:23:49.651 INFO:tasks.workunit.client.3.smithi129.stdout: "error_message": "Success", 2024-03-25T09:23:49.651 INFO:tasks.workunit.client.3.smithi129.stdout: "subsystems": [ 2024-03-25T09:23:49.651 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:23:49.651 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-25T09:23:49.651 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:23:49.651 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph48566432277082", 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 1, 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 2040, 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 20, 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph21611557036653", 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 1, 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 2040, 2024-03-25T09:23:49.652 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 20, 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: }, 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: { 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "enable_ha": true, 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "serial_number": "Ceph70543347611932", 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "model_number": "Ceph bdev Controller", 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "min_cntlid": 1, 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "max_cntlid": 2040, 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "namespace_count": 20, 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "subtype": "NVMe", 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: "max_namespaces": 256 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: } 2024-03-25T09:23:49.653 INFO:tasks.workunit.client.3.smithi129.stdout: ], 2024-03-25T09:23:49.654 INFO:tasks.workunit.client.3.smithi129.stdout: "status": 0 2024-03-25T09:23:49.654 INFO:tasks.workunit.client.3.smithi129.stdout:} 2024-03-25T09:23:50.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:50 smithi019 ceph-mon[29386]: pgmap v420: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 1.7 KiB/s wr, 55 op/s 2024-03-25T09:23:50.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:50 smithi059 ceph-mon[32732]: pgmap v420: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 1.7 KiB/s wr, 55 op/s 2024-03-25T09:23:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:50 smithi040 ceph-mon[33094]: pgmap v420: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 1.7 KiB/s wr, 55 op/s 2024-03-25T09:23:50.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:50.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:50.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:50.558 INFO:tasks.workunit.client.3.smithi129.stderr:++ seq 1 3 2024-03-25T09:23:50.559 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:23:50.559 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-25T09:23:50.559 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 --format plain namespace list --subsystem nqn.2016-06.io.spdk:cnode1 2024-03-25T09:23:50.650 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:50Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:51.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:51.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:51.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:51.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:51] INFO grpc.py:1117: Received request to list all namespaces for nqn.2016-06.io.spdk:cnode1, context: 2024-03-25T09:23:51.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:51] INFO grpc.py:1122: list_namespaces: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}] 2024-03-25T09:23:51.494 INFO:tasks.workunit.client.3.smithi129.stdout:Namespaces in subsystem nqn.2016-06.io.spdk:cnode1: 2024-03-25T09:23:51.494 INFO:tasks.workunit.client.3.smithi129.stdout: NSID Bdev RBD RBD Image Block UUID Load R/W IOs R/W MBs Read MBs Write MBs 2024-03-25T09:23:51.494 INFO:tasks.workunit.client.3.smithi129.stdout: Name Pool Image Size Size Balancing per per per per 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: Group second second second second 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 1 bdev_9348e01d-cee8- mypool myimage1 8 GiB 512 B 9348e01d-cee8-403d- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 403d-bb54-53970ff1ea16 bb54-53970ff1ea16 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 2 bdev_ec2f9973-1e51- mypool myimage2 8 GiB 512 B ec2f9973-1e51-46f2- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 46f2-b483-e3d5c29585fe b483-e3d5c29585fe 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 3 bdev_dad17cdf-8065- mypool myimage3 8 GiB 512 B dad17cdf-8065-4627- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 4627-8ab8-7463052c2015 8ab8-7463052c2015 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 4 bdev_35f3505f-88ed- mypool myimage4 8 GiB 512 B 35f3505f-88ed-414f- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 414f-b648-59aa4a961c41 b648-59aa4a961c41 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 5 bdev_94a7c175-9506- mypool myimage5 8 GiB 512 B 94a7c175-9506-4f46- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 4f46-951b-5cfcf9926b02 951b-5cfcf9926b02 2024-03-25T09:23:51.495 INFO:tasks.workunit.client.3.smithi129.stdout: 6 bdev_5625280c-ac4b- mypool myimage6 8 GiB 512 B 5625280c-ac4b-4ac7- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 4ac7-8303-2044d130bb4a 8303-2044d130bb4a 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 7 bdev_db665a65-d3b0- mypool myimage7 8 GiB 512 B db665a65-d3b0-4cc5- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 4cc5-b87c-c623e77ea38a b87c-c623e77ea38a 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 8 bdev_c84ffc5f-6335- mypool myimage8 8 GiB 512 B c84ffc5f-6335-4b22- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 4b22-858e-f4e302c3ca1d 858e-f4e302c3ca1d 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 9 bdev_cfac5177-80a6- mypool myimage9 8 GiB 512 B cfac5177-80a6-48b3- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 48b3-9cfe-623acba5e940 9cfe-623acba5e940 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 10 bdev_1d4c97a4-a950- mypool myimage10 8 GiB 512 B 1d4c97a4-a950-45bc- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 45bc-9517-9e4618e2a30d 9517-9e4618e2a30d 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 11 bdev_abf15eea-7fca- mypool myimage11 8 GiB 512 B abf15eea-7fca-456e- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 456e-a25b-48d067aee8bd a25b-48d067aee8bd 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 12 bdev_3020f654-8f85- mypool myimage12 8 GiB 512 B 3020f654-8f85-4773- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.496 INFO:tasks.workunit.client.3.smithi129.stdout: 4773-b868-1e2603567d08 b868-1e2603567d08 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 13 bdev_8c66140e-b02b- mypool myimage13 8 GiB 512 B 8c66140e-b02b-4f7c- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 4f7c-a095-3fba10f63656 a095-3fba10f63656 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 14 bdev_e28eedce-ad53- mypool myimage14 8 GiB 512 B e28eedce-ad53-4fcb- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 4fcb-b8ca-a4e93d49e613 b8ca-a4e93d49e613 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 15 bdev_980bdbda-0d04- mypool myimage15 8 GiB 512 B 980bdbda-0d04-42f7- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 42f7-b22e-3bf9062a7e97 b22e-3bf9062a7e97 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 16 bdev_111fd48c-55a6- mypool myimage16 8 GiB 512 B 111fd48c-55a6-4b8b- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 4b8b-8fc1-ab645d2e177d 8fc1-ab645d2e177d 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 17 bdev_9042541e-2b4e- mypool myimage17 8 GiB 512 B 9042541e-2b4e-4b32- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 4b32-8722-3d8b54f30519 8722-3d8b54f30519 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 18 bdev_ce6b322f-6392- mypool myimage18 8 GiB 512 B ce6b322f-6392-498b- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 498b-b5fa-c9cae8cff068 b5fa-c9cae8cff068 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 19 bdev_3372559d-2e5c- mypool myimage19 8 GiB 512 B 3372559d-2e5c-4244- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.497 INFO:tasks.workunit.client.3.smithi129.stdout: 4244-ab43-15dfcc15b9ff ab43-15dfcc15b9ff 2024-03-25T09:23:51.498 INFO:tasks.workunit.client.3.smithi129.stdout: 20 bdev_a1ef7b58-ccef- mypool myimage20 8 GiB 512 B a1ef7b58-ccef-4b5e- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:51.498 INFO:tasks.workunit.client.3.smithi129.stdout: 4b5e-b39d-ba06291661f6 b39d-ba06291661f6 2024-03-25T09:23:51.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:51.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:51.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:52.301 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:23:52.301 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-25T09:23:52.301 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 --format plain namespace list --subsystem nqn.2016-06.io.spdk:cnode2 2024-03-25T09:23:52.386 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:52Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:52 smithi019 ceph-mon[29386]: pgmap v421: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 1.2 KiB/s wr, 49 op/s 2024-03-25T09:23:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:52 smithi059 ceph-mon[32732]: pgmap v421: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 1.2 KiB/s wr, 49 op/s 2024-03-25T09:23:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:52 smithi040 ceph-mon[33094]: pgmap v421: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 1.2 KiB/s wr, 49 op/s 2024-03-25T09:23:52.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:52.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:52.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout:Namespaces in subsystem nqn.2016-06.io.spdk:cnode2: 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout: NSID Bdev RBD RBD Image Block UUID Load R/W IOs R/W MBs Read MBs Write MBs 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout: Name Pool Image Size Size Balancing per per per per 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout: Group second second second second 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout: 1 bdev_0e7c9df9-4e2b- mypool myimage21 8 GiB 512 B 0e7c9df9-4e2b-4d6e- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout: 4d6e-8c5e-cdbcd8673fc8 8c5e-cdbcd8673fc8 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout: 2 bdev_8152cee8-8d2b- mypool myimage22 8 GiB 512 B 8152cee8-8d2b-415a- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout: 415a-ac00-822531debce3 ac00-822531debce3 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout: 3 bdev_1b4f6c4b-2e43- mypool myimage23 8 GiB 512 B 1b4f6c4b-2e43-4361- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout: 4361-953c-a9a83224db65 953c-a9a83224db65 2024-03-25T09:23:53.251 INFO:tasks.workunit.client.3.smithi129.stdout: 4 bdev_84b837fb-53a0- mypool myimage24 8 GiB 512 B 84b837fb-53a0-48a0- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 48a0-9c3b-d546be3f13ad 9c3b-d546be3f13ad 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 5 bdev_10e7459c-f430- mypool myimage25 8 GiB 512 B 10e7459c-f430-4a5b- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 4a5b-8236-b9fcbf95f3a9 8236-b9fcbf95f3a9 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 6 bdev_aad1627f-b632- mypool myimage26 8 GiB 512 B aad1627f-b632-4c58- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 4c58-9c41-ef7d1846a13e 9c41-ef7d1846a13e 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 7 bdev_926c1429-34b4- mypool myimage27 8 GiB 512 B 926c1429-34b4-4551- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 4551-97c7-318bf5dfa876 97c7-318bf5dfa876 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 8 bdev_29dba39d-1be4- mypool myimage28 8 GiB 512 B 29dba39d-1be4-4646- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 4646-b04c-d3d692f2847a b04c-d3d692f2847a 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 9 bdev_8303b2b0-3e51- mypool myimage29 8 GiB 512 B 8303b2b0-3e51-485f- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 485f-82d6-8c2e377307d0 82d6-8c2e377307d0 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 10 bdev_8ba967bc-4f6a- mypool myimage30 8 GiB 512 B 8ba967bc-4f6a-4613- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.252 INFO:tasks.workunit.client.3.smithi129.stdout: 4613-9496-8d3412cc4aac 9496-8d3412cc4aac 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 11 bdev_141ddca5-7f42- mypool myimage31 8 GiB 512 B 141ddca5-7f42-4f88- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 4f88-96c3-e6bc93fb0d08 96c3-e6bc93fb0d08 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 12 bdev_035b3e5a-d391- mypool myimage32 8 GiB 512 B 035b3e5a-d391-4bf4- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 4bf4-9e91-07424831f76f 9e91-07424831f76f 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 13 bdev_dd79c772-7cf8- mypool myimage33 8 GiB 512 B dd79c772-7cf8-4fed- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 4fed-9a85-db14e97b125a 9a85-db14e97b125a 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 14 bdev_e03ab02b-edc2- mypool myimage34 8 GiB 512 B e03ab02b-edc2-4cb3- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 4cb3-981a-35a3c60cebe7 981a-35a3c60cebe7 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 15 bdev_169d87cc-4d44- mypool myimage35 8 GiB 512 B 169d87cc-4d44-45e6- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 45e6-8a50-fc26ccf7e965 8a50-fc26ccf7e965 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 16 bdev_ab28eebb-ebca- mypool myimage36 8 GiB 512 B ab28eebb-ebca-411f- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 411f-b32a-388f2d3fd613 b32a-388f2d3fd613 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 17 bdev_da521597-93a5- mypool myimage37 8 GiB 512 B da521597-93a5-4fb1- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 4fb1-a071-740e044cbe6d a071-740e044cbe6d 2024-03-25T09:23:53.253 INFO:tasks.workunit.client.3.smithi129.stdout: 18 bdev_f3ce6bce-adaf- mypool myimage38 8 GiB 512 B f3ce6bce-adaf-4d35- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.254 INFO:tasks.workunit.client.3.smithi129.stdout: 4d35-9e72-c8a9cbb6a0b7 9e72-c8a9cbb6a0b7 2024-03-25T09:23:53.254 INFO:tasks.workunit.client.3.smithi129.stdout: 19 bdev_23ab2e57-b7cc- mypool myimage39 8 GiB 512 B 23ab2e57-b7cc-4e00- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.254 INFO:tasks.workunit.client.3.smithi129.stdout: 4e00-b0c8-28be1b5d1c7b b0c8-28be1b5d1c7b 2024-03-25T09:23:53.254 INFO:tasks.workunit.client.3.smithi129.stdout: 20 bdev_f14b3c52-f718- mypool myimage40 8 GiB 512 B f14b3c52-f718-4626- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:53.254 INFO:tasks.workunit.client.3.smithi129.stdout: 4626-b469-70f2660a35bd b469-70f2660a35bd 2024-03-25T09:23:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:52.783+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:53.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:53] INFO grpc.py:1117: Received request to list all namespaces for nqn.2016-06.io.spdk:cnode2, context: 2024-03-25T09:23:53.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:53] INFO grpc.py:1122: list_namespaces: [{'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}] 2024-03-25T09:23:53.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:53.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:53.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:53.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:53.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:53.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:54.154 INFO:tasks.workunit.client.3.smithi129.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-25T09:23:54.154 INFO:tasks.workunit.client.3.smithi129.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-25T09:23:54.154 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:1.1.0 --server-address 172.21.15.19 --server-port 5500 --format plain namespace list --subsystem nqn.2016-06.io.spdk:cnode3 2024-03-25T09:23:54.229 INFO:tasks.workunit.client.3.smithi129.stderr:time="2024-03-25T09:23:54Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-25T09:23:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:54 smithi019 ceph-mon[29386]: pgmap v422: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 1023 B/s wr, 34 op/s 2024-03-25T09:23:54.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:54 smithi059 ceph-mon[32732]: pgmap v422: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 1023 B/s wr, 34 op/s 2024-03-25T09:23:54.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:54 smithi040 ceph-mon[33094]: pgmap v422: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 1023 B/s wr, 34 op/s 2024-03-25T09:23:54.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:54.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:54.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:55.106 INFO:tasks.workunit.client.3.smithi129.stdout:Namespaces in subsystem nqn.2016-06.io.spdk:cnode3: 2024-03-25T09:23:55.106 INFO:tasks.workunit.client.3.smithi129.stdout: NSID Bdev RBD RBD Image Block UUID Load R/W IOs R/W MBs Read MBs Write MBs 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: Name Pool Image Size Size Balancing per per per per 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: Group second second second second 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 1 bdev_a19c2ca6-9d8d- mypool myimage41 8 GiB 512 B a19c2ca6-9d8d-4af8- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 4af8-a9a4-46e7d4f16813 a9a4-46e7d4f16813 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 2 bdev_865c2cfb-34c8- mypool myimage42 8 GiB 512 B 865c2cfb-34c8-42ae- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 42ae-8d01-e76ef759818b 8d01-e76ef759818b 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 3 bdev_acfee7b5-f951- mypool myimage43 8 GiB 512 B acfee7b5-f951-45a0- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 45a0-b42d-b09f604dafcb b42d-b09f604dafcb 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 4 bdev_4a34c4b4-f560- mypool myimage44 8 GiB 512 B 4a34c4b4-f560-4567- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 4567-b539-6bc6744c9b39 b539-6bc6744c9b39 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 5 bdev_f2ad3452-90c9- mypool myimage45 8 GiB 512 B f2ad3452-90c9-4131- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 4131-b6f0-d56addb6353c b6f0-d56addb6353c 2024-03-25T09:23:55.107 INFO:tasks.workunit.client.3.smithi129.stdout: 6 bdev_112277d6-d6c6- mypool myimage46 8 GiB 512 B 112277d6-d6c6-4116- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 4116-af7d-f4fc49f0462c af7d-f4fc49f0462c 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 7 bdev_9d1ef92b-a4aa- mypool myimage47 8 GiB 512 B 9d1ef92b-a4aa-4e44- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 4e44-ad5c-32586fb79017 ad5c-32586fb79017 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 8 bdev_63f2150c-8681- mypool myimage48 8 GiB 512 B 63f2150c-8681-4a84- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 4a84-86c2-5ce8bd7d9cbd 86c2-5ce8bd7d9cbd 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 9 bdev_a647aac4-e136- mypool myimage49 8 GiB 512 B a647aac4-e136-4fe9- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 4fe9-b55f-3aab19d8ceee b55f-3aab19d8ceee 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 10 bdev_4d16afb7-d6ac- mypool myimage50 8 GiB 512 B 4d16afb7-d6ac-4790- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 4790-85dd-ee7d5289e0cf 85dd-ee7d5289e0cf 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 11 bdev_cd4f7186-6ab9- mypool myimage51 8 GiB 512 B cd4f7186-6ab9-492e- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 492e-bd7a-e0fe92d12b17 bd7a-e0fe92d12b17 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 12 bdev_9f904d8b-a338- mypool myimage52 8 GiB 512 B 9f904d8b-a338-41f5- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.108 INFO:tasks.workunit.client.3.smithi129.stdout: 41f5-9e74-b160cf3fdaf8 9e74-b160cf3fdaf8 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 13 bdev_2f7df32b-72a7- mypool myimage53 8 GiB 512 B 2f7df32b-72a7-4a80- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 4a80-aea4-f802514d95ac aea4-f802514d95ac 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 14 bdev_f98d9d61-ba09- mypool myimage54 8 GiB 512 B f98d9d61-ba09-4787- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 4787-8d61-79740491a3ab 8d61-79740491a3ab 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 15 bdev_4ed4cb0c-d52b- mypool myimage55 8 GiB 512 B 4ed4cb0c-d52b-4017- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 4017-9a34-cc7bc81f2ed6 9a34-cc7bc81f2ed6 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 16 bdev_d94c813c-d553- mypool myimage56 8 GiB 512 B d94c813c-d553-4574- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 4574-8478-3ae3e0121084 8478-3ae3e0121084 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 17 bdev_227db23a-385d- mypool myimage57 8 GiB 512 B 227db23a-385d-43e4- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 43e4-a0c7-d15fbb3badfc a0c7-d15fbb3badfc 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 18 bdev_8ead3d18-f904- mypool myimage58 8 GiB 512 B 8ead3d18-f904-4e45- 2 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 4e45-a1fc-02b8326ad2c8 a1fc-02b8326ad2c8 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 19 bdev_a641cd3c-533e- mypool myimage59 8 GiB 512 B a641cd3c-533e-45f4- 3 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 45f4-8c2a-fe9277ce1239 8c2a-fe9277ce1239 2024-03-25T09:23:55.109 INFO:tasks.workunit.client.3.smithi129.stdout: 20 bdev_79bf4b6e-621f- mypool myimage60 8 GiB 512 B 79bf4b6e-621f-48b3- 1 unlimited unlimited unlimited unlimited 2024-03-25T09:23:55.110 INFO:tasks.workunit.client.3.smithi129.stdout: 48b3-8331-1a0e6950f603 8331-1a0e6950f603 2024-03-25T09:23:55.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:54] INFO grpc.py:1117: Received request to list all namespaces for nqn.2016-06.io.spdk:cnode3, context: 2024-03-25T09:23:55.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:54] INFO grpc.py:1122: list_namespaces: [{'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:55.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:55.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:55 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 148 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:55.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:55.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:55.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:55 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 148 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:55.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:55.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:55.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:55.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:55 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 148 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:23:55.923 INFO:tasks.workunit.client.3.smithi129.stderr:+ lscpu 2024-03-25T09:23:55.950 INFO:tasks.workunit.client.3.smithi129.stdout:Architecture: x86_64 2024-03-25T09:23:55.951 INFO:tasks.workunit.client.3.smithi129.stdout:CPU op-mode(s): 32-bit, 64-bit 2024-03-25T09:23:55.951 INFO:tasks.workunit.client.3.smithi129.stdout:Address sizes: 46 bits physical, 48 bits virtual 2024-03-25T09:23:55.951 INFO:tasks.workunit.client.3.smithi129.stdout:Byte Order: Little Endian 2024-03-25T09:23:55.951 INFO:tasks.workunit.client.3.smithi129.stdout:CPU(s): 8 2024-03-25T09:23:55.951 INFO:tasks.workunit.client.3.smithi129.stdout:On-line CPU(s) list: 0-7 2024-03-25T09:23:55.951 INFO:tasks.workunit.client.3.smithi129.stdout:Vendor ID: GenuineIntel 2024-03-25T09:23:55.951 INFO:tasks.workunit.client.3.smithi129.stdout:Model name: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz 2024-03-25T09:23:55.952 INFO:tasks.workunit.client.3.smithi129.stdout:CPU family: 6 2024-03-25T09:23:55.952 INFO:tasks.workunit.client.3.smithi129.stdout:Model: 79 2024-03-25T09:23:55.952 INFO:tasks.workunit.client.3.smithi129.stdout:Thread(s) per core: 2 2024-03-25T09:23:55.952 INFO:tasks.workunit.client.3.smithi129.stdout:Core(s) per socket: 4 2024-03-25T09:23:55.952 INFO:tasks.workunit.client.3.smithi129.stdout:Socket(s): 1 2024-03-25T09:23:55.952 INFO:tasks.workunit.client.3.smithi129.stdout:Stepping: 1 2024-03-25T09:23:55.952 INFO:tasks.workunit.client.3.smithi129.stdout:CPU max MHz: 3800.0000 2024-03-25T09:23:55.952 INFO:tasks.workunit.client.3.smithi129.stdout:CPU min MHz: 1200.0000 2024-03-25T09:23:55.952 INFO:tasks.workunit.client.3.smithi129.stdout:BogoMIPS: 6999.80 2024-03-25T09:23:55.952 INFO:tasks.workunit.client.3.smithi129.stdout:Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti intel_ppin tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:Virtualization: VT-x 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:L1d cache: 128 KiB (4 instances) 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:L1i cache: 128 KiB (4 instances) 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:L2 cache: 1 MiB (4 instances) 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:L3 cache: 10 MiB (1 instance) 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:NUMA node(s): 1 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:NUMA node0 CPU(s): 0-7 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Gather data sampling: Not affected 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Itlb multihit: KVM: Mitigation: VMX disabled 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability L1tf: Mitigation; PTE Inversion; VMX conditional cache flushes, SMT vulnerable 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Mds: Vulnerable: Clear CPU buffers attempted, no microcode; SMT vulnerable 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Meltdown: Mitigation; PTI 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT vulnerable 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Retbleed: Not affected 2024-03-25T09:23:55.953 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Spec rstack overflow: Not affected 2024-03-25T09:23:55.954 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Spec store bypass: Vulnerable 2024-03-25T09:23:55.954 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization 2024-03-25T09:23:55.954 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected 2024-03-25T09:23:55.954 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Srbds: Not affected 2024-03-25T09:23:55.954 INFO:tasks.workunit.client.3.smithi129.stdout:Vulnerability Tsx async abort: Vulnerable: Clear CPU buffers attempted, no microcode; SMT vulnerable 2024-03-25T09:23:55.954 INFO:tasks.workunit.client.3.smithi129.stderr:+ free -h 2024-03-25T09:23:55.958 INFO:tasks.workunit.client.3.smithi129.stdout: total used free shared buff/cache available 2024-03-25T09:23:55.958 INFO:tasks.workunit.client.3.smithi129.stdout:Mem: 30Gi 855Mi 26Gi 20Mi 4.4Gi 30Gi 2024-03-25T09:23:55.958 INFO:tasks.workunit.client.3.smithi129.stdout:Swap: 0B 0B 0B 2024-03-25T09:23:55.958 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] Subsystem setup done' 2024-03-25T09:23:55.959 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] Subsystem setup done 2024-03-25T09:23:55.960 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-25T09:23:55.960 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.3/client.3/tmp 2024-03-25T09:23:56.030 INFO:tasks.workunit:Running workunits matching rbd/nvmeof_basic_tests.sh on client.3... 2024-03-25T09:23:56.031 INFO:tasks.workunit:Running workunit rbd/nvmeof_basic_tests.sh... 2024-03-25T09:23:56.032 DEBUG:teuthology.orchestra.run.smithi129:workunit test rbd/nvmeof_basic_tests.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fb51d73931124de2f09457eaa7f1219e2aeb2c0d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 RBD_IMAGE_PREFIX=myimage RBD_POOL=mypool timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/rbd/nvmeof_basic_tests.sh 2024-03-25T09:23:56.087 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo modprobe nvme-fabrics 2024-03-25T09:23:56.118 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo modprobe nvme-tcp 2024-03-25T09:23:56.151 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo dnf install nvme-cli -y 2024-03-25T09:23:56.515 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:56 smithi040 ceph-mon[33094]: pgmap v423: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 938 B/s wr, 28 op/s 2024-03-25T09:23:56.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:56.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:56.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:56.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:56 smithi019 ceph-mon[29386]: pgmap v423: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 938 B/s wr, 28 op/s 2024-03-25T09:23:56.703 INFO:tasks.workunit.client.3.smithi129.stdout:Last metadata expiration check: 0:18:15 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:23:56.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:56 smithi059 ceph-mon[32732]: pgmap v423: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 938 B/s wr, 28 op/s 2024-03-25T09:23:56.801 INFO:tasks.workunit.client.3.smithi129.stdout:Package nvme-cli-2.4-9.el9.x86_64 is already installed. 2024-03-25T09:23:56.853 INFO:tasks.workunit.client.3.smithi129.stdout:Dependencies resolved. 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout:================================================================================ 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout: Package Architecture Version Repository Size 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout:================================================================================ 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout:Upgrading: 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout: libnvme x86_64 1.6-1.el9 baseos 96 k 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout: nvme-cli x86_64 2.6-5.el9 baseos 841 k 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout:Transaction Summary 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout:================================================================================ 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout:Upgrade 2 Packages 2024-03-25T09:23:56.854 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:23:56.855 INFO:tasks.workunit.client.3.smithi129.stdout:Total download size: 937 k 2024-03-25T09:23:56.855 INFO:tasks.workunit.client.3.smithi129.stdout:Downloading Packages: 2024-03-25T09:23:56.994 INFO:tasks.workunit.client.3.smithi129.stdout:(1/2): libnvme-1.6-1.el9.x86_64.rpm 1.0 MB/s | 96 kB 00:00 2024-03-25T09:23:57.044 INFO:tasks.workunit.client.3.smithi129.stdout:(2/2): nvme-cli-2.6-5.el9.x86_64.rpm 5.8 MB/s | 841 kB 00:00 2024-03-25T09:23:57.044 INFO:tasks.workunit.client.3.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:23:57.044 INFO:tasks.workunit.client.3.smithi129.stdout:Total 4.8 MB/s | 937 kB 00:00 2024-03-25T09:23:57.071 INFO:tasks.workunit.client.3.smithi129.stdout:Running transaction check 2024-03-25T09:23:57.082 INFO:tasks.workunit.client.3.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:23:57.082 INFO:tasks.workunit.client.3.smithi129.stdout:Running transaction test 2024-03-25T09:23:57.192 INFO:tasks.workunit.client.3.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:23:57.193 INFO:tasks.workunit.client.3.smithi129.stdout:Running transaction 2024-03-25T09:23:57.419 INFO:tasks.workunit.client.3.smithi129.stdout: Preparing : 1/1 2024-03-25T09:23:57.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:57.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:57.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:57.717 INFO:tasks.workunit.client.3.smithi129.stdout: Upgrading : libnvme-1.6-1.el9.x86_64 1/4 2024-03-25T09:23:57.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:57.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:57.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:57.773 INFO:tasks.workunit.client.3.smithi129.stdout: Upgrading : nvme-cli-2.6-5.el9.x86_64 2/4 2024-03-25T09:23:58.068 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:23:57.783+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:23:58.082 INFO:tasks.workunit.client.3.smithi129.stdout: Running scriptlet: nvme-cli-2.6-5.el9.x86_64 2/4 2024-03-25T09:23:58.119 INFO:tasks.workunit.client.3.smithi129.stdout: Cleanup : nvme-cli-2.4-9.el9.x86_64 3/4 2024-03-25T09:23:58.211 INFO:tasks.workunit.client.3.smithi129.stdout: Cleanup : libnvme-1.4-7.el9.x86_64 4/4 2024-03-25T09:23:58.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:23:58 smithi019 ceph-mon[29386]: pgmap v424: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-25T09:23:58.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:23:58 smithi059 ceph-mon[32732]: pgmap v424: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-25T09:23:58.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:23:58 smithi040 ceph-mon[33094]: pgmap v424: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-25T09:23:58.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:58.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:23:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:58.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:23:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:59.156 INFO:tasks.workunit.client.3.smithi129.stdout: Running scriptlet: libnvme-1.4-7.el9.x86_64 4/4 2024-03-25T09:23:59.156 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : libnvme-1.6-1.el9.x86_64 1/4 2024-03-25T09:23:59.156 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : libnvme-1.4-7.el9.x86_64 2/4 2024-03-25T09:23:59.156 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : nvme-cli-2.6-5.el9.x86_64 3/4 2024-03-25T09:23:59.509 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : nvme-cli-2.4-9.el9.x86_64 4/4 2024-03-25T09:23:59.510 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:23:59.510 INFO:tasks.workunit.client.3.smithi129.stdout:Upgraded: 2024-03-25T09:23:59.510 INFO:tasks.workunit.client.3.smithi129.stdout: libnvme-1.6-1.el9.x86_64 nvme-cli-2.6-5.el9.x86_64 2024-03-25T09:23:59.510 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:23:59.510 INFO:tasks.workunit.client.3.smithi129.stdout:Complete! 2024-03-25T09:23:59.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:59.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:23:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:23:59.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:23:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:59.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:23:59.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:23:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:23:59.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:23:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:23:59.835 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo lsmod 2024-03-25T09:23:59.835 INFO:tasks.workunit.client.3.smithi129.stderr:+ grep nvme 2024-03-25T09:23:59.853 INFO:tasks.workunit.client.3.smithi129.stdout:nvme_tcp 49152 0 2024-03-25T09:23:59.853 INFO:tasks.workunit.client.3.smithi129.stdout:nvme_fabrics 40960 1 nvme_tcp 2024-03-25T09:23:59.853 INFO:tasks.workunit.client.3.smithi129.stdout:nvme 65536 5 2024-03-25T09:23:59.853 INFO:tasks.workunit.client.3.smithi129.stdout:nvme_core 221184 8 nvme_tcp,nvme,nvme_fabrics 2024-03-25T09:23:59.853 INFO:tasks.workunit.client.3.smithi129.stdout:nvme_common 24576 1 nvme_core 2024-03-25T09:23:59.853 INFO:tasks.workunit.client.3.smithi129.stdout:t10_pi 24576 2 sd_mod,nvme_core 2024-03-25T09:23:59.854 INFO:tasks.workunit.client.3.smithi129.stderr:+ source /etc/ceph/nvmeof.env 2024-03-25T09:23:59.854 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_GATEWAY_IP_ADDRESSES=172.21.15.19,172.21.15.40,172.21.15.59 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_GATEWAY_NAMES=nvmeof.nvmeof.a,nvmeof.nvmeof.b,nvmeof.nvmeof.c 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_DEFAULT_GATEWAY_IP_ADDRESS=172.21.15.19 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_CLI_IMAGE=quay.io/ceph/nvmeof-cli:1.1.0 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_SUBSYSTEMS_PREFIX=nqn.2016-06.io.spdk:cnode 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_SUBSYSTEMS_COUNT=3 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_NAMESPACES_COUNT=20 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_PORT=4420 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:++ NVMEOF_SRPORT=5500 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:+ SPDK_CONTROLLER='Ceph bdev Controller' 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:+ DISCOVERY_PORT=8009 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:+ test_run disconnect_all 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] Running test: disconnect_all' 2024-03-25T09:23:59.855 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] Running test: disconnect_all 2024-03-25T09:23:59.856 INFO:tasks.workunit.client.3.smithi129.stderr:+ disconnect_all 2024-03-25T09:23:59.856 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo nvme disconnect-all 2024-03-25T09:23:59.873 INFO:tasks.workunit.client.3.smithi129.stderr:++ sudo nvme list 2024-03-25T09:23:59.887 INFO:tasks.workunit.client.3.smithi129.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2024-03-25T09:23:59.887 INFO:tasks.workunit.client.3.smithi129.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-25T09:23:59.887 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme0n1 /dev/ng0n1 CVFT623300HY400BGN INTEL SSDPEDMD400G4 0x1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0' 2024-03-25T09:23:59.887 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2024-03-25T09:23:59.887 INFO:tasks.workunit.client.3.smithi129.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-25T09:23:59.887 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme0n1 /dev/ng0n1 CVFT623300HY400BGN INTEL SSDPEDMD400G4 0x1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0' 2024-03-25T09:23:59.888 INFO:tasks.workunit.client.3.smithi129.stderr:+ grep -q 'Ceph bdev Controller' 2024-03-25T09:23:59.888 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 0 -eq 0 ']' 2024-03-25T09:23:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] disconnect_all test passed! 2024-03-25T09:23:59.889 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] disconnect_all test passed!' 2024-03-25T09:23:59.889 INFO:tasks.workunit.client.3.smithi129.stderr:+ test_run discovery 2024-03-25T09:23:59.889 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] Running test: discovery 2024-03-25T09:23:59.889 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] Running test: discovery' 2024-03-25T09:23:59.890 INFO:tasks.workunit.client.3.smithi129.stderr:+ discovery 2024-03-25T09:23:59.890 INFO:tasks.workunit.client.3.smithi129.stderr:++ sudo nvme discover -t tcp -a 172.21.15.19 -s 8009 2024-03-25T09:23:59.917 INFO:tasks.workunit.client.3.smithi129.stderr:+ output=' 2024-03-25T09:23:59.917 INFO:tasks.workunit.client.3.smithi129.stderr:Discovery Log Number of Records 9, Generation counter 1 2024-03-25T09:23:59.917 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 0====== 2024-03-25T09:23:59.917 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.917 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.917 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.917 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.917 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 0 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.19 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 1====== 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 1 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.918 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.40 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 2====== 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 2 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.59 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.919 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 3====== 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 3 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.19 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 4====== 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.920 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 4 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.40 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 5====== 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 5 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.59 2024-03-25T09:23:59.921 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 6====== 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 6 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.19 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 7====== 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.922 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 7 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.40 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 8====== 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 8 2024-03-25T09:23:59.923 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.59 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none' 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:+ expected_discovery_stdout='subtype: nvme subsystem' 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo ' 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:Discovery Log Number of Records 9, Generation counter 1 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 0====== 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 0 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-25T09:23:59.924 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.19 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 1====== 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 1 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.40 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 2====== 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.925 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 2 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.59 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 3====== 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 3 2024-03-25T09:23:59.926 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.19 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 4====== 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 4 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.40 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.927 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 5====== 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 5 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.59 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 6====== 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.928 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 6 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.19 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 7====== 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 7 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.40 2024-03-25T09:23:59.929 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:=====Discovery Log Entry 8====== 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:trtype: tcp 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:adrfam: ipv4 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:subtype: nvme subsystem 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:treq: not required 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:portid: 8 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:trsvcid: 4420 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:traddr: 172.21.15.59 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:eflags: none 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:sectype: none' 2024-03-25T09:23:59.930 INFO:tasks.workunit.client.3.smithi129.stderr:+ grep -q 'subtype: nvme subsystem' 2024-03-25T09:23:59.931 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 0 -eq 0 ']' 2024-03-25T09:23:59.931 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] discovery test passed! 2024-03-25T09:23:59.932 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] discovery test passed!' 2024-03-25T09:23:59.932 INFO:tasks.workunit.client.3.smithi129.stderr:+ test_run connect 2024-03-25T09:23:59.932 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] Running test: connect 2024-03-25T09:23:59.932 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] Running test: connect' 2024-03-25T09:23:59.932 INFO:tasks.workunit.client.3.smithi129.stderr:+ connect 2024-03-25T09:23:59.933 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo nvme connect -t tcp --traddr 172.21.15.19 -s 4420 -n nqn.2016-06.io.spdk:cnode1 2024-03-25T09:24:00.020 INFO:tasks.workunit.client.3.smithi129.stderr:++ sudo nvme list 2024-03-25T09:24:00.037 INFO:tasks.workunit.client.3.smithi129.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2024-03-25T09:24:00.038 INFO:tasks.workunit.client.3.smithi129.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-25T09:24:00.038 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme0n1 /dev/ng0n1 CVFT623300HY400BGN INTEL SSDPEDMD400G4 0x1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0 2024-03-25T09:24:00.038 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme1n2 /dev/ng1n2 Ceph48566432277082 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:00.038 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme1n5 /dev/ng1n5 Ceph48566432277082 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:00.038 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme1n8 /dev/ng1n8 Ceph48566432277082 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 ' 2024-03-25T09:24:00.038 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2024-03-25T09:24:00.038 INFO:tasks.workunit.client.3.smithi129.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-25T09:24:00.038 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme0n1 /dev/ng0n1 CVFT623300HY400BGN INTEL SSDPEDMD400G4 0x1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0 2024-03-25T09:24:00.038 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme1n2 /dev/ng1n2 Ceph48566432277082 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:00.038 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme1n5 /dev/ng1n5 Ceph48566432277082 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:00.039 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme1n8 /dev/ng1n8 Ceph48566432277082 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 ' 2024-03-25T09:24:00.039 INFO:tasks.workunit.client.3.smithi129.stderr:+ grep -q 'Ceph bdev Controller' 2024-03-25T09:24:00.039 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 0 -eq 0 ']' 2024-03-25T09:24:00.039 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] connect test passed!' 2024-03-25T09:24:00.039 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] connect test passed! 2024-03-25T09:24:00.040 INFO:tasks.workunit.client.3.smithi129.stderr:+ test_run list_subsys 1 2024-03-25T09:24:00.040 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] Running test: list_subsys 2024-03-25T09:24:00.040 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] Running test: list_subsys' 2024-03-25T09:24:00.041 INFO:tasks.workunit.client.3.smithi129.stderr:+ list_subsys 1 2024-03-25T09:24:00.041 INFO:tasks.workunit.client.3.smithi129.stderr:+ expected_count=1 2024-03-25T09:24:00.041 INFO:tasks.workunit.client.3.smithi129.stderr:++ sudo nvme list-subsys --output-format=json 2024-03-25T09:24:00.068 INFO:tasks.workunit.client.3.smithi129.stderr:+ output='[ 2024-03-25T09:24:00.068 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:00.068 INFO:tasks.workunit.client.3.smithi129.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610", 2024-03-25T09:24:00.068 INFO:tasks.workunit.client.3.smithi129.stderr: "HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521", 2024-03-25T09:24:00.068 INFO:tasks.workunit.client.3.smithi129.stderr: "Subsystems":[ 2024-03-25T09:24:00.068 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:00.068 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme-subsys1", 2024-03-25T09:24:00.068 INFO:tasks.workunit.client.3.smithi129.stderr: "NQN":"nqn.2016-06.io.spdk:cnode1", 2024-03-25T09:24:00.068 INFO:tasks.workunit.client.3.smithi129.stderr: "IOPolicy":"numa", 2024-03-25T09:24:00.068 INFO:tasks.workunit.client.3.smithi129.stderr: "Paths":[ 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme1", 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"tcp", 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"traddr=172.21.15.19,trsvcid=4420,src_addr=172.21.15.129", 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: ] 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: }, 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme-subsys0", 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: "NQN":"nqn.2014.08.org.nvmexpress:80868086CVFT623300HY400BGN INTEL SSDPEDMD400G4", 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: "IOPolicy":"numa", 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: "Paths":[ 2024-03-25T09:24:00.069 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:00.070 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme0", 2024-03-25T09:24:00.070 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"pcie", 2024-03-25T09:24:00.070 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"0000:02:00.0", 2024-03-25T09:24:00.070 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:00.070 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:00.070 INFO:tasks.workunit.client.3.smithi129.stderr: ] 2024-03-25T09:24:00.070 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:00.070 INFO:tasks.workunit.client.3.smithi129.stderr: ] 2024-03-25T09:24:00.070 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:00.070 INFO:tasks.workunit.client.3.smithi129.stderr:]' 2024-03-25T09:24:00.071 INFO:tasks.workunit.client.3.smithi129.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610",' '"HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521",' '"Subsystems":[' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-06.io.spdk:cnode1",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.19,trsvcid=4420,src_addr=172.21.15.129",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2014.08.org.nvmexpress:80868086CVFT623300HY400BGN' INTEL 'SSDPEDMD400G4",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2024-03-25T09:24:00.071 INFO:tasks.workunit.client.3.smithi129.stderr:++ grep -o '"tcp"' 2024-03-25T09:24:00.071 INFO:tasks.workunit.client.3.smithi129.stderr:++ wc -l 2024-03-25T09:24:00.071 INFO:tasks.workunit.client.3.smithi129.stderr:+ multipath=1 2024-03-25T09:24:00.071 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 1 -ne 1 ']' 2024-03-25T09:24:00.072 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 0 -eq 0 ']' 2024-03-25T09:24:00.072 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] list_subsys test passed!' 2024-03-25T09:24:00.072 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] list_subsys test passed! 2024-03-25T09:24:00.072 INFO:tasks.workunit.client.3.smithi129.stderr:+ test_run disconnect_all 2024-03-25T09:24:00.072 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] Running test: disconnect_all' 2024-03-25T09:24:00.073 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] Running test: disconnect_all 2024-03-25T09:24:00.073 INFO:tasks.workunit.client.3.smithi129.stderr:+ disconnect_all 2024-03-25T09:24:00.073 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo nvme disconnect-all 2024-03-25T09:24:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:00 smithi019 ceph-mon[29386]: pgmap v425: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-25T09:24:00.470 INFO:tasks.workunit.client.3.smithi129.stderr:++ sudo nvme list 2024-03-25T09:24:00.485 INFO:tasks.workunit.client.3.smithi129.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2024-03-25T09:24:00.485 INFO:tasks.workunit.client.3.smithi129.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-25T09:24:00.485 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme0n1 /dev/ng0n1 CVFT623300HY400BGN INTEL SSDPEDMD400G4 0x1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0' 2024-03-25T09:24:00.485 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2024-03-25T09:24:00.485 INFO:tasks.workunit.client.3.smithi129.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-25T09:24:00.485 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme0n1 /dev/ng0n1 CVFT623300HY400BGN INTEL SSDPEDMD400G4 0x1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0' 2024-03-25T09:24:00.485 INFO:tasks.workunit.client.3.smithi129.stderr:+ grep -q 'Ceph bdev Controller' 2024-03-25T09:24:00.486 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 0 -eq 0 ']' 2024-03-25T09:24:00.486 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] disconnect_all test passed!' 2024-03-25T09:24:00.487 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] disconnect_all test passed! 2024-03-25T09:24:00.487 INFO:tasks.workunit.client.3.smithi129.stderr:+ test_run list_subsys 0 2024-03-25T09:24:00.487 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] Running test: list_subsys' 2024-03-25T09:24:00.487 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] Running test: list_subsys 2024-03-25T09:24:00.488 INFO:tasks.workunit.client.3.smithi129.stderr:+ list_subsys 0 2024-03-25T09:24:00.488 INFO:tasks.workunit.client.3.smithi129.stderr:+ expected_count=0 2024-03-25T09:24:00.488 INFO:tasks.workunit.client.3.smithi129.stderr:++ sudo nvme list-subsys --output-format=json 2024-03-25T09:24:00.499 INFO:tasks.workunit.client.3.smithi129.stderr:+ output='[ 2024-03-25T09:24:00.499 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:00.499 INFO:tasks.workunit.client.3.smithi129.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610", 2024-03-25T09:24:00.499 INFO:tasks.workunit.client.3.smithi129.stderr: "HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521", 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: "Subsystems":[ 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme-subsys0", 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: "NQN":"nqn.2014.08.org.nvmexpress:80868086CVFT623300HY400BGN INTEL SSDPEDMD400G4", 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: "IOPolicy":"numa", 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: "Paths":[ 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme0", 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"pcie", 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"0000:02:00.0", 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: ] 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: ] 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:00.500 INFO:tasks.workunit.client.3.smithi129.stderr:]' 2024-03-25T09:24:00.502 INFO:tasks.workunit.client.3.smithi129.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610",' '"HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2014.08.org.nvmexpress:80868086CVFT623300HY400BGN' INTEL 'SSDPEDMD400G4",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2024-03-25T09:24:00.502 INFO:tasks.workunit.client.3.smithi129.stderr:++ grep -o '"tcp"' 2024-03-25T09:24:00.502 INFO:tasks.workunit.client.3.smithi129.stderr:++ wc -l 2024-03-25T09:24:00.502 INFO:tasks.workunit.client.3.smithi129.stderr:+ multipath=0 2024-03-25T09:24:00.502 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 0 -ne 0 ']' 2024-03-25T09:24:00.502 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 0 -eq 0 ']' 2024-03-25T09:24:00.503 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] list_subsys test passed! 2024-03-25T09:24:00.503 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] list_subsys test passed!' 2024-03-25T09:24:00.503 INFO:tasks.workunit.client.3.smithi129.stderr:+ test_run connect_all 2024-03-25T09:24:00.503 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] Running test: connect_all' 2024-03-25T09:24:00.504 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] Running test: connect_all 2024-03-25T09:24:00.504 INFO:tasks.workunit.client.3.smithi129.stderr:+ connect_all 2024-03-25T09:24:00.504 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo nvme connect-all --traddr=172.21.15.19 --transport=tcp -l 3600 2024-03-25T09:24:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:00 smithi059 ceph-mon[32732]: pgmap v425: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-25T09:24:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:00 smithi040 ceph-mon[33094]: pgmap v425: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-25T09:24:00.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:00.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:00.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:01.268 INFO:tasks.workunit.client.3.smithi129.stderr:++ sudo nvme list 2024-03-25T09:24:01.301 INFO:tasks.workunit.client.3.smithi129.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2024-03-25T09:24:01.301 INFO:tasks.workunit.client.3.smithi129.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme0n1 /dev/ng0n1 CVFT623300HY400BGN INTEL SSDPEDMD400G4 0x1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n1 /dev/ng2n1 Ceph48566432277082 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n10 /dev/ng2n10 Ceph48566432277082 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n11 /dev/ng2n11 Ceph48566432277082 Ceph bdev Controller 0xb 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n12 /dev/ng2n12 Ceph48566432277082 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n13 /dev/ng2n13 Ceph48566432277082 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n14 /dev/ng2n14 Ceph48566432277082 Ceph bdev Controller 0xe 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n15 /dev/ng2n15 Ceph48566432277082 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n16 /dev/ng2n16 Ceph48566432277082 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n17 /dev/ng2n17 Ceph48566432277082 Ceph bdev Controller 0x11 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n18 /dev/ng2n18 Ceph48566432277082 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n19 /dev/ng2n19 Ceph48566432277082 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.302 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n2 /dev/ng2n2 Ceph48566432277082 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n20 /dev/ng2n20 Ceph48566432277082 Ceph bdev Controller 0x14 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n3 /dev/ng2n3 Ceph48566432277082 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n4 /dev/ng2n4 Ceph48566432277082 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n5 /dev/ng2n5 Ceph48566432277082 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n6 /dev/ng2n6 Ceph48566432277082 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n7 /dev/ng2n7 Ceph48566432277082 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n8 /dev/ng2n8 Ceph48566432277082 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n9 /dev/ng2n9 Ceph48566432277082 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n1 /dev/ng5n1 Ceph21611557036653 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n10 /dev/ng5n10 Ceph21611557036653 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n11 /dev/ng5n11 Ceph21611557036653 Ceph bdev Controller 0xb 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n12 /dev/ng5n12 Ceph21611557036653 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n13 /dev/ng5n13 Ceph21611557036653 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n14 /dev/ng5n14 Ceph21611557036653 Ceph bdev Controller 0xe 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.303 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n15 /dev/ng5n15 Ceph21611557036653 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n16 /dev/ng5n16 Ceph21611557036653 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n17 /dev/ng5n17 Ceph21611557036653 Ceph bdev Controller 0x11 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n18 /dev/ng5n18 Ceph21611557036653 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n19 /dev/ng5n19 Ceph21611557036653 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n2 /dev/ng5n2 Ceph21611557036653 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n20 /dev/ng5n20 Ceph21611557036653 Ceph bdev Controller 0x14 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n3 /dev/ng5n3 Ceph21611557036653 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n4 /dev/ng5n4 Ceph21611557036653 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n5 /dev/ng5n5 Ceph21611557036653 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n6 /dev/ng5n6 Ceph21611557036653 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n7 /dev/ng5n7 Ceph21611557036653 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n8 /dev/ng5n8 Ceph21611557036653 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n9 /dev/ng5n9 Ceph21611557036653 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n1 /dev/ng8n1 Ceph70543347611932 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.304 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n10 /dev/ng8n10 Ceph70543347611932 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n12 /dev/ng8n12 Ceph70543347611932 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n13 /dev/ng8n13 Ceph70543347611932 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n15 /dev/ng8n15 Ceph70543347611932 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n16 /dev/ng8n16 Ceph70543347611932 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n18 /dev/ng8n18 Ceph70543347611932 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n19 /dev/ng8n19 Ceph70543347611932 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n2 /dev/ng8n2 Ceph70543347611932 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n3 /dev/ng8n3 Ceph70543347611932 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n4 /dev/ng8n4 Ceph70543347611932 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n6 /dev/ng8n6 Ceph70543347611932 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n7 /dev/ng8n7 Ceph70543347611932 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n9 /dev/ng8n9 Ceph70543347611932 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 ' 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:+ grep -q 'Ceph bdev Controller' 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2024-03-25T09:24:01.305 INFO:tasks.workunit.client.3.smithi129.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme0n1 /dev/ng0n1 CVFT623300HY400BGN INTEL SSDPEDMD400G4 0x1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n1 /dev/ng2n1 Ceph48566432277082 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n10 /dev/ng2n10 Ceph48566432277082 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n11 /dev/ng2n11 Ceph48566432277082 Ceph bdev Controller 0xb 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n12 /dev/ng2n12 Ceph48566432277082 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n13 /dev/ng2n13 Ceph48566432277082 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n14 /dev/ng2n14 Ceph48566432277082 Ceph bdev Controller 0xe 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n15 /dev/ng2n15 Ceph48566432277082 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n16 /dev/ng2n16 Ceph48566432277082 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n17 /dev/ng2n17 Ceph48566432277082 Ceph bdev Controller 0x11 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n18 /dev/ng2n18 Ceph48566432277082 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n19 /dev/ng2n19 Ceph48566432277082 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n2 /dev/ng2n2 Ceph48566432277082 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.306 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n20 /dev/ng2n20 Ceph48566432277082 Ceph bdev Controller 0x14 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n3 /dev/ng2n3 Ceph48566432277082 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n4 /dev/ng2n4 Ceph48566432277082 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n5 /dev/ng2n5 Ceph48566432277082 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n6 /dev/ng2n6 Ceph48566432277082 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n7 /dev/ng2n7 Ceph48566432277082 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n8 /dev/ng2n8 Ceph48566432277082 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n9 /dev/ng2n9 Ceph48566432277082 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n1 /dev/ng5n1 Ceph21611557036653 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n10 /dev/ng5n10 Ceph21611557036653 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n11 /dev/ng5n11 Ceph21611557036653 Ceph bdev Controller 0xb 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n12 /dev/ng5n12 Ceph21611557036653 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n13 /dev/ng5n13 Ceph21611557036653 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n14 /dev/ng5n14 Ceph21611557036653 Ceph bdev Controller 0xe 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n15 /dev/ng5n15 Ceph21611557036653 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.307 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n16 /dev/ng5n16 Ceph21611557036653 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n17 /dev/ng5n17 Ceph21611557036653 Ceph bdev Controller 0x11 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n18 /dev/ng5n18 Ceph21611557036653 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n19 /dev/ng5n19 Ceph21611557036653 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n2 /dev/ng5n2 Ceph21611557036653 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n20 /dev/ng5n20 Ceph21611557036653 Ceph bdev Controller 0x14 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n3 /dev/ng5n3 Ceph21611557036653 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n4 /dev/ng5n4 Ceph21611557036653 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n5 /dev/ng5n5 Ceph21611557036653 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n6 /dev/ng5n6 Ceph21611557036653 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n7 /dev/ng5n7 Ceph21611557036653 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n8 /dev/ng5n8 Ceph21611557036653 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n9 /dev/ng5n9 Ceph21611557036653 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n1 /dev/ng8n1 Ceph70543347611932 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n10 /dev/ng8n10 Ceph70543347611932 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.308 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n12 /dev/ng8n12 Ceph70543347611932 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n13 /dev/ng8n13 Ceph70543347611932 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n15 /dev/ng8n15 Ceph70543347611932 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n16 /dev/ng8n16 Ceph70543347611932 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n18 /dev/ng8n18 Ceph70543347611932 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n19 /dev/ng8n19 Ceph70543347611932 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n2 /dev/ng8n2 Ceph70543347611932 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n3 /dev/ng8n3 Ceph70543347611932 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n4 /dev/ng8n4 Ceph70543347611932 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n6 /dev/ng8n6 Ceph70543347611932 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n7 /dev/ng8n7 Ceph70543347611932 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-25T09:24:01.309 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n9 /dev/ng8n9 Ceph70543347611932 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 ' 2024-03-25T09:24:01.310 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 0 -eq 0 ']' 2024-03-25T09:24:01.310 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] connect_all test passed! 2024-03-25T09:24:01.311 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] connect_all test passed!' 2024-03-25T09:24:01.311 INFO:tasks.workunit.client.3.smithi129.stderr:++ echo 172.21.15.19,172.21.15.40,172.21.15.59 2024-03-25T09:24:01.311 INFO:tasks.workunit.client.3.smithi129.stderr:++ tr -cd , 2024-03-25T09:24:01.311 INFO:tasks.workunit.client.3.smithi129.stderr:++ wc -c 2024-03-25T09:24:01.311 INFO:tasks.workunit.client.3.smithi129.stderr:+ gateways_count=3 2024-03-25T09:24:01.311 INFO:tasks.workunit.client.3.smithi129.stderr:+ multipath_count=9 2024-03-25T09:24:01.311 INFO:tasks.workunit.client.3.smithi129.stderr:+ test_run list_subsys 9 2024-03-25T09:24:01.311 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] Running test: list_subsys' 2024-03-25T09:24:01.312 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] Running test: list_subsys 2024-03-25T09:24:01.312 INFO:tasks.workunit.client.3.smithi129.stderr:+ list_subsys 9 2024-03-25T09:24:01.312 INFO:tasks.workunit.client.3.smithi129.stderr:+ expected_count=9 2024-03-25T09:24:01.312 INFO:tasks.workunit.client.3.smithi129.stderr:++ sudo nvme list-subsys --output-format=json 2024-03-25T09:24:01.333 INFO:tasks.workunit.client.3.smithi129.stderr:+ output='[ 2024-03-25T09:24:01.333 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.333 INFO:tasks.workunit.client.3.smithi129.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610", 2024-03-25T09:24:01.333 INFO:tasks.workunit.client.3.smithi129.stderr: "HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521", 2024-03-25T09:24:01.333 INFO:tasks.workunit.client.3.smithi129.stderr: "Subsystems":[ 2024-03-25T09:24:01.333 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.333 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme-subsys5", 2024-03-25T09:24:01.333 INFO:tasks.workunit.client.3.smithi129.stderr: "NQN":"nqn.2016-06.io.spdk:cnode2", 2024-03-25T09:24:01.333 INFO:tasks.workunit.client.3.smithi129.stderr: "IOPolicy":"numa", 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: "Paths":[ 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme7", 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"tcp", 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"traddr=172.21.15.59,trsvcid=4420,src_addr=172.21.15.129", 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: }, 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme6", 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"tcp", 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"traddr=172.21.15.40,trsvcid=4420,src_addr=172.21.15.129", 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: }, 2024-03-25T09:24:01.334 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme5", 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"tcp", 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"traddr=172.21.15.19,trsvcid=4420,src_addr=172.21.15.129", 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: ] 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: }, 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme-subsys2", 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: "NQN":"nqn.2016-06.io.spdk:cnode1", 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: "IOPolicy":"numa", 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: "Paths":[ 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme4", 2024-03-25T09:24:01.335 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"tcp", 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"traddr=172.21.15.59,trsvcid=4420,src_addr=172.21.15.129", 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: }, 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme3", 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"tcp", 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"traddr=172.21.15.40,trsvcid=4420,src_addr=172.21.15.129", 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: }, 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme2", 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"tcp", 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"traddr=172.21.15.19,trsvcid=4420,src_addr=172.21.15.129", 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:01.336 INFO:tasks.workunit.client.3.smithi129.stderr: ] 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: }, 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme-subsys8", 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: "NQN":"nqn.2016-06.io.spdk:cnode3", 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: "IOPolicy":"numa", 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: "Paths":[ 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme9", 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"tcp", 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"traddr=172.21.15.40,trsvcid=4420,src_addr=172.21.15.129", 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: }, 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme8", 2024-03-25T09:24:01.337 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"tcp", 2024-03-25T09:24:01.338 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"traddr=172.21.15.19,trsvcid=4420,src_addr=172.21.15.129", 2024-03-25T09:24:01.338 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:01.338 INFO:tasks.workunit.client.3.smithi129.stderr: }, 2024-03-25T09:24:01.338 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.338 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme10", 2024-03-25T09:24:01.338 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"tcp", 2024-03-25T09:24:01.338 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"traddr=172.21.15.59,trsvcid=4420,src_addr=172.21.15.129", 2024-03-25T09:24:01.338 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:01.338 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: ] 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: }, 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme-subsys0", 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: "NQN":"nqn.2014.08.org.nvmexpress:80868086CVFT623300HY400BGN INTEL SSDPEDMD400G4", 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: "IOPolicy":"numa", 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: "Paths":[ 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: { 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: "Name":"nvme0", 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: "Transport":"pcie", 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: "Address":"0000:02:00.0", 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: "State":"live" 2024-03-25T09:24:01.339 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:01.340 INFO:tasks.workunit.client.3.smithi129.stderr: ] 2024-03-25T09:24:01.340 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:01.340 INFO:tasks.workunit.client.3.smithi129.stderr: ] 2024-03-25T09:24:01.340 INFO:tasks.workunit.client.3.smithi129.stderr: } 2024-03-25T09:24:01.340 INFO:tasks.workunit.client.3.smithi129.stderr:]' 2024-03-25T09:24:01.341 INFO:tasks.workunit.client.3.smithi129.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610",' '"HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521",' '"Subsystems":[' '{' '"Name":"nvme-subsys5",' '"NQN":"nqn.2016-06.io.spdk:cnode2",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme7",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.59,trsvcid=4420,src_addr=172.21.15.129",' '"State":"live"' '},' '{' '"Name":"nvme6",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.40,trsvcid=4420,src_addr=172.21.15.129",' '"State":"live"' '},' '{' '"Name":"nvme5",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.19,trsvcid=4420,src_addr=172.21.15.129",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-06.io.spdk:cnode1",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme4",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.59,trsvcid=4420,src_addr=172.21.15.129",' '"State":"live"' '},' '{' '"Name":"nvme3",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.40,trsvcid=4420,src_addr=172.21.15.129",' '"State":"live"' '},' '{' '"Name":"nvme2",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.19,trsvcid=4420,src_addr=172.21.15.129",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys8",' '"NQN":"nqn.2016-06.io.spdk:cnode3",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme9",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.40,trsvcid=4420,src_addr=172.21.15.129",' '"State":"live"' '},' '{' '"Name":"nvme8",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.19,trsvcid=4420,src_addr=172.21.15.129",' '"State":"live"' '},' '{' '"Name":"nvme10",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.59,trsvcid=4420,src_addr=172.21.15.129",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2014.08.org.nvmexpress:80868086CVFT623300HY400BGN' INTEL 'SSDPEDMD400G4",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2024-03-25T09:24:01.342 INFO:tasks.workunit.client.3.smithi129.stderr:++ grep -o '"tcp"' 2024-03-25T09:24:01.342 INFO:tasks.workunit.client.3.smithi129.stderr:++ wc -l 2024-03-25T09:24:01.342 INFO:tasks.workunit.client.3.smithi129.stderr:+ multipath=9 2024-03-25T09:24:01.342 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 9 -ne 9 ']' 2024-03-25T09:24:01.342 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' 0 -eq 0 ']' 2024-03-25T09:24:01.342 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] list_subsys test passed! 2024-03-25T09:24:01.343 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] list_subsys test passed!' 2024-03-25T09:24:01.343 INFO:tasks.workunit.client.3.smithi129.stdout:-------------Test Summary------------- 2024-03-25T09:24:01.343 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '-------------Test Summary-------------' 2024-03-25T09:24:01.344 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof] All nvmeof basic tests passed! 2024-03-25T09:24:01.345 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof] All nvmeof basic tests passed!' 2024-03-25T09:24:01.345 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-25T09:24:01.346 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.3/client.3/tmp 2024-03-25T09:24:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:01 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 158 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:01.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:01.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:01.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:01.414 INFO:tasks.workunit:Stopping ['rbd/nvmeof_setup_subsystem.sh', 'rbd/nvmeof_basic_tests.sh'] on client.3... 2024-03-25T09:24:01.414 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.3 /home/ubuntu/cephtest/clone.client.3 2024-03-25T09:24:01.468 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:01 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 158 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:01.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:01 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 158 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:01.750 DEBUG:teuthology.parallel:result is None 2024-03-25T09:24:01.751 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.3/client.3 2024-03-25T09:24:01.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:01.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:01.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:01.777 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.3/client.3 2024-03-25T09:24:01.778 DEBUG:teuthology.orchestra.run.smithi129:> rmdir -- /home/ubuntu/cephtest/mnt.3 2024-03-25T09:24:01.843 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.3/client.3 2024-03-25T09:24:01.843 INFO:teuthology.run_tasks:Running task nvmeof.thrash... 2024-03-25T09:24:01.855 INFO:teuthology.run_tasks:Running task workunit... 2024-03-25T09:24:01.863 INFO:tasks.workunit:Pulling workunits from ref fb51d73931124de2f09457eaa7f1219e2aeb2c0d 2024-03-25T09:24:01.863 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-25T09:24:01.864 DEBUG:teuthology.orchestra.run.smithi129:> stat -- /home/ubuntu/cephtest/mnt.3 2024-03-25T09:24:01.864 INFO:tasks.nvmeof.[nvmeof.thrasher]:start thrashing 2024-03-25T09:24:01.864 INFO:tasks.nvmeof.[nvmeof.thrasher]:seed: 1711358641, , max thrash delay: 90, min thrash delay: 60 max revive delay: 10, min revive delay: 0 daemons: 3 2024-03-25T09:24:01.864 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 72 secs before thrashing 2024-03-25T09:24:01.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:24:01.898 INFO:teuthology.orchestra.run.smithi129.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-25T09:24:01.898 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -- /home/ubuntu/cephtest/mnt.3 2024-03-25T09:24:01.953 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.3 2024-03-25T09:24:01.953 DEBUG:teuthology.orchestra.run.smithi129:> cd -- /home/ubuntu/cephtest/mnt.3 && mkdir -- client.3 2024-03-25T09:24:02.008 INFO:tasks.workunit:timeout=3h 2024-03-25T09:24:02.008 INFO:tasks.workunit:cleanup=True 2024-03-25T09:24:02.009 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf /home/ubuntu/cephtest/clone.client.3 && git clone https://github.com/vallariag/ceph.git /home/ubuntu/cephtest/clone.client.3 && cd /home/ubuntu/cephtest/clone.client.3 && git checkout fb51d73931124de2f09457eaa7f1219e2aeb2c0d 2024-03-25T09:24:02.065 INFO:tasks.workunit.client.3.smithi129.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.3'... 2024-03-25T09:24:02.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:02 smithi019 ceph-mon[29386]: pgmap v426: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-25T09:24:02.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:02 smithi040 ceph-mon[33094]: pgmap v426: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-25T09:24:02.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:02.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:02.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:02 smithi059 ceph-mon[32732]: pgmap v426: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-25T09:24:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:02.784+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:03.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:03.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:03.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:03.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:03.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:03.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:04 smithi019 ceph-mon[29386]: pgmap v427: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-25T09:24:04.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:04 smithi059 ceph-mon[32732]: pgmap v427: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-25T09:24:04.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:04 smithi040 ceph-mon[33094]: pgmap v427: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-25T09:24:04.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:04.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:04.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:05.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:05.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:05.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:05.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:05.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:05.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:06.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:06 smithi019 ceph-mon[29386]: pgmap v428: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-03-25T09:24:06.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:06 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 163 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:06 smithi059 ceph-mon[32732]: pgmap v428: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-03-25T09:24:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:06 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 163 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:06 smithi040 ceph-mon[33094]: pgmap v428: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-03-25T09:24:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:06 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 163 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:06.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:06.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:06.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:07.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:07.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:07.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:07.761 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:07.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:07.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:08.069 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:07.784+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:08 smithi019 ceph-mon[29386]: pgmap v429: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-25T09:24:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:08 smithi059 ceph-mon[32732]: pgmap v429: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-25T09:24:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:08 smithi040 ceph-mon[33094]: pgmap v429: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-25T09:24:08.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:08.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:08.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:10.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:10.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:10.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:10.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:10 smithi019 ceph-mon[29386]: pgmap v430: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-03-25T09:24:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:10 smithi059 ceph-mon[32732]: pgmap v430: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-03-25T09:24:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:10 smithi040 ceph-mon[33094]: pgmap v430: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-03-25T09:24:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:11.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:11.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:11.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:12.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:12.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:12.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:12.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:12 smithi019 ceph-mon[29386]: pgmap v431: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-25T09:24:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:12 smithi059 ceph-mon[32732]: pgmap v431: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-25T09:24:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:12 smithi040 ceph-mon[33094]: pgmap v431: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-25T09:24:12.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:12.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:12.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:12.784+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:13.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:13.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:13.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:14.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:14.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:14.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:14.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:14 smithi019 ceph-mon[29386]: pgmap v432: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-03-25T09:24:14.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:14 smithi059 ceph-mon[32732]: pgmap v432: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-03-25T09:24:14.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:14 smithi040 ceph-mon[33094]: pgmap v432: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-03-25T09:24:14.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:14.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:14.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:15.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:15 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 168 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:15.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:15.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:15.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:15.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:15 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 168 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:15.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:15.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:15.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:15 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 168 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:16.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:16 smithi019 ceph-mon[29386]: pgmap v433: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:24:16.665 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:16 smithi040 ceph-mon[33094]: pgmap v433: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:24:16.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:16.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:16.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:16.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:16 smithi059 ceph-mon[32732]: pgmap v433: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-25T09:24:17.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:17.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:17.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:18.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:17.784+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:18.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:18.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:18.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:18.334 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:18 smithi040 ceph-mon[33094]: pgmap v434: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:18.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:18 smithi019 ceph-mon[29386]: pgmap v434: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:18 smithi059 ceph-mon[32732]: pgmap v434: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:18.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:18.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:18.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:20.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:20.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:20.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:20.346 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:20 smithi040 ceph-mon[33094]: pgmap v435: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:20.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:20 smithi019 ceph-mon[29386]: pgmap v435: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:20 smithi059 ceph-mon[32732]: pgmap v435: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:20.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:20.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:20.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:21.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:21 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 178 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:21 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 178 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:21 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 178 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:21.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:21.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:21.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:22.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:22.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:22.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:22.359 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:22 smithi040 ceph-mon[33094]: pgmap v436: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:22 smithi019 ceph-mon[29386]: pgmap v436: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:22 smithi059 ceph-mon[32732]: pgmap v436: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:22.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:22.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:22.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:22.785+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:23.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:23.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:23.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:24.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:24.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:24.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:24.371 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:24 smithi040 ceph-mon[33094]: pgmap v437: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:24.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:24 smithi019 ceph-mon[29386]: pgmap v437: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:24.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:24 smithi059 ceph-mon[32732]: pgmap v437: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:24.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:24.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:24.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:25.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:25.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:25.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:26.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:26.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:26.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:25 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:26.383 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:26 smithi040 ceph-mon[33094]: pgmap v438: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:26.383 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:26 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 183 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:26.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:26 smithi019 ceph-mon[29386]: pgmap v438: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:26.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:26 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 183 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:26 smithi059 ceph-mon[32732]: pgmap v438: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:26 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 183 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:26.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:26.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:26.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:27.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:27.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:27.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:28.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:27.785+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:28.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:28.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:28.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:28.395 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:28 smithi040 ceph-mon[33094]: pgmap v439: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:28.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:28 smithi019 ceph-mon[29386]: pgmap v439: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:28.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:28 smithi059 ceph-mon[32732]: pgmap v439: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:28.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:28.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:28.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:29.639 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:29 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:24:29.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:29 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:24:29.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:29.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:29.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:29.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:29 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:24:30.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:30.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:30.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:29 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:30.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:30 smithi019 ceph-mon[29386]: pgmap v440: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:30.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-25T09:24:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-25T09:24:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:24:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:24:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:24:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:30 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:24:30.665 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:30 smithi040 ceph-mon[33094]: pgmap v440: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:30.665 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:30 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-25T09:24:30.665 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:30 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-25T09:24:30.665 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:30 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:24:30.665 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:30 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:24:30.666 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:30 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:24:30.666 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:30 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:24:30.666 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:30.666 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:30.666 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:30 smithi059 ceph-mon[32732]: pgmap v440: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:30 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-25T09:24:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:30 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-25T09:24:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:30 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:24:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:30 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:24:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:30 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:24:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:30 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:24:31.651 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:31 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi019 to 6498M 2024-03-25T09:24:31.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:31 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi019 to 6498M 2024-03-25T09:24:31.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:31.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:31.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:31.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:31 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi019 to 6498M 2024-03-25T09:24:32.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:32.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:32.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:31 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:32.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:32 smithi019 ceph-mon[29386]: pgmap v441: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:32.665 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:32 smithi040 ceph-mon[33094]: pgmap v441: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:32.666 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:32.666 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:32.666 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:32.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:32 smithi059 ceph-mon[32732]: pgmap v441: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:32.785+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:33.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:33.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:33.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:34.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:34 smithi019 ceph-mon[29386]: pgmap v442: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:34.431 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:34 smithi040 ceph-mon[33094]: pgmap v442: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:34.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:34 smithi059 ceph-mon[32732]: pgmap v442: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:35.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:35 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 188 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:35.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:35.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:35.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:35.675 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:35 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 188 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:35.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:35 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 188 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:36.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:36.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:36.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:36.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:36 smithi019 ceph-mon[29386]: pgmap v443: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:36.665 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:36 smithi040 ceph-mon[33094]: pgmap v443: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:36.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:36.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:36.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:36 smithi059 ceph-mon[32732]: pgmap v443: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:37.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:37.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:37.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:38.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:37.786+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:38.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:38.013 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:38.013 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:38.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:38 smithi019 ceph-mon[29386]: pgmap v444: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:38.456 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:38 smithi040 ceph-mon[33094]: pgmap v444: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:38.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:38 smithi059 ceph-mon[32732]: pgmap v444: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:38.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:38.765 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:38.765 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:39.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:39.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:39.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:40.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:40.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:40.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:40 smithi019 ceph-mon[29386]: pgmap v445: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:40.468 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:40 smithi040 ceph-mon[33094]: pgmap v445: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:40 smithi059 ceph-mon[32732]: pgmap v445: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:40.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:40.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:40.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:41.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:41 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 198 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:41.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:41 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 198 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:41.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:41 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 198 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:41.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:41.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:41.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:42.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:42.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:42.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:42.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:42 smithi019 ceph-mon[29386]: pgmap v446: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:42.445 INFO:tasks.workunit.client.3.smithi129.stderr:Note: switching to 'fb51d73931124de2f09457eaa7f1219e2aeb2c0d'. 2024-03-25T09:24:42.445 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:24:42.445 INFO:tasks.workunit.client.3.smithi129.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-25T09:24:42.445 INFO:tasks.workunit.client.3.smithi129.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-25T09:24:42.446 INFO:tasks.workunit.client.3.smithi129.stderr:state without impacting any branches by switching back to a branch. 2024-03-25T09:24:42.446 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:24:42.446 INFO:tasks.workunit.client.3.smithi129.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-25T09:24:42.446 INFO:tasks.workunit.client.3.smithi129.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-25T09:24:42.446 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:24:42.447 INFO:tasks.workunit.client.3.smithi129.stderr: git switch -c 2024-03-25T09:24:42.447 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:24:42.447 INFO:tasks.workunit.client.3.smithi129.stderr:Or undo this operation with: 2024-03-25T09:24:42.447 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:24:42.447 INFO:tasks.workunit.client.3.smithi129.stderr: git switch - 2024-03-25T09:24:42.447 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:24:42.448 INFO:tasks.workunit.client.3.smithi129.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-25T09:24:42.448 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:24:42.448 INFO:tasks.workunit.client.3.smithi129.stderr:HEAD is now at fb51d739311 thrasher: convert contextmanager func task to 'Task' subclass 2024-03-25T09:24:42.450 DEBUG:teuthology.orchestra.run.smithi129:> cd -- /home/ubuntu/cephtest/clone.client.3/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.3 2024-03-25T09:24:42.480 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:42 smithi040 ceph-mon[33094]: pgmap v446: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:42.505 INFO:tasks.workunit.client.3.smithi129.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-25T09:24:42.507 INFO:tasks.workunit.client.3.smithi129.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2024-03-25T09:24:42.507 INFO:tasks.workunit.client.3.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-25T09:24:42.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:42 smithi059 ceph-mon[32732]: pgmap v446: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:42.557 INFO:tasks.workunit.client.3.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-25T09:24:42.605 INFO:tasks.workunit.client.3.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-25T09:24:42.645 INFO:tasks.workunit.client.3.smithi129.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2024-03-25T09:24:42.647 INFO:tasks.workunit.client.3.smithi129.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2024-03-25T09:24:42.647 INFO:tasks.workunit.client.3.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-25T09:24:42.685 INFO:tasks.workunit.client.3.smithi129.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2024-03-25T09:24:42.688 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-25T09:24:42.688 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/home/ubuntu/cephtest/workunits.list.client.3 of=/dev/stdout 2024-03-25T09:24:42.744 INFO:tasks.workunit:Running workunits matching rbd/nvmeof_fio_test.sh on client.3... 2024-03-25T09:24:42.745 INFO:tasks.workunit:Running workunit rbd/nvmeof_fio_test.sh... 2024-03-25T09:24:42.745 DEBUG:teuthology.orchestra.run.smithi129:workunit test rbd/nvmeof_fio_test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fb51d73931124de2f09457eaa7f1219e2aeb2c0d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 IOSTAT_INTERVAL=10 RBD_POOL=mypool RUNTIME=600 timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/rbd/nvmeof_fio_test.sh --rbd_iostat 2024-03-25T09:24:42.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:42.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:42.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:42.799 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo yum -y install fio 2024-03-25T09:24:43.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:42.786+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:43.349 INFO:tasks.workunit.client.3.smithi129.stdout:Last metadata expiration check: 0:19:02 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:24:43.500 INFO:tasks.workunit.client.3.smithi129.stdout:Dependencies resolved. 2024-03-25T09:24:43.501 INFO:tasks.workunit.client.3.smithi129.stdout:================================================================================ 2024-03-25T09:24:43.501 INFO:tasks.workunit.client.3.smithi129.stdout: Package Arch Version Repository Size 2024-03-25T09:24:43.501 INFO:tasks.workunit.client.3.smithi129.stdout:================================================================================ 2024-03-25T09:24:43.501 INFO:tasks.workunit.client.3.smithi129.stdout:Installing: 2024-03-25T09:24:43.502 INFO:tasks.workunit.client.3.smithi129.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-03-25T09:24:43.502 INFO:tasks.workunit.client.3.smithi129.stdout:Installing dependencies: 2024-03-25T09:24:43.502 INFO:tasks.workunit.client.3.smithi129.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-03-25T09:24:43.502 INFO:tasks.workunit.client.3.smithi129.stdout:Installing weak dependencies: 2024-03-25T09:24:43.502 INFO:tasks.workunit.client.3.smithi129.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-03-25T09:24:43.502 INFO:tasks.workunit.client.3.smithi129.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-03-25T09:24:43.502 INFO:tasks.workunit.client.3.smithi129.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-03-25T09:24:43.502 INFO:tasks.workunit.client.3.smithi129.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-25T09:24:43.503 INFO:tasks.workunit.client.3.smithi129.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-25T09:24:43.503 INFO:tasks.workunit.client.3.smithi129.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-03-25T09:24:43.503 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:24:43.503 INFO:tasks.workunit.client.3.smithi129.stdout:Transaction Summary 2024-03-25T09:24:43.503 INFO:tasks.workunit.client.3.smithi129.stdout:================================================================================ 2024-03-25T09:24:43.503 INFO:tasks.workunit.client.3.smithi129.stdout:Install 8 Packages 2024-03-25T09:24:43.503 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:24:43.504 INFO:tasks.workunit.client.3.smithi129.stdout:Total download size: 6.5 M 2024-03-25T09:24:43.504 INFO:tasks.workunit.client.3.smithi129.stdout:Installed size: 9.1 M 2024-03-25T09:24:43.504 INFO:tasks.workunit.client.3.smithi129.stdout:Downloading Packages: 2024-03-25T09:24:43.856 INFO:tasks.workunit.client.3.smithi129.stdout:(1/8): fio-engine-http-3.35-1.el9.x86_64.rpm 80 kB/s | 17 kB 00:00 2024-03-25T09:24:43.880 INFO:tasks.workunit.client.3.smithi129.stdout:(2/8): fio-engine-libaio-3.35-1.el9.x86_64.rpm 61 kB/s | 14 kB 00:00 2024-03-25T09:24:43.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:43.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:43.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:43.997 INFO:tasks.workunit.client.3.smithi129.stdout:(3/8): fio-engine-nbd-3.35-1.el9.x86_64.rpm 96 kB/s | 13 kB 00:00 2024-03-25T09:24:44.011 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:44.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:44.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:44.023 INFO:tasks.workunit.client.3.smithi129.stdout:(4/8): fio-engine-rados-3.35-1.el9.x86_64.rpm 102 kB/s | 15 kB 00:00 2024-03-25T09:24:44.140 INFO:tasks.workunit.client.3.smithi129.stdout:(5/8): fio-engine-rbd-3.35-1.el9.x86_64.rpm 106 kB/s | 15 kB 00:00 2024-03-25T09:24:44.249 INFO:tasks.workunit.client.3.smithi129.stdout:(6/8): fio-3.35-1.el9.x86_64.rpm 10 MB/s | 6.2 MB 00:00 2024-03-25T09:24:44.274 INFO:tasks.workunit.client.3.smithi129.stdout:(7/8): fio-engine-rdma-3.35-1.el9.x86_64.rpm 79 kB/s | 20 kB 00:00 2024-03-25T09:24:44.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:44 smithi019 ceph-mon[29386]: pgmap v447: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:44.491 INFO:tasks.workunit.client.3.smithi129.stdout:(8/8): libnbd-1.18.1-3.el9.x86_64.rpm 477 kB/s | 166 kB 00:00 2024-03-25T09:24:44.492 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:44 smithi040 ceph-mon[33094]: pgmap v447: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:44.493 INFO:tasks.workunit.client.3.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-25T09:24:44.493 INFO:tasks.workunit.client.3.smithi129.stdout:Total 6.5 MB/s | 6.5 MB 00:00 2024-03-25T09:24:44.505 INFO:tasks.workunit.client.3.smithi129.stdout:Running transaction check 2024-03-25T09:24:44.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:44 smithi059 ceph-mon[32732]: pgmap v447: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:44.517 INFO:tasks.workunit.client.3.smithi129.stdout:Transaction check succeeded. 2024-03-25T09:24:44.517 INFO:tasks.workunit.client.3.smithi129.stdout:Running transaction test 2024-03-25T09:24:44.623 INFO:tasks.workunit.client.3.smithi129.stdout:Transaction test succeeded. 2024-03-25T09:24:44.623 INFO:tasks.workunit.client.3.smithi129.stdout:Running transaction 2024-03-25T09:24:44.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:44.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:44.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:45.067 INFO:tasks.workunit.client.3.smithi129.stdout: Preparing : 1/1 2024-03-25T09:24:45.294 INFO:tasks.workunit.client.3.smithi129.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 1/8 2024-03-25T09:24:45.318 INFO:tasks.workunit.client.3.smithi129.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 2/8 2024-03-25T09:24:45.344 INFO:tasks.workunit.client.3.smithi129.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 3/8 2024-03-25T09:24:45.369 INFO:tasks.workunit.client.3.smithi129.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 4/8 2024-03-25T09:24:45.395 INFO:tasks.workunit.client.3.smithi129.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 5/8 2024-03-25T09:24:45.421 INFO:tasks.workunit.client.3.smithi129.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 6/8 2024-03-25T09:24:45.571 INFO:tasks.workunit.client.3.smithi129.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 7/8 2024-03-25T09:24:45.652 INFO:tasks.workunit.client.3.smithi129.stdout: Installing : fio-3.35-1.el9.x86_64 8/8 2024-03-25T09:24:45.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:45.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:45.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:46.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:46.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:46.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:46 smithi019 ceph-mon[29386]: pgmap v448: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:46 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 203 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:46.505 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:46 smithi040 ceph-mon[33094]: pgmap v448: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:46.505 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:46 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 203 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:46 smithi059 ceph-mon[32732]: pgmap v448: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:46 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 203 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:47.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:47.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:47.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:48.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:47.785+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:48.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:48.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:48.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:48.066 INFO:tasks.workunit.client.3.smithi129.stdout: Running scriptlet: fio-3.35-1.el9.x86_64 8/8 2024-03-25T09:24:48.066 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : fio-3.35-1.el9.x86_64 1/8 2024-03-25T09:24:48.066 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/8 2024-03-25T09:24:48.066 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/8 2024-03-25T09:24:48.066 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/8 2024-03-25T09:24:48.066 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/8 2024-03-25T09:24:48.067 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/8 2024-03-25T09:24:48.067 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/8 2024-03-25T09:24:48.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:48 smithi019 ceph-mon[29386]: pgmap v449: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:48.510 INFO:tasks.workunit.client.3.smithi129.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 8/8 2024-03-25T09:24:48.510 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:24:48.510 INFO:tasks.workunit.client.3.smithi129.stdout:Installed: 2024-03-25T09:24:48.510 INFO:tasks.workunit.client.3.smithi129.stdout: fio-3.35-1.el9.x86_64 fio-engine-http-3.35-1.el9.x86_64 2024-03-25T09:24:48.510 INFO:tasks.workunit.client.3.smithi129.stdout: fio-engine-libaio-3.35-1.el9.x86_64 fio-engine-nbd-3.35-1.el9.x86_64 2024-03-25T09:24:48.510 INFO:tasks.workunit.client.3.smithi129.stdout: fio-engine-rados-3.35-1.el9.x86_64 fio-engine-rbd-3.35-1.el9.x86_64 2024-03-25T09:24:48.511 INFO:tasks.workunit.client.3.smithi129.stdout: fio-engine-rdma-3.35-1.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-03-25T09:24:48.511 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:24:48.511 INFO:tasks.workunit.client.3.smithi129.stdout:Complete! 2024-03-25T09:24:48.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:48 smithi059 ceph-mon[32732]: pgmap v449: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:48.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:48 smithi040 ceph-mon[33094]: pgmap v449: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-25T09:24:48.846 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo yum -y install sysstat 2024-03-25T09:24:49.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:49.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:49.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:49.409 INFO:tasks.workunit.client.3.smithi129.stdout:Last metadata expiration check: 0:19:08 ago on Mon 25 Mar 2024 09:05:41 AM UTC. 2024-03-25T09:24:49.507 INFO:tasks.workunit.client.3.smithi129.stdout:Package sysstat-12.5.4-7.el9.x86_64 is already installed. 2024-03-25T09:24:49.559 INFO:tasks.workunit.client.3.smithi129.stdout:Dependencies resolved. 2024-03-25T09:24:49.560 INFO:tasks.workunit.client.3.smithi129.stdout:Nothing to do. 2024-03-25T09:24:49.560 INFO:tasks.workunit.client.3.smithi129.stdout:Complete! 2024-03-25T09:24:49.625 INFO:tasks.workunit.client.3.smithi129.stderr:+ namespace_range_start= 2024-03-25T09:24:49.625 INFO:tasks.workunit.client.3.smithi129.stderr:+ namespace_range_end= 2024-03-25T09:24:49.625 INFO:tasks.workunit.client.3.smithi129.stderr:+ rbd_iostat=false 2024-03-25T09:24:49.625 INFO:tasks.workunit.client.3.smithi129.stderr:+ [[ 1 -gt 0 ]] 2024-03-25T09:24:49.625 INFO:tasks.workunit.client.3.smithi129.stderr:+ case "$1" in 2024-03-25T09:24:49.625 INFO:tasks.workunit.client.3.smithi129.stderr:+ rbd_iostat=true 2024-03-25T09:24:49.626 INFO:tasks.workunit.client.3.smithi129.stderr:+ shift 2024-03-25T09:24:49.626 INFO:tasks.workunit.client.3.smithi129.stderr:+ [[ 0 -gt 0 ]] 2024-03-25T09:24:49.626 INFO:tasks.workunit.client.3.smithi129.stderr:++ mktemp -t nvmeof-fio-XXXX 2024-03-25T09:24:49.626 INFO:tasks.workunit.client.3.smithi129.stderr:+ fio_file=/tmp/nvmeof-fio-KM7a 2024-03-25T09:24:49.626 INFO:tasks.workunit.client.3.smithi129.stderr:++ sudo nvme list --output-format=json 2024-03-25T09:24:49.627 INFO:tasks.workunit.client.3.smithi129.stderr:++ jq -r '.Devices | sort_by(.NameSpace) | .[] | select(.ModelNumber == "Ceph bdev Controller") | .DevicePath' 2024-03-25T09:24:49.656 INFO:tasks.workunit.client.3.smithi129.stderr:+ all_drives_list='/dev/nvme5n1 2024-03-25T09:24:49.657 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n1 2024-03-25T09:24:49.657 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n1 2024-03-25T09:24:49.657 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n2 2024-03-25T09:24:49.657 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n2 2024-03-25T09:24:49.657 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n2 2024-03-25T09:24:49.657 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n3 2024-03-25T09:24:49.657 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n3 2024-03-25T09:24:49.657 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n3 2024-03-25T09:24:49.657 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n4 2024-03-25T09:24:49.657 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n4 2024-03-25T09:24:49.658 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n4 2024-03-25T09:24:49.658 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n5 2024-03-25T09:24:49.658 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n5 2024-03-25T09:24:49.658 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n5 2024-03-25T09:24:49.658 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n6 2024-03-25T09:24:49.658 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n6 2024-03-25T09:24:49.658 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n6 2024-03-25T09:24:49.658 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n7 2024-03-25T09:24:49.658 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n7 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n7 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n8 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n8 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n8 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n9 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n9 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n9 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n10 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n10 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n10 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n11 2024-03-25T09:24:49.659 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n11 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n11 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n12 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n12 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n12 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n13 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n13 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n13 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n14 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n14 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n14 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n15 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n15 2024-03-25T09:24:49.660 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n15 2024-03-25T09:24:49.661 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n16 2024-03-25T09:24:49.661 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n16 2024-03-25T09:24:49.661 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n16 2024-03-25T09:24:49.661 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n17 2024-03-25T09:24:49.661 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n17 2024-03-25T09:24:49.661 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n17 2024-03-25T09:24:49.661 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n18 2024-03-25T09:24:49.661 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n18 2024-03-25T09:24:49.661 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n18 2024-03-25T09:24:49.662 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n19 2024-03-25T09:24:49.662 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n19 2024-03-25T09:24:49.662 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n19 2024-03-25T09:24:49.662 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n20 2024-03-25T09:24:49.662 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n20 2024-03-25T09:24:49.662 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n20' 2024-03-25T09:24:49.662 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' '' ']' 2024-03-25T09:24:49.662 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' '' ']' 2024-03-25T09:24:49.662 INFO:tasks.workunit.client.3.smithi129.stderr:+ selected_drives='/dev/nvme5n1 2024-03-25T09:24:49.662 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n1 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n1 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n2 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n2 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n2 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n3 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n3 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n3 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n4 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n4 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n4 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n5 2024-03-25T09:24:49.663 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n5 2024-03-25T09:24:49.664 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n5 2024-03-25T09:24:49.664 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n6 2024-03-25T09:24:49.664 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n6 2024-03-25T09:24:49.664 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n6 2024-03-25T09:24:49.664 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n7 2024-03-25T09:24:49.664 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n7 2024-03-25T09:24:49.664 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n7 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n8 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n8 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n8 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n9 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n9 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n9 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n10 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n10 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n10 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n11 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n11 2024-03-25T09:24:49.665 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n11 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n12 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n12 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n12 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n13 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n13 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n13 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n14 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n14 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n14 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n15 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n15 2024-03-25T09:24:49.666 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n15 2024-03-25T09:24:49.667 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n16 2024-03-25T09:24:49.667 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n16 2024-03-25T09:24:49.667 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n16 2024-03-25T09:24:49.667 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n17 2024-03-25T09:24:49.667 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n17 2024-03-25T09:24:49.667 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n17 2024-03-25T09:24:49.667 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n18 2024-03-25T09:24:49.667 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n18 2024-03-25T09:24:49.667 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n18 2024-03-25T09:24:49.667 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n19 2024-03-25T09:24:49.668 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n19 2024-03-25T09:24:49.668 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n19 2024-03-25T09:24:49.668 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n20 2024-03-25T09:24:49.668 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n20 2024-03-25T09:24:49.668 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n20' 2024-03-25T09:24:49.668 INFO:tasks.workunit.client.3.smithi129.stderr:+ RUNTIME=600 2024-03-25T09:24:49.668 INFO:tasks.workunit.client.3.smithi129.stderr:+ cat 2024-03-25T09:24:49.668 INFO:tasks.workunit.client.3.smithi129.stderr:++ echo '/dev/nvme5n1 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n1 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n1 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n2 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n2 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n2 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n3 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n3 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n3 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n4 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n4 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n4 2024-03-25T09:24:49.669 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n5 2024-03-25T09:24:49.670 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n5 2024-03-25T09:24:49.670 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n5 2024-03-25T09:24:49.670 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n6 2024-03-25T09:24:49.670 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n6 2024-03-25T09:24:49.670 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n6 2024-03-25T09:24:49.670 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n7 2024-03-25T09:24:49.670 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n7 2024-03-25T09:24:49.670 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n7 2024-03-25T09:24:49.670 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n8 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n8 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n8 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n9 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n9 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n9 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n10 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n10 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n10 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n11 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n11 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n11 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n12 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n12 2024-03-25T09:24:49.671 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n12 2024-03-25T09:24:49.672 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n13 2024-03-25T09:24:49.672 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n13 2024-03-25T09:24:49.672 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n13 2024-03-25T09:24:49.672 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n14 2024-03-25T09:24:49.672 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n14 2024-03-25T09:24:49.672 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n14 2024-03-25T09:24:49.672 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n15 2024-03-25T09:24:49.673 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n15 2024-03-25T09:24:49.673 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n15 2024-03-25T09:24:49.673 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n16 2024-03-25T09:24:49.673 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n16 2024-03-25T09:24:49.673 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n16 2024-03-25T09:24:49.673 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n17 2024-03-25T09:24:49.673 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n17 2024-03-25T09:24:49.674 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n17 2024-03-25T09:24:49.674 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n18 2024-03-25T09:24:49.674 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n18 2024-03-25T09:24:49.674 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n18 2024-03-25T09:24:49.674 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n19 2024-03-25T09:24:49.674 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n19 2024-03-25T09:24:49.674 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n19 2024-03-25T09:24:49.674 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme5n20 2024-03-25T09:24:49.675 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme2n20 2024-03-25T09:24:49.675 INFO:tasks.workunit.client.3.smithi129.stderr:/dev/nvme8n20' 2024-03-25T09:24:49.675 INFO:tasks.workunit.client.3.smithi129.stderr:++ tr '\n' : 2024-03-25T09:24:49.675 INFO:tasks.workunit.client.3.smithi129.stderr:++ sed 's/:$//' 2024-03-25T09:24:49.675 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeof.fio] starting fio test...' 2024-03-25T09:24:49.676 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeof.fio] starting fio test... 2024-03-25T09:24:49.677 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' -n 10 ']' 2024-03-25T09:24:49.678 INFO:tasks.workunit.client.3.smithi129.stderr:+ iostat_count=60 2024-03-25T09:24:49.678 INFO:tasks.workunit.client.3.smithi129.stderr:+ '[' true = true ']' 2024-03-25T09:24:49.678 INFO:tasks.workunit.client.3.smithi129.stderr:+ iterations=120 2024-03-25T09:24:49.678 INFO:tasks.workunit.client.3.smithi129.stderr:+ iostat -d -p /dev/nvme5n1 /dev/nvme2n1 /dev/nvme8n1 /dev/nvme5n2 /dev/nvme2n2 /dev/nvme8n2 /dev/nvme5n3 /dev/nvme2n3 /dev/nvme8n3 /dev/nvme5n4 /dev/nvme2n4 /dev/nvme8n4 /dev/nvme5n5 /dev/nvme2n5 /dev/nvme8n5 /dev/nvme5n6 /dev/nvme2n6 /dev/nvme8n6 /dev/nvme5n7 /dev/nvme2n7 /dev/nvme8n7 /dev/nvme5n8 /dev/nvme2n8 /dev/nvme8n8 /dev/nvme5n9 /dev/nvme2n9 /dev/nvme8n9 /dev/nvme5n10 /dev/nvme2n10 /dev/nvme8n10 /dev/nvme5n11 /dev/nvme2n11 /dev/nvme8n11 /dev/nvme5n12 /dev/nvme2n12 /dev/nvme8n12 /dev/nvme5n13 /dev/nvme2n13 /dev/nvme8n13 /dev/nvme5n14 /dev/nvme2n14 /dev/nvme8n14 /dev/nvme5n15 /dev/nvme2n15 /dev/nvme8n15 /dev/nvme5n16 /dev/nvme2n16 /dev/nvme8n16 /dev/nvme5n17 /dev/nvme2n17 /dev/nvme8n17 /dev/nvme5n18 /dev/nvme2n18 /dev/nvme8n18 /dev/nvme5n19 /dev/nvme2n19 /dev/nvme8n19 /dev/nvme5n20 /dev/nvme2n20 /dev/nvme8n20 10 60 -h 2024-03-25T09:24:49.678 INFO:tasks.workunit.client.3.smithi129.stderr:+ fio --showcmd /tmp/nvmeof-fio-KM7a 2024-03-25T09:24:49.678 INFO:tasks.workunit.client.3.smithi129.stderr:+ rbd perf image iostat mypool --iterations 120 2024-03-25T09:24:49.695 INFO:tasks.workunit.client.3.smithi129.stdout:Linux 5.14.0-430.el9.x86_64 (smithi129) 03/25/2024 _x86_64_ (8 CPU) 2024-03-25T09:24:49.695 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:24:49.695 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:24:49.695 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n1 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n10 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n11 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n12 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n13 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n14 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n15 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n16 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n17 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n18 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n19 2024-03-25T09:24:49.696 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n2 2024-03-25T09:24:49.697 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n20 2024-03-25T09:24:49.697 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n3 2024-03-25T09:24:49.697 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n4 2024-03-25T09:24:49.697 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n5 2024-03-25T09:24:49.697 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n6 2024-03-25T09:24:49.697 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n7 2024-03-25T09:24:49.697 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n8 2024-03-25T09:24:49.697 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n9 2024-03-25T09:24:49.698 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n1 2024-03-25T09:24:49.698 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n10 2024-03-25T09:24:49.698 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n11 2024-03-25T09:24:49.698 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n12 2024-03-25T09:24:49.698 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n13 2024-03-25T09:24:49.698 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n14 2024-03-25T09:24:49.699 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n15 2024-03-25T09:24:49.699 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n16 2024-03-25T09:24:49.699 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n17 2024-03-25T09:24:49.699 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n18 2024-03-25T09:24:49.699 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n19 2024-03-25T09:24:49.699 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n2 2024-03-25T09:24:49.700 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n20 2024-03-25T09:24:49.700 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n3 2024-03-25T09:24:49.700 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n4 2024-03-25T09:24:49.700 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n5 2024-03-25T09:24:49.700 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n6 2024-03-25T09:24:49.700 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n7 2024-03-25T09:24:49.701 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n8 2024-03-25T09:24:49.701 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n9 2024-03-25T09:24:49.701 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n1 2024-03-25T09:24:49.701 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n10 2024-03-25T09:24:49.701 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n11 2024-03-25T09:24:49.702 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n12 2024-03-25T09:24:49.702 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n13 2024-03-25T09:24:49.702 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n14 2024-03-25T09:24:49.702 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n15 2024-03-25T09:24:49.702 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n16 2024-03-25T09:24:49.703 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n17 2024-03-25T09:24:49.703 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n18 2024-03-25T09:24:49.703 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n19 2024-03-25T09:24:49.703 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n2 2024-03-25T09:24:49.703 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n20 2024-03-25T09:24:49.703 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n3 2024-03-25T09:24:49.704 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n4 2024-03-25T09:24:49.704 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n5 2024-03-25T09:24:49.704 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n6 2024-03-25T09:24:49.704 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n7 2024-03-25T09:24:49.704 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n8 2024-03-25T09:24:49.704 INFO:tasks.workunit.client.3.smithi129.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n9 2024-03-25T09:24:49.705 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:24:49.780 INFO:tasks.workunit.client.3.smithi129.stderr:rbd: waiting for initial image stats 2024-03-25T09:24:49.780 INFO:tasks.workunit.client.3.smithi129.stderr: 2024-03-25T09:24:49.806 INFO:tasks.workunit.client.3.smithi129.stdout:fio --name=nvmeof-fio-test --ioengine=sync --bsrange=4k-64k --numjobs=1 --size=1G --time_based=1 --runtime=600 --rw=randrw --verify=md5 --verify_fatal=1 --direct=1 --filename=/dev/nvme5n1:/dev/nvme2n1:/dev/nvme8n1:/dev/nvme5n2:/dev/nvme2n2:/dev/nvme8n2:/dev/nvme5n3:/dev/nvme2n3:/dev/nvme8n3:/dev/nvme5n4:/dev/nvme2n4:/dev/nvme8n4:/dev/nvme5n5:/dev/nvme2n5:/dev/nvme8n5:/dev/nvme5n6:/dev/nvme2n6:/dev/nvme8n6:/dev/nvme5n7:/dev/nvme2n7:/dev/nvme8n7:/dev/nvme5n8:/dev/nvme2n8:/dev/nvme8n8:/dev/nvme5n9:/dev/nvme2n9:/dev/nvme8n9:/dev/nvme5n10:/dev/nvme2n10:/dev/nvme8n10:/dev/nvme5n11:/dev/nvme2n11:/dev/nvme8n11:/dev/nvme5n12:/dev/nvme2n12:/dev/nvme8n12:/dev/nvme5n13:/dev/nvme2n13:/dev/nvme8n13:/dev/nvme5n14:/dev/nvme2n14:/dev/nvme8n14:/dev/nvme5n15:/dev/nvme2n15:/dev/nvme8n15:/dev/nvme5n16:/dev/nvme2n16:/dev/nvme8n16:/dev/nvme5n17:/dev/nvme2n17:/dev/nvme8n17:/dev/nvme5n18:/dev/nvme2n18:/dev/nvme8n18:/dev/nvme5n19:/dev/nvme2n19:/dev/nvme8n19:/dev/nvme5n20:/dev/nvme2n20:/dev/nvme8n20 2024-03-25T09:24:49.806 INFO:tasks.workunit.client.3.smithi129.stderr:+ sudo fio /tmp/nvmeof-fio-KM7a 2024-03-25T09:24:49.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:49.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:49.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:49.955 INFO:tasks.workunit.client.3.smithi129.stdout:nvmeof-fio-test: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2024-03-25T09:24:49.955 INFO:tasks.workunit.client.3.smithi129.stdout:fio-3.35 2024-03-25T09:24:49.955 INFO:tasks.workunit.client.3.smithi129.stdout:Starting 1 process 2024-03-25T09:24:50.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:50.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:50.012 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:50.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:50 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:24:50.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:50 smithi019 ceph-mon[29386]: { 2024-03-25T09:24:50.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:50 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:24:50.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:50 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:24:50.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:50 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:24:50.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:50 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:24:50.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:50 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:24:50.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:50 smithi019 ceph-mon[29386]: pgmap v450: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:50.417 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:24:50.418 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-mon[33094]: { 2024-03-25T09:24:50.418 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:24:50.418 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:24:50.418 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:24:50.418 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:24:50.418 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:24:50.418 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-mon[33094]: pgmap v450: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:50.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:50 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:24:50.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:50 smithi059 ceph-mon[32732]: { 2024-03-25T09:24:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:50 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:24:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:50 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:24:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:50 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:24:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:50 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:24:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:50 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:24:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:50 smithi059 ceph-mon[32732]: pgmap v450: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-25T09:24:50.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:50.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:50.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:51.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:51.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:51.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:52.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:52.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:52.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:52.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:52 smithi019 ceph-mon[29386]: pgmap v451: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-03-25T09:24:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:52 smithi059 ceph-mon[32732]: pgmap v451: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-03-25T09:24:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:52 smithi040 ceph-mon[33094]: pgmap v451: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-03-25T09:24:53.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:53.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:53.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:52.786+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:53.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:53.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:53.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:54.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:54.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:54.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:54 smithi019 ceph-mon[29386]: pgmap v452: 33 pgs: 33 active+clean; 4.0 MiB data, 235 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-03-25T09:24:54.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:54 smithi059 ceph-mon[32732]: pgmap v452: 33 pgs: 33 active+clean; 4.0 MiB data, 235 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-03-25T09:24:54.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:54 smithi040 ceph-mon[33094]: pgmap v452: 33 pgs: 33 active+clean; 4.0 MiB data, 235 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-03-25T09:24:55.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:55.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:55.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:55 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:24:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:55 smithi019 ceph-mon[29386]: { 2024-03-25T09:24:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:55 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:24:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:55 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:24:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:55 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:24:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:55 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:24:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:55 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:24:55.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:55 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:24:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:55 smithi059 ceph-mon[32732]: { 2024-03-25T09:24:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:55 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:24:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:55 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:24:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:55 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:24:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:55 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:24:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:55 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:24:55.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:55 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:24:55.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:55 smithi040 ceph-mon[33094]: { 2024-03-25T09:24:55.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:55 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:24:55.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:55 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:24:55.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:55 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:24:55.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:55 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:24:55.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:55 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:24:55.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:55.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:55.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:56.081 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:56.082 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:56.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:56 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 208 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:56.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:56 smithi019 ceph-mon[29386]: pgmap v453: 33 pgs: 33 active+clean; 269 MiB data, 247 MiB used, 715 GiB / 715 GiB avail; 227 KiB/s rd, 652 KiB/s wr, 126 op/s 2024-03-25T09:24:56.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:56 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 208 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:56.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:56 smithi059 ceph-mon[32732]: pgmap v453: 33 pgs: 33 active+clean; 269 MiB data, 247 MiB used, 715 GiB / 715 GiB avail; 227 KiB/s rd, 652 KiB/s wr, 126 op/s 2024-03-25T09:24:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:56 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 208 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:24:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:56 smithi040 ceph-mon[33094]: pgmap v453: 33 pgs: 33 active+clean; 269 MiB data, 247 MiB used, 715 GiB / 715 GiB avail; 227 KiB/s rd, 652 KiB/s wr, 126 op/s 2024-03-25T09:24:57.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:57.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:57.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:57.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:57.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:57.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:58.074 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:24:57.787+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:24:58.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:58.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:24:58.075 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:58.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:24:58 smithi019 ceph-mon[29386]: pgmap v454: 33 pgs: 33 active+clean; 545 MiB data, 287 MiB used, 715 GiB / 715 GiB avail; 797 KiB/s rd, 1.8 MiB/s wr, 267 op/s 2024-03-25T09:24:58.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:24:58 smithi059 ceph-mon[32732]: pgmap v454: 33 pgs: 33 active+clean; 545 MiB data, 287 MiB used, 715 GiB / 715 GiB avail; 797 KiB/s rd, 1.8 MiB/s wr, 267 op/s 2024-03-25T09:24:58.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:24:58 smithi040 ceph-mon[33094]: pgmap v454: 33 pgs: 33 active+clean; 545 MiB data, 287 MiB used, 715 GiB / 715 GiB avail; 797 KiB/s rd, 1.8 MiB/s wr, 267 op/s 2024-03-25T09:24:59.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:59.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:24:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:59.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:24:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:24:59.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:24:59.678 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:24:59.678 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 263.2k 144.0k 0.0k 2.6M 1.4M 0.0k nvme2n1 2024-03-25T09:24:59.678 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 272.4k 128.0k 0.0k 2.7M 1.2M 0.0k nvme2n10 2024-03-25T09:24:59.678 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 240.0k 140.4k 0.0k 2.3M 1.4M 0.0k nvme2n11 2024-03-25T09:24:59.678 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 253.6k 132.0k 0.0k 2.5M 1.3M 0.0k nvme2n12 2024-03-25T09:24:59.678 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 277.2k 112.0k 0.0k 2.7M 1.1M 0.0k nvme2n13 2024-03-25T09:24:59.678 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 249.2k 139.6k 0.0k 2.4M 1.4M 0.0k nvme2n14 2024-03-25T09:24:59.678 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 266.4k 109.6k 0.0k 2.6M 1.1M 0.0k nvme2n15 2024-03-25T09:24:59.678 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 250.4k 125.6k 0.0k 2.4M 1.2M 0.0k nvme2n16 2024-03-25T09:24:59.678 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 212.4k 154.4k 0.0k 2.1M 1.5M 0.0k nvme2n17 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 227.2k 159.2k 0.0k 2.2M 1.6M 0.0k nvme2n18 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 210.4k 189.2k 0.0k 2.1M 1.8M 0.0k nvme2n19 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 247.6k 136.8k 0.0k 2.4M 1.3M 0.0k nvme2n2 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.80 268.8k 114.4k 0.0k 2.6M 1.1M 0.0k nvme2n20 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 241.6k 132.4k 0.0k 2.4M 1.3M 0.0k nvme2n3 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 250.8k 143.2k 0.0k 2.4M 1.4M 0.0k nvme2n4 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 252.4k 117.6k 0.0k 2.5M 1.1M 0.0k nvme2n5 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 224.8k 172.0k 0.0k 2.2M 1.7M 0.0k nvme2n6 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 256.8k 134.4k 0.0k 2.5M 1.3M 0.0k nvme2n7 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 253.6k 125.2k 0.0k 2.5M 1.2M 0.0k nvme2n8 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 218.8k 179.6k 0.0k 2.1M 1.8M 0.0k nvme2n9 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 213.6k 156.0k 0.0k 2.1M 1.5M 0.0k nvme5n1 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 230.0k 159.2k 0.0k 2.2M 1.6M 0.0k nvme5n10 2024-03-25T09:24:59.679 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 220.0k 138.0k 0.0k 2.1M 1.3M 0.0k nvme5n11 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 230.4k 130.0k 0.0k 2.2M 1.3M 0.0k nvme5n12 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 225.6k 170.4k 0.0k 2.2M 1.7M 0.0k nvme5n13 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 218.4k 139.6k 0.0k 2.1M 1.4M 0.0k nvme5n14 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 277.6k 124.8k 0.0k 2.7M 1.2M 0.0k nvme5n15 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 292.0k 138.0k 0.0k 2.9M 1.3M 0.0k nvme5n16 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 262.4k 137.2k 0.0k 2.6M 1.3M 0.0k nvme5n17 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 241.6k 147.2k 0.0k 2.4M 1.4M 0.0k nvme5n18 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 254.4k 142.4k 0.0k 2.5M 1.4M 0.0k nvme5n19 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 205.6k 171.2k 0.0k 2.0M 1.7M 0.0k nvme5n2 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.80 235.2k 142.8k 0.0k 2.3M 1.4M 0.0k nvme5n20 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 245.6k 110.0k 0.0k 2.4M 1.1M 0.0k nvme5n3 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 270.8k 116.4k 0.0k 2.6M 1.1M 0.0k nvme5n4 2024-03-25T09:24:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 246.4k 136.4k 0.0k 2.4M 1.3M 0.0k nvme5n5 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 255.2k 140.4k 0.0k 2.5M 1.4M 0.0k nvme5n6 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 239.2k 149.2k 0.0k 2.3M 1.5M 0.0k nvme5n7 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 233.2k 155.2k 0.0k 2.3M 1.5M 0.0k nvme5n8 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 249.2k 162.0k 0.0k 2.4M 1.6M 0.0k nvme5n9 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 238.4k 117.2k 0.0k 2.3M 1.1M 0.0k nvme8n1 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 221.2k 147.2k 0.0k 2.2M 1.4M 0.0k nvme8n10 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 261.2k 149.6k 0.0k 2.6M 1.5M 0.0k nvme8n11 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 246.4k 145.6k 0.0k 2.4M 1.4M 0.0k nvme8n12 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 245.6k 115.2k 0.0k 2.4M 1.1M 0.0k nvme8n13 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 267.6k 170.0k 0.0k 2.6M 1.7M 0.0k nvme8n14 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 224.0k 138.8k 0.0k 2.2M 1.4M 0.0k nvme8n15 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 256.8k 155.2k 0.0k 2.5M 1.5M 0.0k nvme8n16 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 256.4k 155.2k 0.0k 2.5M 1.5M 0.0k nvme8n17 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 236.8k 178.4k 0.0k 2.3M 1.7M 0.0k nvme8n18 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.80 251.6k 126.4k 0.0k 2.5M 1.2M 0.0k nvme8n19 2024-03-25T09:24:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 240.8k 141.6k 0.0k 2.4M 1.4M 0.0k nvme8n2 2024-03-25T09:24:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 13.80 224.8k 155.6k 0.0k 2.2M 1.5M 0.0k nvme8n20 2024-03-25T09:24:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 246.0k 171.2k 0.0k 2.4M 1.7M 0.0k nvme8n3 2024-03-25T09:24:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 210.4k 153.2k 0.0k 2.1M 1.5M 0.0k nvme8n4 2024-03-25T09:24:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 229.6k 167.6k 0.0k 2.2M 1.6M 0.0k nvme8n5 2024-03-25T09:24:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 274.0k 118.8k 0.0k 2.7M 1.2M 0.0k nvme8n6 2024-03-25T09:24:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 233.2k 163.6k 0.0k 2.3M 1.6M 0.0k nvme8n7 2024-03-25T09:24:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 249.2k 151.6k 0.0k 2.4M 1.5M 0.0k nvme8n8 2024-03-25T09:24:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 13.90 232.4k 138.4k 0.0k 2.3M 1.4M 0.0k nvme8n9 2024-03-25T09:24:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:24:59.786 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:24:59.786 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 8/s 4/s 237 KiB/s 77 KiB/s 986.57 us 157.37 us 2024-03-25T09:24:59.786 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 7/s 5/s 188 KiB/s 117 KiB/s 910.49 us 161.05 us 2024-03-25T09:24:59.786 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 4/s 202 KiB/s 98 KiB/s 907.51 us 148.23 us 2024-03-25T09:24:59.786 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 5/s 215 KiB/s 124 KiB/s 947.81 us 167.24 us 2024-03-25T09:24:59.786 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 4/s 175 KiB/s 106 KiB/s 957.94 us 175.02 us 2024-03-25T09:24:59.786 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 5/s 206 KiB/s 165 KiB/s 927.49 us 165.66 us 2024-03-25T09:24:59.786 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 5/s 209 KiB/s 134 KiB/s 944.84 us 155.12 us 2024-03-25T09:24:59.786 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 4/s 219 KiB/s 98 KiB/s 944.63 us 170.90 us 2024-03-25T09:24:59.786 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 3/s 180 KiB/s 103 KiB/s 943.72 us 162.60 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 4/s 178 KiB/s 82 KiB/s 943.38 us 155.24 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 157 KiB/s 96 KiB/s 943.72 us 152.31 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 3/s 178 KiB/s 89 KiB/s 937.85 us 170.75 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 177 KiB/s 42 KiB/s 945.19 us 150.64 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 3/s 103 KiB/s 54 KiB/s 891.65 us 148.68 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 126 KiB/s 66 KiB/s 1.01 ms 151.38 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 2/s 155 KiB/s 40 KiB/s 955.62 us 160.03 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 2/s 95 KiB/s 55 KiB/s 919.44 us 147.65 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 3/s 110 KiB/s 72 KiB/s 926.58 us 152.61 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 2/s 97 KiB/s 58 KiB/s 935.52 us 161.57 us 2024-03-25T09:24:59.787 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:24:59.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:24:59.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:24:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:24:59.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:24:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:00.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:00.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:24:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:00.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:24:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:00.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:00 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:00 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:00 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:00 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:00 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:00 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:00 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:00.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:00 smithi019 ceph-mon[29386]: pgmap v455: 33 pgs: 33 active+clean; 768 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 431 op/s 2024-03-25T09:25:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:00 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:00 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:00 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:00 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:00 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:00 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:00 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:00 smithi059 ceph-mon[32732]: pgmap v455: 33 pgs: 33 active+clean; 768 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 431 op/s 2024-03-25T09:25:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:00.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:00.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:00.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-mon[33094]: pgmap v455: 33 pgs: 33 active+clean; 768 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 431 op/s 2024-03-25T09:25:01.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:01.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:01.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:01 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 218 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:01.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:01 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 218 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:01.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:01 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 218 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:02.079 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:02.079 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:02.079 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:02 smithi059 ceph-mon[32732]: pgmap v456: 33 pgs: 33 active+clean; 925 MiB data, 524 MiB used, 715 GiB / 715 GiB avail; 4.5 MiB/s rd, 7.2 MiB/s wr, 683 op/s 2024-03-25T09:25:02.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:02.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:02.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:02.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:02 smithi019 ceph-mon[29386]: pgmap v456: 33 pgs: 33 active+clean; 925 MiB data, 524 MiB used, 715 GiB / 715 GiB avail; 4.5 MiB/s rd, 7.2 MiB/s wr, 683 op/s 2024-03-25T09:25:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:02 smithi040 ceph-mon[33094]: pgmap v456: 33 pgs: 33 active+clean; 925 MiB data, 524 MiB used, 715 GiB / 715 GiB avail; 4.5 MiB/s rd, 7.2 MiB/s wr, 683 op/s 2024-03-25T09:25:03.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:03.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:03.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:02.787+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:04.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:04.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:04.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:04.162 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:04 smithi059 ceph-mon[32732]: pgmap v457: 33 pgs: 33 active+clean; 942 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 8.5 MiB/s wr, 771 op/s 2024-03-25T09:25:04.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:04.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:04.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:04.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:04 smithi019 ceph-mon[29386]: pgmap v457: 33 pgs: 33 active+clean; 942 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 8.5 MiB/s wr, 771 op/s 2024-03-25T09:25:04.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:04 smithi040 ceph-mon[33094]: pgmap v457: 33 pgs: 33 active+clean; 942 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 8.5 MiB/s wr, 771 op/s 2024-03-25T09:25:04.791 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:04.791 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 10/s 7/s 322 KiB/s 197 KiB/s 954.29 us 163.70 us 2024-03-25T09:25:04.791 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 10/s 6/s 318 KiB/s 122 KiB/s 915.68 us 160.04 us 2024-03-25T09:25:04.791 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 9/s 7/s 315 KiB/s 174 KiB/s 950.45 us 156.71 us 2024-03-25T09:25:04.791 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 9/s 6/s 264 KiB/s 160 KiB/s 962.07 us 161.54 us 2024-03-25T09:25:04.791 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 9/s 7/s 246 KiB/s 182 KiB/s 931.48 us 160.28 us 2024-03-25T09:25:04.791 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 9/s 6/s 244 KiB/s 179 KiB/s 958.67 us 160.60 us 2024-03-25T09:25:04.791 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 9/s 6/s 295 KiB/s 132 KiB/s 983.86 us 159.86 us 2024-03-25T09:25:04.791 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 9/s 6/s 284 KiB/s 121 KiB/s 914.78 us 152.38 us 2024-03-25T09:25:04.791 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 9/s 7/s 288 KiB/s 202 KiB/s 925.91 us 157.16 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 9/s 7/s 294 KiB/s 197 KiB/s 947.99 us 172.03 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 9/s 6/s 278 KiB/s 130 KiB/s 988.44 us 161.27 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 8/s 6/s 238 KiB/s 204 KiB/s 956.07 us 156.82 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 8/s 7/s 263 KiB/s 145 KiB/s 960.19 us 157.90 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 8/s 7/s 287 KiB/s 164 KiB/s 931.84 us 163.16 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 8/s 8/s 206 KiB/s 259 KiB/s 939.44 us 158.78 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 8/s 7/s 266 KiB/s 216 KiB/s 957.74 us 162.94 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 8/s 7/s 307 KiB/s 137 KiB/s 950.19 us 162.68 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 8/s 7/s 218 KiB/s 161 KiB/s 958.12 us 157.95 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 8/s 8/s 252 KiB/s 190 KiB/s 907.96 us 154.31 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 8/s 8/s 274 KiB/s 235 KiB/s 948.33 us 152.27 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 8/s 7/s 283 KiB/s 188 KiB/s 932.07 us 157.58 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 8/s 8/s 254 KiB/s 183 KiB/s 939.41 us 157.24 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 8/s 7/s 268 KiB/s 185 KiB/s 983.11 us 162.57 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 8/s 7/s 235 KiB/s 198 KiB/s 938.49 us 167.80 us 2024-03-25T09:25:04.792 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 8/s 8/s 277 KiB/s 190 KiB/s 918.60 us 149.09 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 8/s 9/s 242 KiB/s 194 KiB/s 987.42 us 153.98 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 8/s 8/s 245 KiB/s 236 KiB/s 961.30 us 159.44 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 8/s 7/s 244 KiB/s 182 KiB/s 916.39 us 162.59 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 8/s 9/s 269 KiB/s 233 KiB/s 918.27 us 160.95 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 8/s 7/s 225 KiB/s 195 KiB/s 939.60 us 159.47 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 8/s 7/s 274 KiB/s 145 KiB/s 977.14 us 162.55 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 8/s 10/s 270 KiB/s 234 KiB/s 945.73 us 171.33 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 8/s 8/s 235 KiB/s 208 KiB/s 985.46 us 164.43 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 8/s 8/s 203 KiB/s 218 KiB/s 946.85 us 152.95 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 8/s 7/s 274 KiB/s 187 KiB/s 929.86 us 166.60 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 8/s 9/s 242 KiB/s 252 KiB/s 935.12 us 164.43 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 7/s 7/s 230 KiB/s 206 KiB/s 956.56 us 162.39 us 2024-03-25T09:25:04.793 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 7/s 7/s 221 KiB/s 202 KiB/s 946.88 us 159.77 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 7/s 8/s 233 KiB/s 216 KiB/s 942.95 us 159.66 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 7/s 9/s 261 KiB/s 218 KiB/s 956.55 us 162.96 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 7/s 8/s 258 KiB/s 185 KiB/s 935.74 us 155.31 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 7/s 8/s 234 KiB/s 228 KiB/s 909.15 us 155.43 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 8/s 251 KiB/s 205 KiB/s 950.44 us 159.88 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 7/s 9/s 258 KiB/s 186 KiB/s 972.12 us 163.11 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 7/s 9/s 179 KiB/s 208 KiB/s 963.51 us 157.07 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 7/s 9/s 214 KiB/s 208 KiB/s 912.03 us 157.23 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 7/s 7/s 229 KiB/s 186 KiB/s 932.39 us 166.35 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 7/s 8/s 242 KiB/s 198 KiB/s 940.18 us 154.80 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 7/s 7/s 228 KiB/s 178 KiB/s 919.74 us 155.95 us 2024-03-25T09:25:04.794 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 7/s 9/s 223 KiB/s 217 KiB/s 940.48 us 159.24 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 7/s 8/s 235 KiB/s 216 KiB/s 990.94 us 158.97 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 7/s 10/s 203 KiB/s 242 KiB/s 938.50 us 160.06 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 7/s 9/s 196 KiB/s 231 KiB/s 915.61 us 164.20 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 7/s 9/s 215 KiB/s 203 KiB/s 967.67 us 160.04 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 7/s 8/s 230 KiB/s 222 KiB/s 933.68 us 152.14 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 7/s 7/s 233 KiB/s 178 KiB/s 929.67 us 164.64 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 9/s 148 KiB/s 203 KiB/s 934.55 us 152.95 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 6/s 7/s 234 KiB/s 242 KiB/s 956.60 us 156.94 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 9/s 189 KiB/s 234 KiB/s 949.42 us 159.93 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 9/s 165 KiB/s 250 KiB/s 954.72 us 160.21 us 2024-03-25T09:25:04.795 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:05.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:05.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:05.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:05.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:05 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:05.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:05 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:05 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:05 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:05 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:05 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:05 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:05 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:05 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:05 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:05 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:05 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:05 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:05 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:05 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:05 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:05 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:05 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:05.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:05 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:05.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:05 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:05.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:05 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:06.084 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:06.084 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:06.084 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:06 smithi059 ceph-mon[32732]: pgmap v458: 33 pgs: 33 active+clean; 967 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 8.4 MiB/s rd, 12 MiB/s wr, 994 op/s 2024-03-25T09:25:06.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:06.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:06.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:06.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:06 smithi019 ceph-mon[29386]: pgmap v458: 33 pgs: 33 active+clean; 967 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 8.4 MiB/s rd, 12 MiB/s wr, 994 op/s 2024-03-25T09:25:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:06 smithi040 ceph-mon[33094]: pgmap v458: 33 pgs: 33 active+clean; 967 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 8.4 MiB/s rd, 12 MiB/s wr, 994 op/s 2024-03-25T09:25:07.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:07.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:07.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:07 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 223 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:07 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 223 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:07.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:07 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 223 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:08.086 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:07.787+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:08.087 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:08.087 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:08.087 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:08.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:08.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:08.088 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:08.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:08 smithi019 ceph-mon[29386]: pgmap v459: 33 pgs: 33 active+clean; 976 MiB data, 778 MiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-03-25T09:25:08.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:08 smithi059 ceph-mon[32732]: pgmap v459: 33 pgs: 33 active+clean; 976 MiB data, 778 MiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-03-25T09:25:08.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:08 smithi040 ceph-mon[33094]: pgmap v459: 33 pgs: 33 active+clean; 976 MiB data, 778 MiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-03-25T09:25:09.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:09.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:09.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:09.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:25:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 200.8k 256.8k 0.0k 2.0M 2.5M 0.0k nvme2n1 2024-03-25T09:25:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 243.2k 228.8k 0.0k 2.4M 2.2M 0.0k nvme2n10 2024-03-25T09:25:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 249.2k 252.4k 0.0k 2.4M 2.5M 0.0k nvme2n11 2024-03-25T09:25:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 186.8k 257.6k 0.0k 1.8M 2.5M 0.0k nvme2n12 2024-03-25T09:25:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 262.0k 206.8k 0.0k 2.6M 2.0M 0.0k nvme2n13 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 206.8k 252.8k 0.0k 2.0M 2.5M 0.0k nvme2n14 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 230.4k 222.4k 0.0k 2.2M 2.2M 0.0k nvme2n15 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 220.0k 206.4k 0.0k 2.1M 2.0M 0.0k nvme2n16 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 232.4k 224.8k 0.0k 2.3M 2.2M 0.0k nvme2n17 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 206.8k 241.6k 0.0k 2.0M 2.4M 0.0k nvme2n18 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 236.0k 210.0k 0.0k 2.3M 2.1M 0.0k nvme2n19 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 211.6k 227.6k 0.0k 2.1M 2.2M 0.0k nvme2n2 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.90 220.0k 268.0k 0.0k 2.1M 2.6M 0.0k nvme2n20 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 194.8k 246.8k 0.0k 1.9M 2.4M 0.0k nvme2n3 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 238.4k 204.8k 0.0k 2.3M 2.0M 0.0k nvme2n4 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 279.6k 169.6k 0.0k 2.7M 1.7M 0.0k nvme2n5 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 231.2k 214.0k 0.0k 2.3M 2.1M 0.0k nvme2n6 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 242.0k 234.4k 0.0k 2.4M 2.3M 0.0k nvme2n7 2024-03-25T09:25:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 234.4k 190.0k 0.0k 2.3M 1.9M 0.0k nvme2n8 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 254.8k 222.0k 0.0k 2.5M 2.2M 0.0k nvme2n9 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 217.2k 268.0k 0.0k 2.1M 2.6M 0.0k nvme5n1 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 238.8k 202.8k 0.0k 2.3M 2.0M 0.0k nvme5n10 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 223.6k 202.0k 0.0k 2.2M 2.0M 0.0k nvme5n11 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 227.6k 224.8k 0.0k 2.2M 2.2M 0.0k nvme5n12 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 242.0k 212.0k 0.0k 2.4M 2.1M 0.0k nvme5n13 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 218.4k 243.6k 0.0k 2.1M 2.4M 0.0k nvme5n14 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 221.2k 207.6k 0.0k 2.2M 2.0M 0.0k nvme5n15 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 238.0k 196.4k 0.0k 2.3M 1.9M 0.0k nvme5n16 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 248.0k 212.0k 0.0k 2.4M 2.1M 0.0k nvme5n17 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 191.6k 229.6k 0.0k 1.9M 2.2M 0.0k nvme5n18 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 207.2k 262.4k 0.0k 2.0M 2.6M 0.0k nvme5n19 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 248.0k 207.6k 0.0k 2.4M 2.0M 0.0k nvme5n2 2024-03-25T09:25:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 15.90 249.6k 189.2k 0.0k 2.4M 1.8M 0.0k nvme5n20 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 242.0k 202.8k 0.0k 2.4M 2.0M 0.0k nvme5n3 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 240.4k 208.4k 0.0k 2.3M 2.0M 0.0k nvme5n4 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 235.6k 220.0k 0.0k 2.3M 2.1M 0.0k nvme5n5 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 198.4k 226.0k 0.0k 1.9M 2.2M 0.0k nvme5n6 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 222.0k 236.4k 0.0k 2.2M 2.3M 0.0k nvme5n7 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 146.4k 273.6k 0.0k 1.4M 2.7M 0.0k nvme5n8 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 216.0k 232.0k 0.0k 2.1M 2.3M 0.0k nvme5n9 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 219.6k 250.8k 0.0k 2.1M 2.4M 0.0k nvme8n1 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 244.0k 196.0k 0.0k 2.4M 1.9M 0.0k nvme8n10 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 216.8k 246.8k 0.0k 2.1M 2.4M 0.0k nvme8n11 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 191.6k 244.8k 0.0k 1.9M 2.4M 0.0k nvme8n12 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 203.2k 220.8k 0.0k 2.0M 2.2M 0.0k nvme8n13 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 218.4k 226.8k 0.0k 2.1M 2.2M 0.0k nvme8n14 2024-03-25T09:25:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 231.2k 229.6k 0.0k 2.3M 2.2M 0.0k nvme8n15 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 233.6k 223.2k 0.0k 2.3M 2.2M 0.0k nvme8n16 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 224.0k 191.6k 0.0k 2.2M 1.9M 0.0k nvme8n17 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 209.2k 232.4k 0.0k 2.0M 2.3M 0.0k nvme8n18 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.90 192.0k 275.6k 0.0k 1.9M 2.7M 0.0k nvme8n19 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 226.8k 216.8k 0.0k 2.2M 2.1M 0.0k nvme8n2 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.90 288.0k 175.2k 0.0k 2.8M 1.7M 0.0k nvme8n20 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 234.8k 183.2k 0.0k 2.3M 1.8M 0.0k nvme8n3 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 234.4k 244.4k 0.0k 2.3M 2.4M 0.0k nvme8n4 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 226.0k 214.4k 0.0k 2.2M 2.1M 0.0k nvme8n5 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 239.2k 228.0k 0.0k 2.3M 2.2M 0.0k nvme8n6 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 302.4k 164.4k 0.0k 3.0M 1.6M 0.0k nvme8n7 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 220.4k 210.0k 0.0k 2.2M 2.1M 0.0k nvme8n8 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.80 247.2k 203.6k 0.0k 2.4M 2.0M 0.0k nvme8n9 2024-03-25T09:25:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:09.795 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:09.796 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 10/s 6/s 287 KiB/s 142 KiB/s 982.68 us 164.77 us 2024-03-25T09:25:09.796 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 9/s 7/s 275 KiB/s 188 KiB/s 992.53 us 166.58 us 2024-03-25T09:25:09.796 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 9/s 6/s 269 KiB/s 124 KiB/s 961.88 us 162.10 us 2024-03-25T09:25:09.796 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 9/s 5/s 292 KiB/s 154 KiB/s 958.16 us 162.89 us 2024-03-25T09:25:09.796 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 9/s 5/s 235 KiB/s 125 KiB/s 961.58 us 173.19 us 2024-03-25T09:25:09.796 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 9/s 8/s 237 KiB/s 207 KiB/s 969.19 us 163.34 us 2024-03-25T09:25:09.796 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 9/s 6/s 288 KiB/s 151 KiB/s 967.80 us 160.17 us 2024-03-25T09:25:09.796 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 9/s 6/s 274 KiB/s 156 KiB/s 1.03 ms 167.17 us 2024-03-25T09:25:09.796 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 9/s 6/s 235 KiB/s 169 KiB/s 957.57 us 157.17 us 2024-03-25T09:25:09.796 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 8/s 8/s 228 KiB/s 202 KiB/s 968.82 us 163.80 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 8/s 6/s 271 KiB/s 156 KiB/s 965.05 us 165.05 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 8/s 8/s 271 KiB/s 181 KiB/s 1.02 ms 163.62 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 8/s 6/s 234 KiB/s 180 KiB/s 964.35 us 162.27 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 8/s 8/s 297 KiB/s 209 KiB/s 998.51 us 167.59 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 8/s 6/s 234 KiB/s 164 KiB/s 993.25 us 163.74 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 8/s 7/s 274 KiB/s 159 KiB/s 999.30 us 173.81 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 8/s 6/s 236 KiB/s 194 KiB/s 971.88 us 163.04 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 8/s 8/s 238 KiB/s 194 KiB/s 982.58 us 166.43 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 8/s 9/s 203 KiB/s 265 KiB/s 975.70 us 168.95 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 8/s 8/s 246 KiB/s 193 KiB/s 987.44 us 167.41 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 8/s 8/s 236 KiB/s 172 KiB/s 996.06 us 168.15 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 8/s 8/s 231 KiB/s 165 KiB/s 959.92 us 164.56 us 2024-03-25T09:25:09.797 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 8/s 6/s 226 KiB/s 141 KiB/s 958.53 us 155.69 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 8/s 7/s 241 KiB/s 199 KiB/s 955.87 us 164.38 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 8/s 7/s 230 KiB/s 207 KiB/s 955.52 us 169.34 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 8/s 7/s 238 KiB/s 241 KiB/s 966.20 us 160.42 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 8/s 8/s 222 KiB/s 207 KiB/s 961.25 us 173.38 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 8/s 7/s 197 KiB/s 208 KiB/s 929.05 us 154.82 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 8/s 10/s 225 KiB/s 252 KiB/s 957.70 us 166.50 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 8/s 7/s 237 KiB/s 193 KiB/s 954.35 us 159.22 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 7/s 7/s 246 KiB/s 178 KiB/s 978.71 us 158.92 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 7/s 8/s 211 KiB/s 170 KiB/s 960.83 us 153.53 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 7/s 7/s 202 KiB/s 166 KiB/s 961.67 us 163.89 us 2024-03-25T09:25:09.798 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 7/s 248 KiB/s 193 KiB/s 978.29 us 161.05 us 2024-03-25T09:25:09.799 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 7/s 9/s 207 KiB/s 238 KiB/s 950.23 us 171.93 us 2024-03-25T09:25:09.799 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 7/s 8/s 190 KiB/s 210 KiB/s 991.67 us 157.56 us 2024-03-25T09:25:09.799 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 7/s 9/s 209 KiB/s 201 KiB/s 960.46 us 155.69 us 2024-03-25T09:25:09.799 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 7/s 8/s 215 KiB/s 246 KiB/s 980.82 us 170.74 us 2024-03-25T09:25:09.799 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 7/s 8/s 221 KiB/s 197 KiB/s 1.01 ms 167.84 us 2024-03-25T09:25:09.799 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 7/s 7/s 184 KiB/s 212 KiB/s 983.91 us 167.26 us 2024-03-25T09:25:09.799 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 7/s 193 KiB/s 186 KiB/s 986.53 us 162.00 us 2024-03-25T09:25:09.799 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 7/s 7/s 157 KiB/s 230 KiB/s 950.15 us 171.44 us 2024-03-25T09:25:09.799 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 7/s 9/s 196 KiB/s 220 KiB/s 1.00 ms 167.30 us 2024-03-25T09:25:09.800 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 7/s 7/s 222 KiB/s 179 KiB/s 948.32 us 162.95 us 2024-03-25T09:25:09.800 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 7/s 8/s 193 KiB/s 205 KiB/s 970.20 us 163.25 us 2024-03-25T09:25:09.800 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 7/s 8/s 234 KiB/s 185 KiB/s 974.02 us 165.58 us 2024-03-25T09:25:09.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 7/s 8/s 177 KiB/s 153 KiB/s 955.59 us 161.00 us 2024-03-25T09:25:09.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 8/s 218 KiB/s 162 KiB/s 973.06 us 159.25 us 2024-03-25T09:25:09.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 7/s 7/s 193 KiB/s 178 KiB/s 1.04 ms 162.77 us 2024-03-25T09:25:09.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 6/s 8/s 226 KiB/s 210 KiB/s 996.88 us 171.23 us 2024-03-25T09:25:09.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 9/s 187 KiB/s 227 KiB/s 988.91 us 165.83 us 2024-03-25T09:25:09.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 8/s 187 KiB/s 186 KiB/s 1.10 ms 162.95 us 2024-03-25T09:25:09.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 6/s 7/s 216 KiB/s 171 KiB/s 960.34 us 152.89 us 2024-03-25T09:25:09.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 8/s 210 KiB/s 282 KiB/s 959.88 us 157.73 us 2024-03-25T09:25:09.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 7/s 210 KiB/s 208 KiB/s 963.24 us 160.22 us 2024-03-25T09:25:09.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 9/s 166 KiB/s 198 KiB/s 954.17 us 161.07 us 2024-03-25T09:25:09.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 8/s 192 KiB/s 194 KiB/s 981.55 us 159.11 us 2024-03-25T09:25:09.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 8/s 174 KiB/s 225 KiB/s 990.81 us 161.35 us 2024-03-25T09:25:09.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 9/s 144 KiB/s 228 KiB/s 946.20 us 166.71 us 2024-03-25T09:25:09.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 9/s 147 KiB/s 196 KiB/s 921.35 us 157.45 us 2024-03-25T09:25:09.802 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:10.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:10.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:10.078 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:10.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:10 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:10.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:10 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:10.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:10 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:10.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:10 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:10.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:10 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:10.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:10 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:10.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:10 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:10.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:10 smithi059 ceph-mon[32732]: pgmap v460: 33 pgs: 33 active+clean; 982 MiB data, 831 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 13 MiB/s wr, 984 op/s 2024-03-25T09:25:10.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:10.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:10.264 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:09 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:10 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:10 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:10 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:10 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:10 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:10 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:10 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:10 smithi019 ceph-mon[29386]: pgmap v460: 33 pgs: 33 active+clean; 982 MiB data, 831 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 13 MiB/s wr, 984 op/s 2024-03-25T09:25:10.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:10.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:10.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:10.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:10.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:10.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:10.515 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:10.515 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-mon[33094]: pgmap v460: 33 pgs: 33 active+clean; 982 MiB data, 831 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 13 MiB/s wr, 984 op/s 2024-03-25T09:25:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:11.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:12.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:12.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:12.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:12 smithi059 ceph-mon[32732]: pgmap v461: 33 pgs: 33 active+clean; 992 MiB data, 903 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-03-25T09:25:12.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:12.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:12.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:11 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:12.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:12 smithi019 ceph-mon[29386]: pgmap v461: 33 pgs: 33 active+clean; 992 MiB data, 903 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-03-25T09:25:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:12 smithi040 ceph-mon[33094]: pgmap v461: 33 pgs: 33 active+clean; 992 MiB data, 903 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-03-25T09:25:13.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:13.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:13.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:12.787+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:13.865 INFO:tasks.nvmeof.[nvmeof.thrasher]:nvmeof daemons to thrash: 1 2024-03-25T09:25:13.865 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.c 2024-03-25T09:25:13.865 INFO:tasks.nvmeof.ceph.nvmeof.nvmeof.c:Stopping nvmeof.nvmeof.c... 2024-03-25T09:25:13.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.c 2024-03-25T09:25:14.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:14.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:14.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:14.165 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:14 smithi059 ceph-mon[32732]: pgmap v462: 33 pgs: 33 active+clean; 995 MiB data, 946 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 12 MiB/s wr, 884 op/s 2024-03-25T09:25:14.166 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:14.166 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:13 smithi059 systemd[1]: Stopping Ceph nvmeof.nvmeof.c for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:25:14.166 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:14.166 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:13 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:14.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:14 smithi019 ceph-mon[29386]: pgmap v462: 33 pgs: 33 active+clean; 995 MiB data, 946 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 12 MiB/s wr, 884 op/s 2024-03-25T09:25:14.511 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:14 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:14] INFO utils.py:399: Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log.gz 2024-03-25T09:25:14.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:14 smithi040 ceph-mon[33094]: pgmap v462: 33 pgs: 33 active+clean; 995 MiB data, 946 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 12 MiB/s wr, 884 op/s 2024-03-25T09:25:14.800 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:14.800 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 10/s 6/s 242 KiB/s 180 KiB/s 971.25 us 150.48 us 2024-03-25T09:25:14.800 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 9/s 7/s 259 KiB/s 161 KiB/s 1.04 ms 160.59 us 2024-03-25T09:25:14.800 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 9/s 7/s 276 KiB/s 156 KiB/s 1.04 ms 163.54 us 2024-03-25T09:25:14.800 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 9/s 7/s 254 KiB/s 166 KiB/s 990.37 us 164.26 us 2024-03-25T09:25:14.800 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 9/s 6/s 260 KiB/s 132 KiB/s 988.63 us 164.88 us 2024-03-25T09:25:14.800 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 9/s 6/s 256 KiB/s 142 KiB/s 1.05 ms 155.43 us 2024-03-25T09:25:14.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 9/s 8/s 234 KiB/s 146 KiB/s 985.49 us 175.79 us 2024-03-25T09:25:14.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 9/s 6/s 251 KiB/s 179 KiB/s 967.20 us 152.63 us 2024-03-25T09:25:14.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 9/s 6/s 228 KiB/s 155 KiB/s 980.80 us 163.37 us 2024-03-25T09:25:14.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 8/s 7/s 198 KiB/s 184 KiB/s 973.19 us 163.05 us 2024-03-25T09:25:14.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 8/s 7/s 192 KiB/s 173 KiB/s 1.02 ms 163.56 us 2024-03-25T09:25:14.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 8/s 6/s 213 KiB/s 145 KiB/s 1.00 ms 154.71 us 2024-03-25T09:25:14.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 8/s 9/s 253 KiB/s 206 KiB/s 985.23 us 173.09 us 2024-03-25T09:25:14.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 8/s 6/s 242 KiB/s 148 KiB/s 966.16 us 158.29 us 2024-03-25T09:25:14.801 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 8/s 9/s 217 KiB/s 201 KiB/s 1.01 ms 162.84 us 2024-03-25T09:25:14.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 8/s 8/s 203 KiB/s 186 KiB/s 976.11 us 156.77 us 2024-03-25T09:25:14.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 8/s 7/s 234 KiB/s 178 KiB/s 987.56 us 157.36 us 2024-03-25T09:25:14.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 8/s 6/s 214 KiB/s 165 KiB/s 1.01 ms 160.45 us 2024-03-25T09:25:14.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 8/s 7/s 225 KiB/s 157 KiB/s 992.69 us 154.35 us 2024-03-25T09:25:14.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 8/s 6/s 227 KiB/s 139 KiB/s 992.02 us 161.11 us 2024-03-25T09:25:14.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 8/s 7/s 226 KiB/s 155 KiB/s 991.67 us 159.01 us 2024-03-25T09:25:14.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 8/s 5/s 242 KiB/s 174 KiB/s 1.01 ms 173.85 us 2024-03-25T09:25:14.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 8/s 7/s 222 KiB/s 154 KiB/s 1.02 ms 163.23 us 2024-03-25T09:25:14.802 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 8/s 6/s 198 KiB/s 166 KiB/s 1.02 ms 162.68 us 2024-03-25T09:25:14.803 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 8/s 9/s 223 KiB/s 202 KiB/s 994.20 us 155.39 us 2024-03-25T09:25:14.803 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 8/s 7/s 197 KiB/s 198 KiB/s 948.87 us 165.21 us 2024-03-25T09:25:14.803 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 8/s 7/s 217 KiB/s 166 KiB/s 1.01 ms 165.22 us 2024-03-25T09:25:14.803 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 8/s 9/s 218 KiB/s 238 KiB/s 1.00 ms 173.36 us 2024-03-25T09:25:14.803 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 8/s 8/s 169 KiB/s 214 KiB/s 980.72 us 155.27 us 2024-03-25T09:25:14.803 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 8/s 7/s 193 KiB/s 204 KiB/s 998.99 us 152.30 us 2024-03-25T09:25:14.803 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 8/s 7/s 234 KiB/s 179 KiB/s 973.35 us 157.39 us 2024-03-25T09:25:14.803 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 8/s 8/s 219 KiB/s 230 KiB/s 1.00 ms 158.88 us 2024-03-25T09:25:14.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 8/s 7/s 236 KiB/s 155 KiB/s 979.34 us 160.45 us 2024-03-25T09:25:14.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 7/s 8/s 210 KiB/s 213 KiB/s 999.51 us 166.73 us 2024-03-25T09:25:14.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 7/s 7/s 193 KiB/s 162 KiB/s 1.01 ms 159.21 us 2024-03-25T09:25:14.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 7/s 8/s 204 KiB/s 236 KiB/s 960.18 us 163.77 us 2024-03-25T09:25:14.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 7/s 9/s 161 KiB/s 241 KiB/s 948.06 us 166.11 us 2024-03-25T09:25:14.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 7/s 6/s 207 KiB/s 156 KiB/s 1.01 ms 158.46 us 2024-03-25T09:25:14.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 7/s 7/s 198 KiB/s 161 KiB/s 990.32 us 164.75 us 2024-03-25T09:25:14.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 7/s 9/s 214 KiB/s 234 KiB/s 980.18 us 164.15 us 2024-03-25T09:25:14.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 7/s 8/s 190 KiB/s 207 KiB/s 959.46 us 173.48 us 2024-03-25T09:25:14.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 7/s 8/s 208 KiB/s 177 KiB/s 1.03 ms 160.30 us 2024-03-25T09:25:14.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 7/s 8/s 172 KiB/s 186 KiB/s 992.36 us 159.16 us 2024-03-25T09:25:14.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 7/s 8/s 199 KiB/s 183 KiB/s 999.34 us 163.69 us 2024-03-25T09:25:14.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 7/s 8/s 173 KiB/s 206 KiB/s 1.01 ms 158.14 us 2024-03-25T09:25:14.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 7/s 8/s 193 KiB/s 221 KiB/s 1.01 ms 166.70 us 2024-03-25T09:25:14.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 9/s 192 KiB/s 206 KiB/s 1.02 ms 161.92 us 2024-03-25T09:25:14.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 6/s 6/s 147 KiB/s 144 KiB/s 1.00 ms 162.54 us 2024-03-25T09:25:14.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 7/s 183 KiB/s 226 KiB/s 1.03 ms 162.20 us 2024-03-25T09:25:14.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 8/s 178 KiB/s 179 KiB/s 993.24 us 165.25 us 2024-03-25T09:25:14.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 6/s 6/s 162 KiB/s 207 KiB/s 994.92 us 168.12 us 2024-03-25T09:25:14.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 8/s 183 KiB/s 169 KiB/s 994.15 us 163.82 us 2024-03-25T09:25:14.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 9/s 152 KiB/s 204 KiB/s 981.62 us 155.64 us 2024-03-25T09:25:14.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 9/s 182 KiB/s 205 KiB/s 1.02 ms 160.21 us 2024-03-25T09:25:14.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 8/s 175 KiB/s 184 KiB/s 964.51 us 162.99 us 2024-03-25T09:25:14.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 8/s 208 KiB/s 201 KiB/s 976.26 us 165.66 us 2024-03-25T09:25:14.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 9/s 162 KiB/s 207 KiB/s 1.01 ms 163.08 us 2024-03-25T09:25:14.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 10/s 195 KiB/s 220 KiB/s 973.47 us 160.50 us 2024-03-25T09:25:14.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 9/s 172 KiB/s 235 KiB/s 993.10 us 155.05 us 2024-03-25T09:25:14.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 8/s 162 KiB/s 234 KiB/s 1.02 ms 165.29 us 2024-03-25T09:25:14.806 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:15.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:15.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:15.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:15.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:15 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:15.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:15 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:15.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:15 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:15.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:15 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:15.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:15 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:15.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:15 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:15.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:15 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:15 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:15 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:15 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:15 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:15 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:15 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:15.513 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:15 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:15.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:15 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:15.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:15 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:15 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:15 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:15 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:15 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:15 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:16.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:16.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:16.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:16 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 228 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:16 smithi059 ceph-mon[32732]: pgmap v463: 33 pgs: 33 active+clean; 999 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-03-25T09:25:16.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:16.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:16.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:15 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:16.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:16 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 228 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:16.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:16 smithi019 ceph-mon[29386]: pgmap v463: 33 pgs: 33 active+clean; 999 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-03-25T09:25:16.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:16 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 228 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:16.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:16 smithi040 ceph-mon[33094]: pgmap v463: 33 pgs: 33 active+clean; 999 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-03-25T09:25:17.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:17.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:17.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:18.078 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:18.078 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:18.078 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:18.078 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:17.788+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:18.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:18.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:18.079 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:18.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:18 smithi019 ceph-mon[29386]: pgmap v464: 33 pgs: 33 active+clean; 1001 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 920 op/s 2024-03-25T09:25:18.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:18 smithi059 ceph-mon[32732]: pgmap v464: 33 pgs: 33 active+clean; 1001 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 920 op/s 2024-03-25T09:25:18.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:18 smithi040 ceph-mon[33094]: pgmap v464: 33 pgs: 33 active+clean; 1001 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 920 op/s 2024-03-25T09:25:19.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:19.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:19.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:19.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:25:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 202.0k 177.2k 0.0k 2.0M 1.7M 0.0k nvme2n1 2024-03-25T09:25:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 162.4k 197.6k 0.0k 1.6M 1.9M 0.0k nvme2n10 2024-03-25T09:25:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 235.2k 113.2k 0.0k 2.3M 1.1M 0.0k nvme2n11 2024-03-25T09:25:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 185.2k 188.8k 0.0k 1.8M 1.8M 0.0k nvme2n12 2024-03-25T09:25:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 189.2k 174.0k 0.0k 1.8M 1.7M 0.0k nvme2n13 2024-03-25T09:25:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 233.2k 151.2k 0.0k 2.3M 1.5M 0.0k nvme2n14 2024-03-25T09:25:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 166.0k 186.4k 0.0k 1.6M 1.8M 0.0k nvme2n15 2024-03-25T09:25:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 171.6k 172.4k 0.0k 1.7M 1.7M 0.0k nvme2n16 2024-03-25T09:25:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 201.2k 162.4k 0.0k 2.0M 1.6M 0.0k nvme2n17 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 206.0k 175.6k 0.0k 2.0M 1.7M 0.0k nvme2n18 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 176.0k 146.4k 0.0k 1.7M 1.4M 0.0k nvme2n19 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 242.0k 184.4k 0.0k 2.4M 1.8M 0.0k nvme2n2 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 202.0k 171.2k 0.0k 2.0M 1.7M 0.0k nvme2n20 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 163.6k 175.6k 0.0k 1.6M 1.7M 0.0k nvme2n3 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 174.0k 197.6k 0.0k 1.7M 1.9M 0.0k nvme2n4 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 200.4k 176.0k 0.0k 2.0M 1.7M 0.0k nvme2n5 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 211.2k 168.4k 0.0k 2.1M 1.6M 0.0k nvme2n6 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 154.4k 210.8k 0.0k 1.5M 2.1M 0.0k nvme2n7 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 218.4k 197.6k 0.0k 2.1M 1.9M 0.0k nvme2n8 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 216.4k 182.4k 0.0k 2.1M 1.8M 0.0k nvme2n9 2024-03-25T09:25:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 186.8k 200.8k 0.0k 1.8M 2.0M 0.0k nvme5n1 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 164.0k 216.0k 0.0k 1.6M 2.1M 0.0k nvme5n10 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 176.8k 202.4k 0.0k 1.7M 2.0M 0.0k nvme5n11 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 156.4k 182.8k 0.0k 1.5M 1.8M 0.0k nvme5n12 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 156.0k 217.6k 0.0k 1.5M 2.1M 0.0k nvme5n13 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 177.2k 196.0k 0.0k 1.7M 1.9M 0.0k nvme5n14 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 184.4k 211.6k 0.0k 1.8M 2.1M 0.0k nvme5n15 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 171.2k 209.2k 0.0k 1.7M 2.0M 0.0k nvme5n16 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 217.6k 180.0k 0.0k 2.1M 1.8M 0.0k nvme5n17 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 183.2k 185.6k 0.0k 1.8M 1.8M 0.0k nvme5n18 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 184.4k 201.2k 0.0k 1.8M 2.0M 0.0k nvme5n19 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 162.4k 220.4k 0.0k 1.6M 2.2M 0.0k nvme5n2 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 184.8k 189.6k 0.0k 1.8M 1.9M 0.0k nvme5n20 2024-03-25T09:25:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 207.6k 202.0k 0.0k 2.0M 2.0M 0.0k nvme5n3 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 197.2k 142.8k 0.0k 1.9M 1.4M 0.0k nvme5n4 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 180.4k 198.8k 0.0k 1.8M 1.9M 0.0k nvme5n5 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 169.2k 214.4k 0.0k 1.7M 2.1M 0.0k nvme5n6 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 155.6k 191.2k 0.0k 1.5M 1.9M 0.0k nvme5n7 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 179.6k 192.4k 0.0k 1.8M 1.9M 0.0k nvme5n8 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 169.2k 227.2k 0.0k 1.7M 2.2M 0.0k nvme5n9 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 197.2k 140.0k 0.0k 1.9M 1.4M 0.0k nvme8n1 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 200.4k 196.8k 0.0k 2.0M 1.9M 0.0k nvme8n10 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 157.2k 229.6k 0.0k 1.5M 2.2M 0.0k nvme8n11 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 176.8k 213.2k 0.0k 1.7M 2.1M 0.0k nvme8n12 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 194.8k 182.8k 0.0k 1.9M 1.8M 0.0k nvme8n13 2024-03-25T09:25:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 175.2k 182.0k 0.0k 1.7M 1.8M 0.0k nvme8n14 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 180.4k 196.8k 0.0k 1.8M 1.9M 0.0k nvme8n15 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 214.8k 178.0k 0.0k 2.1M 1.7M 0.0k nvme8n16 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 208.4k 178.4k 0.0k 2.0M 1.7M 0.0k nvme8n17 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 188.0k 173.2k 0.0k 1.8M 1.7M 0.0k nvme8n18 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 192.8k 168.0k 0.0k 1.9M 1.6M 0.0k nvme8n19 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 183.2k 218.8k 0.0k 1.8M 2.1M 0.0k nvme8n2 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.40 156.8k 189.6k 0.0k 1.5M 1.9M 0.0k nvme8n20 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 188.4k 188.8k 0.0k 1.8M 1.8M 0.0k nvme8n3 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 162.4k 219.2k 0.0k 1.6M 2.1M 0.0k nvme8n4 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 211.6k 180.8k 0.0k 2.1M 1.8M 0.0k nvme8n5 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 170.0k 186.8k 0.0k 1.7M 1.8M 0.0k nvme8n6 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 206.4k 197.2k 0.0k 2.0M 1.9M 0.0k nvme8n7 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 214.0k 168.4k 0.0k 2.1M 1.6M 0.0k nvme8n8 2024-03-25T09:25:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 15.50 192.0k 183.2k 0.0k 1.9M 1.8M 0.0k nvme8n9 2024-03-25T09:25:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:19.804 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:19.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 9/s 7/s 229 KiB/s 133 KiB/s 1.03 ms 161.03 us 2024-03-25T09:25:19.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 9/s 8/s 208 KiB/s 173 KiB/s 1.02 ms 154.45 us 2024-03-25T09:25:19.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 9/s 6/s 253 KiB/s 132 KiB/s 1.04 ms 157.53 us 2024-03-25T09:25:19.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 9/s 6/s 262 KiB/s 107 KiB/s 1.03 ms 157.63 us 2024-03-25T09:25:19.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 9/s 8/s 261 KiB/s 193 KiB/s 994.27 us 166.32 us 2024-03-25T09:25:19.804 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 9/s 6/s 198 KiB/s 110 KiB/s 1.02 ms 159.07 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 8/s 7/s 254 KiB/s 158 KiB/s 1.04 ms 162.58 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 8/s 8/s 228 KiB/s 168 KiB/s 1.05 ms 166.56 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 8/s 5/s 172 KiB/s 147 KiB/s 1.04 ms 167.70 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 8/s 6/s 194 KiB/s 142 KiB/s 1.06 ms 164.62 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 8/s 6/s 202 KiB/s 140 KiB/s 1.04 ms 175.51 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 8/s 7/s 195 KiB/s 168 KiB/s 1.03 ms 152.99 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 8/s 7/s 197 KiB/s 188 KiB/s 1.04 ms 165.40 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 8/s 7/s 188 KiB/s 201 KiB/s 1.02 ms 175.23 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 8/s 7/s 173 KiB/s 136 KiB/s 1.03 ms 174.20 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 8/s 7/s 201 KiB/s 158 KiB/s 1.03 ms 161.36 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 8/s 7/s 232 KiB/s 158 KiB/s 997.56 us 164.04 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 8/s 7/s 210 KiB/s 170 KiB/s 1.03 ms 156.57 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 8/s 7/s 213 KiB/s 183 KiB/s 1.02 ms 170.70 us 2024-03-25T09:25:19.805 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 8/s 9/s 198 KiB/s 250 KiB/s 1.06 ms 160.19 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 8/s 8/s 178 KiB/s 185 KiB/s 1.10 ms 168.02 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 8/s 7/s 229 KiB/s 122 KiB/s 1.06 ms 163.88 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 8/s 6/s 181 KiB/s 168 KiB/s 1.00 ms 171.85 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 8/s 7/s 216 KiB/s 168 KiB/s 1.03 ms 156.27 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 8/s 7/s 175 KiB/s 138 KiB/s 1.15 ms 158.06 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 8/s 5/s 195 KiB/s 123 KiB/s 1.03 ms 160.67 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 7/s 7/s 216 KiB/s 152 KiB/s 1.06 ms 176.10 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 7/s 154 KiB/s 177 KiB/s 1.01 ms 162.56 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 7/s 9/s 148 KiB/s 235 KiB/s 998.26 us 160.85 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 7/s 7/s 177 KiB/s 172 KiB/s 1.03 ms 157.92 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 7/s 9/s 202 KiB/s 195 KiB/s 1.03 ms 166.96 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 7/s 7/s 198 KiB/s 150 KiB/s 1.05 ms 167.13 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 7/s 7/s 202 KiB/s 166 KiB/s 1.05 ms 165.26 us 2024-03-25T09:25:19.806 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 7/s 8/s 177 KiB/s 214 KiB/s 1.06 ms 166.04 us 2024-03-25T09:25:19.807 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 7/s 9/s 174 KiB/s 191 KiB/s 1.01 ms 165.89 us 2024-03-25T09:25:19.807 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 7/s 8/s 189 KiB/s 222 KiB/s 1.03 ms 170.33 us 2024-03-25T09:25:19.807 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 7/s 9/s 194 KiB/s 198 KiB/s 999.00 us 156.38 us 2024-03-25T09:25:19.807 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 7/s 8/s 167 KiB/s 192 KiB/s 1.02 ms 165.45 us 2024-03-25T09:25:19.807 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 6/s 166 KiB/s 157 KiB/s 1.05 ms 159.43 us 2024-03-25T09:25:19.807 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 7/s 7/s 167 KiB/s 182 KiB/s 1.05 ms 167.20 us 2024-03-25T09:25:19.807 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 7/s 9/s 199 KiB/s 219 KiB/s 1.02 ms 168.60 us 2024-03-25T09:25:19.807 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 7/s 6/s 194 KiB/s 136 KiB/s 1.01 ms 173.43 us 2024-03-25T09:25:19.807 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 7/s 7/s 166 KiB/s 205 KiB/s 1.00 ms 166.75 us 2024-03-25T09:25:19.807 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 7/s 8/s 150 KiB/s 239 KiB/s 992.64 us 161.07 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 7/s 8/s 141 KiB/s 190 KiB/s 1.01 ms 163.38 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 7/s 7/s 179 KiB/s 161 KiB/s 1.09 ms 166.80 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 7/s 7/s 202 KiB/s 188 KiB/s 1.05 ms 163.97 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 7/s 7/s 171 KiB/s 163 KiB/s 1.01 ms 158.58 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 7/s 8/s 161 KiB/s 198 KiB/s 1.00 ms 171.53 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 9/s 144 KiB/s 222 KiB/s 1.04 ms 162.60 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 9/s 109 KiB/s 244 KiB/s 1.03 ms 170.33 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 9/s 159 KiB/s 194 KiB/s 1.04 ms 162.89 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 8/s 165 KiB/s 198 KiB/s 1.06 ms 166.47 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 7/s 154 KiB/s 146 KiB/s 1.00 ms 169.04 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 8/s 114 KiB/s 195 KiB/s 1.01 ms 173.75 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 8/s 177 KiB/s 169 KiB/s 1.03 ms 164.01 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 9/s 170 KiB/s 172 KiB/s 1.03 ms 163.12 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 8/s 133 KiB/s 182 KiB/s 1.04 ms 166.49 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 8/s 157 KiB/s 231 KiB/s 1.04 ms 168.07 us 2024-03-25T09:25:19.808 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 9/s 121 KiB/s 186 KiB/s 992.32 us 164.65 us 2024-03-25T09:25:19.809 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:20.079 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:20.079 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:20.079 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:20.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:20 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:20.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:20 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:20.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:20 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:20.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:20 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:20.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:20 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:20.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:20 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:20.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:20 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:20.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:20 smithi059 ceph-mon[32732]: pgmap v465: 33 pgs: 33 active+clean; 1004 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 902 op/s 2024-03-25T09:25:20.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:20.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:20.263 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:19 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:20.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:20 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:20.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:20 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:20 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:20 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:20 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:20 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:20 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:20 smithi019 ceph-mon[29386]: pgmap v465: 33 pgs: 33 active+clean; 1004 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 902 op/s 2024-03-25T09:25:20.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:20.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:20.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:20.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:20.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:20.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:20.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:20.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-mon[33094]: pgmap v465: 33 pgs: 33 active+clean; 1004 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 902 op/s 2024-03-25T09:25:21.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:21.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:21.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:21.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:21 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 238 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:21 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 238 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:21 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 238 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:22.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:22.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:22.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:22 smithi059 ceph-mon[32732]: pgmap v466: 33 pgs: 33 active+clean; 1007 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-03-25T09:25:22.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:22.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:22.262 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:21 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:22 smithi019 ceph-mon[29386]: pgmap v466: 33 pgs: 33 active+clean; 1007 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-03-25T09:25:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:22 smithi040 ceph-mon[33094]: pgmap v466: 33 pgs: 33 active+clean; 1007 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-03-25T09:25:23.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:23.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:23.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:22.788+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 8 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:24.220 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:24 smithi059 ceph-mon[32732]: pgmap v467: 33 pgs: 33 active+clean; 1009 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.2 MiB/s rd, 10 MiB/s wr, 862 op/s 2024-03-25T09:25:24.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:24.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: [25-Mar-2024 09:25:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': '035b 2024-03-25T09:25:24.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:23 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c[53147]: 3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.59', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:24.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:24 smithi059 bash[55463]: time="2024-03-25T09:25:24Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c in 10 seconds, resorting to SIGKILL" 2024-03-25T09:25:24.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:24 smithi059 podman[55463]: 2024-03-25 09:25:24.219872639 +0000 UTC m=+10.146229050 container died bb39a9701952b53e76004c16871c5e2a3b57223264b6070b9611d975240a4318 (image=quay.io/ceph/nvmeof:1.1.0, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c, io.spdk.build.pkgdep-args=--rbd, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.wants=ceph,rbd, io.ceph.nvmeof=None, io.spdk.build.makeflags=, com.redhat.component=ubi9-container, vcs-type=git, distribution-scope=public, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.29.0, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, build-date=2024-03-13 14:41:08 UTC, summary=Ceph NVMe over Fabrics Gateway, org.centos.version=9.0-21.el9, io.ceph.git.branch=tags/1.1.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.maintainer=Ceph Developers , vcs-ref=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.ceph.git.commit=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.spdk.build.ceph-release=18.2.2, maintainer=Ceph Developers , io.ceph.version=1.1.0, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, release=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.version=23.01.1, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.ceph.component=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.branch=ceph-nvmeof, version=1.1.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, architecture=x86_64, io.spdk.build.target-arch=, io.spdk.git.commit=6769b6f51c9508981243042396ec2b2f097a5745) 2024-03-25T09:25:24.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:24 smithi019 ceph-mon[29386]: pgmap v467: 33 pgs: 33 active+clean; 1009 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.2 MiB/s rd, 10 MiB/s wr, 862 op/s 2024-03-25T09:25:24.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:24 smithi040 ceph-mon[33094]: pgmap v467: 33 pgs: 33 active+clean; 1009 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.2 MiB/s rd, 10 MiB/s wr, 862 op/s 2024-03-25T09:25:24.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:24 smithi059 podman[55463]: 2024-03-25 09:25:24.653005967 +0000 UTC m=+10.579362422 container cleanup bb39a9701952b53e76004c16871c5e2a3b57223264b6070b9611d975240a4318 (image=quay.io/ceph/nvmeof:1.1.0, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c, maintainer=Ceph Developers , io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, release=, summary=Ceph NVMe over Fabrics Gateway, vcs-ref=635ba2fc3c4eeee93025a0994decacf48590f9f1, vendor=Red Hat, Inc., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.pkgdep-args=--rbd, io.ceph.version=1.1.0, io.spdk.build.ceph-release=18.2.2, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, version=1.1.0, io.ceph.nvmeof=None, io.spdk.git.commit=6769b6f51c9508981243042396ec2b2f097a5745, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.makeflags=, io.spdk.build.target-arch=, org.centos.version=9.0-21.el9, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-type=git, io.openshift.wants=ceph,rbd, url=https://github.com/ceph/ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.ceph.git.branch=tags/1.1.0, io.spdk.git.branch=ceph-nvmeof, distribution-scope=public, com.redhat.component=ubi9-container, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.version=23.01.1, io.ceph.component=ceph-nvmeof, build-date=2024-03-13 14:41:08 UTC, name=ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.29.0, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.maintainer=Ceph Developers ) 2024-03-25T09:25:24.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:24 smithi059 bash[55463]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c 2024-03-25T09:25:24.810 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:24.810 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 10/s 7/s 257 KiB/s 169 KiB/s 1.09 ms 156.98 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 9/s 5/s 229 KiB/s 103 KiB/s 1.01 ms 148.16 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 9/s 6/s 257 KiB/s 110 KiB/s 1.02 ms 158.69 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 9/s 7/s 172 KiB/s 144 KiB/s 1.02 ms 171.96 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 9/s 6/s 224 KiB/s 137 KiB/s 1.03 ms 151.40 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 9/s 6/s 217 KiB/s 138 KiB/s 1.03 ms 166.61 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 8/s 7/s 202 KiB/s 142 KiB/s 1.05 ms 172.01 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 8/s 6/s 178 KiB/s 129 KiB/s 1.01 ms 163.89 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 8/s 6/s 205 KiB/s 133 KiB/s 1.06 ms 161.80 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 8/s 7/s 220 KiB/s 160 KiB/s 1.07 ms 160.18 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 8/s 6/s 228 KiB/s 162 KiB/s 1.03 ms 175.55 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 8/s 5/s 219 KiB/s 116 KiB/s 1.08 ms 164.49 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 8/s 7/s 235 KiB/s 186 KiB/s 1.03 ms 159.57 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 8/s 7/s 171 KiB/s 158 KiB/s 1.04 ms 160.30 us 2024-03-25T09:25:24.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 8/s 7/s 169 KiB/s 147 KiB/s 1.03 ms 159.01 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 8/s 7/s 161 KiB/s 195 KiB/s 1.01 ms 173.50 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 8/s 6/s 194 KiB/s 138 KiB/s 1.06 ms 153.19 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 8/s 7/s 146 KiB/s 160 KiB/s 1.03 ms 166.81 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 8/s 8/s 180 KiB/s 150 KiB/s 1.04 ms 163.60 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 8/s 6/s 169 KiB/s 103 KiB/s 1.09 ms 155.77 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 8/s 8/s 194 KiB/s 175 KiB/s 1.10 ms 169.19 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 8/s 8/s 166 KiB/s 143 KiB/s 1.09 ms 159.76 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 8/s 7/s 174 KiB/s 161 KiB/s 1.06 ms 163.51 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 8/s 7/s 190 KiB/s 176 KiB/s 1.02 ms 168.48 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 8/s 7/s 200 KiB/s 152 KiB/s 1.07 ms 162.46 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 7/s 6/s 201 KiB/s 134 KiB/s 1.06 ms 167.17 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 7/s 7/s 165 KiB/s 144 KiB/s 1.01 ms 168.10 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 7/s 7/s 130 KiB/s 153 KiB/s 1.03 ms 161.13 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 7/s 182 KiB/s 158 KiB/s 1.03 ms 159.10 us 2024-03-25T09:25:24.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 7/s 9/s 201 KiB/s 153 KiB/s 1.07 ms 159.31 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 7/s 7/s 139 KiB/s 182 KiB/s 1.20 ms 166.18 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 8/s 172 KiB/s 202 KiB/s 1.06 ms 162.60 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 7/s 7/s 173 KiB/s 185 KiB/s 1.04 ms 165.67 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 7/s 7/s 160 KiB/s 142 KiB/s 1.04 ms 155.99 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 7/s 6/s 153 KiB/s 145 KiB/s 1.11 ms 158.37 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 7/s 8/s 161 KiB/s 198 KiB/s 1.03 ms 167.92 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 7/s 9/s 182 KiB/s 151 KiB/s 1.03 ms 165.57 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 7/s 9/s 153 KiB/s 246 KiB/s 1.05 ms 162.18 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 7/s 7/s 186 KiB/s 170 KiB/s 1.04 ms 160.16 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 7/s 7/s 175 KiB/s 213 KiB/s 1.06 ms 157.57 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 7/s 8/s 113 KiB/s 134 KiB/s 1.04 ms 164.54 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 7/s 8/s 158 KiB/s 157 KiB/s 1.08 ms 163.66 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 7/s 8/s 167 KiB/s 178 KiB/s 1.03 ms 164.52 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 7/s 8/s 181 KiB/s 180 KiB/s 1.03 ms 162.73 us 2024-03-25T09:25:24.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 7/s 8/s 140 KiB/s 190 KiB/s 1.05 ms 167.53 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 7/s 7/s 178 KiB/s 110 KiB/s 1.02 ms 159.91 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 7/s 176 KiB/s 172 KiB/s 1.00 ms 163.62 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 7/s 151 KiB/s 174 KiB/s 1.08 ms 165.57 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 10/s 167 KiB/s 226 KiB/s 1.02 ms 155.40 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 9/s 154 KiB/s 205 KiB/s 1.02 ms 168.49 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 8/s 133 KiB/s 186 KiB/s 1.06 ms 159.67 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 8/s 137 KiB/s 204 KiB/s 1.02 ms 173.10 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 9/s 190 KiB/s 158 KiB/s 1.06 ms 163.06 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 9/s 122 KiB/s 206 KiB/s 1.06 ms 162.19 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 7/s 138 KiB/s 165 KiB/s 1.04 ms 161.56 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 7/s 187 KiB/s 146 KiB/s 1.04 ms 164.32 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 9/s 126 KiB/s 208 KiB/s 1.06 ms 168.75 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 7/s 130 KiB/s 138 KiB/s 1.05 ms 165.69 us 2024-03-25T09:25:24.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 8/s 159 KiB/s 150 KiB/s 1.05 ms 161.41 us 2024-03-25T09:25:24.815 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 9/s 168 KiB/s 167 KiB/s 1.08 ms 166.21 us 2024-03-25T09:25:24.815 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:25.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:25.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:25.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:25.216 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:25 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:25.216 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:25 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:25.216 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:25 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:25.216 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:25 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:25.216 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:25 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:25.216 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:25 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:25.216 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:25 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:25.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:24 smithi059 podman[55493]: 2024-03-25 09:25:24.929595904 +0000 UTC m=+0.709088860 container remove bb39a9701952b53e76004c16871c5e2a3b57223264b6070b9611d975240a4318 (image=quay.io/ceph/nvmeof:1.1.0, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-c, io.spdk.build.ceph-release=18.2.2, io.ceph.git.commit=635ba2fc3c4eeee93025a0994decacf48590f9f1, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.component=ceph-nvmeof, io.ceph.nvmeof=None, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.summary=Ceph NVMe over Fabrics Gateway, build-date=2024-03-13 14:41:08 UTC, io.spdk.build.makeflags=, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , version=1.1.0, architecture=x86_64, io.spdk.git.branch=ceph-nvmeof, maintainer=Ceph Developers , release=, vcs-type=git, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=6769b6f51c9508981243042396ec2b2f097a5745, io.ceph.git.branch=tags/1.1.0, io.openshift.wants=ceph,rbd, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-ref=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.spdk.build.target-arch=, distribution-scope=public, name=ceph-nvmeof, org.centos.version=9.0-21.el9, io.ceph.version=1.1.0, io.spdk.version=23.01.1, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vendor=Red Hat, Inc., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0) 2024-03-25T09:25:25.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi059.stdout:Mar 25 09:25:24 smithi059 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.c.service: Main process exited, code=exited, status=137/n/a 2024-03-25T09:25:25.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.c.service' 2024-03-25T09:25:25.290 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:25:25.291 INFO:tasks.nvmeof.ceph.nvmeof.nvmeof.c:Stopped nvmeof.nvmeof.c 2024-03-25T09:25:25.291 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 9 secs before reviving 2024-03-25T09:25:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:25 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:25 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:25 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:25 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:25 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:25 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:25 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:25.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:25 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:25.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:25 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:25.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:25 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:25 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:25 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:25 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:25 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:26.084 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:26.084 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:26.084 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:26.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:26 smithi019 ceph-mon[29386]: pgmap v468: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 971 op/s 2024-03-25T09:25:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:26 smithi059 ceph-mon[32732]: pgmap v468: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 971 op/s 2024-03-25T09:25:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:26 smithi040 ceph-mon[33094]: pgmap v468: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 971 op/s 2024-03-25T09:25:27.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:27.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:27.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:27 smithi019 ceph-mon[29386]: Health check update: 8 slow ops, oldest one blocked for 243 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:27 smithi059 ceph-mon[32732]: Health check update: 8 slow ops, oldest one blocked for 243 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:27.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:27 smithi040 ceph-mon[33094]: Health check update: 8 slow ops, oldest one blocked for 243 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:28.089 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:28.089 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:28.089 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:28.091 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:27.789+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:28.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:28 smithi019 ceph-mon[29386]: pgmap v469: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.2 MiB/s wr, 817 op/s 2024-03-25T09:25:28.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:28 smithi059 ceph-mon[32732]: pgmap v469: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.2 MiB/s wr, 817 op/s 2024-03-25T09:25:28.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:28 smithi040 ceph-mon[33094]: pgmap v469: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.2 MiB/s wr, 817 op/s 2024-03-25T09:25:29.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:29.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:29.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:29.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:29.679 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:25:29.679 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 82.4k 66.8k 0.0k 824.0k 668.0k 0.0k nvme2n1 2024-03-25T09:25:29.679 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 76.0k 71.2k 0.0k 760.0k 712.0k 0.0k nvme2n10 2024-03-25T09:25:29.679 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 78.4k 81.2k 0.0k 784.0k 812.0k 0.0k nvme2n11 2024-03-25T09:25:29.679 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 86.8k 61.2k 0.0k 868.0k 612.0k 0.0k nvme2n12 2024-03-25T09:25:29.679 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 64.8k 63.6k 0.0k 648.0k 636.0k 0.0k nvme2n13 2024-03-25T09:25:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 65.2k 86.8k 0.0k 652.0k 868.0k 0.0k nvme2n14 2024-03-25T09:25:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 56.0k 94.8k 0.0k 560.0k 948.0k 0.0k nvme2n15 2024-03-25T09:25:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 70.0k 78.4k 0.0k 700.0k 784.0k 0.0k nvme2n16 2024-03-25T09:25:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 73.6k 82.0k 0.0k 736.0k 820.0k 0.0k nvme2n17 2024-03-25T09:25:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 74.8k 72.4k 0.0k 748.0k 724.0k 0.0k nvme2n18 2024-03-25T09:25:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 82.4k 86.0k 0.0k 824.0k 860.0k 0.0k nvme2n19 2024-03-25T09:25:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 94.8k 68.4k 0.0k 948.0k 684.0k 0.0k nvme2n2 2024-03-25T09:25:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 99.2k 84.0k 0.0k 992.0k 840.0k 0.0k nvme2n20 2024-03-25T09:25:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 88.8k 87.2k 0.0k 888.0k 872.0k 0.0k nvme2n3 2024-03-25T09:25:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 78.0k 100.8k 0.0k 780.0k 1008.0k 0.0k nvme2n4 2024-03-25T09:25:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 86.0k 69.6k 0.0k 860.0k 696.0k 0.0k nvme2n5 2024-03-25T09:25:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 88.8k 63.2k 0.0k 888.0k 632.0k 0.0k nvme2n6 2024-03-25T09:25:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 91.6k 78.8k 0.0k 916.0k 788.0k 0.0k nvme2n7 2024-03-25T09:25:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 62.4k 72.0k 0.0k 624.0k 720.0k 0.0k nvme2n8 2024-03-25T09:25:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 56.0k 78.4k 0.0k 560.0k 784.0k 0.0k nvme2n9 2024-03-25T09:25:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 67.2k 83.2k 0.0k 672.0k 832.0k 0.0k nvme5n1 2024-03-25T09:25:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 94.8k 57.6k 0.0k 948.0k 576.0k 0.0k nvme5n10 2024-03-25T09:25:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 69.2k 92.4k 0.0k 692.0k 924.0k 0.0k nvme5n11 2024-03-25T09:25:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 76.4k 82.0k 0.0k 764.0k 820.0k 0.0k nvme5n12 2024-03-25T09:25:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 72.4k 81.6k 0.0k 724.0k 816.0k 0.0k nvme5n13 2024-03-25T09:25:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 94.8k 76.0k 0.0k 948.0k 760.0k 0.0k nvme5n14 2024-03-25T09:25:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 64.0k 85.6k 0.0k 640.0k 856.0k 0.0k nvme5n15 2024-03-25T09:25:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 61.6k 110.4k 0.0k 616.0k 1.1M 0.0k nvme5n16 2024-03-25T09:25:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 65.2k 85.2k 0.0k 652.0k 852.0k 0.0k nvme5n17 2024-03-25T09:25:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 75.2k 79.6k 0.0k 752.0k 796.0k 0.0k nvme5n18 2024-03-25T09:25:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 61.2k 96.4k 0.0k 612.0k 964.0k 0.0k nvme5n19 2024-03-25T09:25:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 80.4k 73.6k 0.0k 804.0k 736.0k 0.0k nvme5n2 2024-03-25T09:25:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 82.0k 88.8k 0.0k 820.0k 888.0k 0.0k nvme5n20 2024-03-25T09:25:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 76.8k 57.6k 0.0k 768.0k 576.0k 0.0k nvme5n3 2024-03-25T09:25:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 63.6k 87.6k 0.0k 636.0k 876.0k 0.0k nvme5n4 2024-03-25T09:25:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 80.4k 87.2k 0.0k 804.0k 872.0k 0.0k nvme5n5 2024-03-25T09:25:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 83.2k 72.0k 0.0k 832.0k 720.0k 0.0k nvme5n6 2024-03-25T09:25:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 71.2k 90.4k 0.0k 712.0k 904.0k 0.0k nvme5n7 2024-03-25T09:25:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 69.6k 71.6k 0.0k 696.0k 716.0k 0.0k nvme5n8 2024-03-25T09:25:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 71.6k 73.2k 0.0k 716.0k 732.0k 0.0k nvme5n9 2024-03-25T09:25:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 69.2k 92.0k 0.0k 692.0k 920.0k 0.0k nvme8n1 2024-03-25T09:25:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 80.8k 88.4k 0.0k 808.0k 884.0k 0.0k nvme8n10 2024-03-25T09:25:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 98.4k 66.4k 0.0k 984.0k 664.0k 0.0k nvme8n11 2024-03-25T09:25:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 66.4k 88.8k 0.0k 664.0k 888.0k 0.0k nvme8n12 2024-03-25T09:25:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 75.6k 77.6k 0.0k 756.0k 776.0k 0.0k nvme8n13 2024-03-25T09:25:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 71.2k 103.6k 0.0k 712.0k 1.0M 0.0k nvme8n14 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 108.8k 60.4k 0.0k 1.1M 604.0k 0.0k nvme8n15 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 114.4k 60.0k 0.0k 1.1M 600.0k 0.0k nvme8n16 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 66.4k 81.6k 0.0k 664.0k 816.0k 0.0k nvme8n17 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 52.4k 92.0k 0.0k 524.0k 920.0k 0.0k nvme8n18 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 81.6k 81.2k 0.0k 816.0k 812.0k 0.0k nvme8n19 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 100.0k 63.6k 0.0k 1000.0k 636.0k 0.0k nvme8n2 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 81.2k 73.6k 0.0k 812.0k 736.0k 0.0k nvme8n20 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 75.6k 102.0k 0.0k 756.0k 1020.0k 0.0k nvme8n3 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 56.8k 77.2k 0.0k 568.0k 772.0k 0.0k nvme8n4 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.10 68.4k 68.0k 0.0k 684.0k 680.0k 0.0k nvme8n5 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 81.6k 76.4k 0.0k 816.0k 764.0k 0.0k nvme8n6 2024-03-25T09:25:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 62.8k 91.6k 0.0k 628.0k 916.0k 0.0k nvme8n7 2024-03-25T09:25:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 84.8k 72.8k 0.0k 848.0k 728.0k 0.0k nvme8n8 2024-03-25T09:25:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 7.00 84.8k 76.4k 0.0k 848.0k 764.0k 0.0k nvme8n9 2024-03-25T09:25:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:29.811 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:29.811 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 4/s 162 KiB/s 92 KiB/s 1.02 ms 158.70 us 2024-03-25T09:25:29.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 3/s 124 KiB/s 62 KiB/s 1.05 ms 155.87 us 2024-03-25T09:25:29.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 4/s 142 KiB/s 126 KiB/s 1.10 ms 151.16 us 2024-03-25T09:25:29.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 6/s 107 KiB/s 141 KiB/s 1.06 ms 159.91 us 2024-03-25T09:25:29.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 108 KiB/s 101 KiB/s 1.03 ms 158.16 us 2024-03-25T09:25:29.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 6/s 108 KiB/s 150 KiB/s 1.05 ms 155.95 us 2024-03-25T09:25:29.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 3/s 128 KiB/s 89 KiB/s 1.10 ms 151.79 us 2024-03-25T09:25:29.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 3/s 130 KiB/s 58 KiB/s 1.07 ms 177.96 us 2024-03-25T09:25:29.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 4/s 119 KiB/s 98 KiB/s 1.07 ms 158.21 us 2024-03-25T09:25:29.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 4/s 147 KiB/s 82 KiB/s 1.07 ms 166.07 us 2024-03-25T09:25:29.812 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 6/s 118 KiB/s 125 KiB/s 1.08 ms 151.68 us 2024-03-25T09:25:29.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 4/s 109 KiB/s 57 KiB/s 1.06 ms 163.86 us 2024-03-25T09:25:29.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 3/s 122 KiB/s 55 KiB/s 1.06 ms 156.07 us 2024-03-25T09:25:29.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 6/s 99 KiB/s 127 KiB/s 1.04 ms 157.34 us 2024-03-25T09:25:29.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 5/s 92 KiB/s 113 KiB/s 1.05 ms 157.82 us 2024-03-25T09:25:29.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 90 KiB/s 90 KiB/s 1.05 ms 152.59 us 2024-03-25T09:25:29.813 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 5/s 107 KiB/s 117 KiB/s 1.04 ms 164.29 us 2024-03-25T09:25:29.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 102 KiB/s 132 KiB/s 1.08 ms 164.24 us 2024-03-25T09:25:29.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 4/s 106 KiB/s 69 KiB/s 1.05 ms 155.56 us 2024-03-25T09:25:29.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 5/s 67 KiB/s 87 KiB/s 1.01 ms 151.96 us 2024-03-25T09:25:29.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 90 KiB/s 100 KiB/s 1.02 ms 155.34 us 2024-03-25T09:25:29.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 6/s 86 KiB/s 136 KiB/s 1.01 ms 154.20 us 2024-03-25T09:25:29.814 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 110 KiB/s 85 KiB/s 1.01 ms 148.38 us 2024-03-25T09:25:29.815 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 104 KiB/s 104 KiB/s 1.06 ms 169.69 us 2024-03-25T09:25:29.815 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 90 KiB/s 92 KiB/s 1.06 ms 164.85 us 2024-03-25T09:25:29.815 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 2/s 114 KiB/s 58 KiB/s 1.05 ms 166.26 us 2024-03-25T09:25:29.816 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 3/s 94 KiB/s 77 KiB/s 1.04 ms 160.34 us 2024-03-25T09:25:29.816 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 1/s 79 KiB/s 23 KiB/s 1.08 ms 164.69 us 2024-03-25T09:25:29.816 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 2/s 79 KiB/s 63 KiB/s 1.04 ms 164.37 us 2024-03-25T09:25:29.816 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 3/s 98 KiB/s 69 KiB/s 1.08 ms 159.16 us 2024-03-25T09:25:29.817 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 2/s 66 KiB/s 42 KiB/s 1.02 ms 162.45 us 2024-03-25T09:25:29.817 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 102 KiB/s 95 KiB/s 1.08 ms 163.51 us 2024-03-25T09:25:29.817 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 2/s 102 KiB/s 52 KiB/s 1.05 ms 149.76 us 2024-03-25T09:25:29.817 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 4/s 78 KiB/s 88 KiB/s 1.03 ms 177.53 us 2024-03-25T09:25:29.817 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 3/s 66 KiB/s 65 KiB/s 1.10 ms 177.93 us 2024-03-25T09:25:29.817 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 5/s 101 KiB/s 98 KiB/s 1.09 ms 165.87 us 2024-03-25T09:25:29.817 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 4/s 95 KiB/s 112 KiB/s 1.17 ms 163.36 us 2024-03-25T09:25:29.817 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 81 KiB/s 107 KiB/s 1.09 ms 166.06 us 2024-03-25T09:25:29.817 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 3/s 73 KiB/s 58 KiB/s 1.08 ms 164.79 us 2024-03-25T09:25:29.818 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 3/s 74 KiB/s 73 KiB/s 1.02 ms 165.90 us 2024-03-25T09:25:29.818 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 2/s 74 KiB/s 38 KiB/s 1.09 ms 142.69 us 2024-03-25T09:25:29.818 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 2/s 82 KiB/s 25 KiB/s 1.12 ms 155.05 us 2024-03-25T09:25:29.818 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 3/s 59 KiB/s 48 KiB/s 1.05 ms 172.49 us 2024-03-25T09:25:29.818 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 4/s 66 KiB/s 93 KiB/s 1.06 ms 151.90 us 2024-03-25T09:25:29.818 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 72 KiB/s 96 KiB/s 1.02 ms 160.33 us 2024-03-25T09:25:29.818 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 2/s 2/s 55 KiB/s 60 KiB/s 1.06 ms 152.97 us 2024-03-25T09:25:29.818 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 2/s 3/s 66 KiB/s 66 KiB/s 1.08 ms 172.62 us 2024-03-25T09:25:29.818 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 2/s 1/s 43 KiB/s 34 KiB/s 1.05 ms 155.39 us 2024-03-25T09:25:29.819 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 2/s 2/s 74 KiB/s 47 KiB/s 1.04 ms 155.76 us 2024-03-25T09:25:29.819 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 2/s 1/s 32 KiB/s 43 KiB/s 1.05 ms 156.60 us 2024-03-25T09:25:29.819 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 1/s 4/s 50 KiB/s 92 KiB/s 1.10 ms 160.42 us 2024-03-25T09:25:29.819 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 1/s 2/s 47 KiB/s 52 KiB/s 1.02 ms 154.12 us 2024-03-25T09:25:29.820 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 1/s 2/s 52 KiB/s 42 KiB/s 1.05 ms 166.06 us 2024-03-25T09:25:29.820 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 1/s 2/s 46 KiB/s 64 KiB/s 1.08 ms 167.59 us 2024-03-25T09:25:29.820 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 1/s 2/s 33 KiB/s 34 KiB/s 1.05 ms 167.74 us 2024-03-25T09:25:29.820 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 1/s 1/s 21 KiB/s 26 KiB/s 989.87 us 169.25 us 2024-03-25T09:25:29.820 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 1/s 2/s 27 KiB/s 51 KiB/s 1.03 ms 158.69 us 2024-03-25T09:25:29.820 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 1/s 1/s 26 KiB/s 38 KiB/s 1.09 ms 162.99 us 2024-03-25T09:25:29.820 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 1/s 1/s 28 KiB/s 16 KiB/s 1.06 ms 160.97 us 2024-03-25T09:25:29.821 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 0/s 1/s 8.8 KiB/s 22 KiB/s 620.56 us 173.22 us 2024-03-25T09:25:29.821 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:30.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:30 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:30.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:30 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:30.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:30 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:30.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:30 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:30.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:30 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:30.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:30 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:30.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:30 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:30.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:30 smithi019 ceph-mon[29386]: pgmap v470: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.7 MiB/s wr, 687 op/s 2024-03-25T09:25:30.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:30.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:30.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:30 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:30 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:30 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:30 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:30 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:30 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:30 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:30 smithi059 ceph-mon[32732]: pgmap v470: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.7 MiB/s wr, 687 op/s 2024-03-25T09:25:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:30.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:30.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:30.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-mon[33094]: pgmap v470: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.7 MiB/s wr, 687 op/s 2024-03-25T09:25:31.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:31.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:31.084 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:31 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:25:31.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:31 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:25:31.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:31 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-25T09:25:31.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:31 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-25T09:25:31.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:31 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:25:31.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:31 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:25:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:31 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:25:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:31 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:25:31.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:31 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-25T09:25:31.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:31 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-25T09:25:31.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:31 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:25:31.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:31 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:25:31.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:31 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:25:31.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:31 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-25T09:25:31.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:31 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-25T09:25:31.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:31 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-25T09:25:31.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:31 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:25:31.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:31 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:25:32.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:32 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi040 to 5697M 2024-03-25T09:25:32.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:25:32.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:25:32.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:32 smithi019 ceph-mon[29386]: pgmap v471: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.3 MiB/s wr, 573 op/s 2024-03-25T09:25:32.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:32.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:32.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:32.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:32 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi040 to 5697M 2024-03-25T09:25:32.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:25:32.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:25:32.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:32 smithi059 ceph-mon[32732]: pgmap v471: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.3 MiB/s wr, 573 op/s 2024-03-25T09:25:32.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:32 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi040 to 5697M 2024-03-25T09:25:32.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:25:32.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:25:32.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:32 smithi040 ceph-mon[33094]: pgmap v471: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.3 MiB/s wr, 573 op/s 2024-03-25T09:25:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:32.789+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:33.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:33.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:33.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:34.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:34 smithi019 ceph-mon[29386]: pgmap v472: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 348 op/s 2024-03-25T09:25:34.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:34.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:34.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:34.291 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.c 2024-03-25T09:25:34.292 DEBUG:teuthology.orchestra.run.smithi059:nvmeof.nvmeof.c> sudo journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.c.service 2024-03-25T09:25:34.295 ERROR:tasks.nvmeof.[nvmeof.thrasher]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_vallariag_ceph_fb51d73931124de2f09457eaa7f1219e2aeb2c0d/qa/tasks/nvmeof.py", line 206, in _run self.do_thrash() File "/home/teuthworker/src/github.com_vallariag_ceph_fb51d73931124de2f09457eaa7f1219e2aeb2c0d/qa/tasks/nvmeof.py", line 257, in do_thrash daemon.start() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/cephadmunit.py", line 139, in start self.remote.run(self.start_cmd) TypeError: run() takes 1 positional argument but 2 were given 2024-03-25T09:25:34.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:34 smithi059 ceph-mon[32732]: pgmap v472: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 348 op/s 2024-03-25T09:25:34.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:34 smithi040 ceph-mon[33094]: pgmap v472: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 348 op/s 2024-03-25T09:25:34.814 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:34.814 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:35.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:35.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:35.082 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:35.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:35 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:35 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:35 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:35 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:35 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:35 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:35.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:35 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:35.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:35 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:35.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:35 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:35.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:35 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:35.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:35 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:35.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:35 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:35.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:35 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:35.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:35 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:35.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:35 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:35.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:35 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:35.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:35 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:35.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:35 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:35.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:35 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:35.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:35 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:35.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:35 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:36 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 247 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:36 smithi019 ceph-mon[29386]: osdmap e60: 8 total, 8 up, 8 in 2024-03-25T09:25:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:36 smithi019 ceph-mon[29386]: pgmap v474: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 853 KiB/s rd, 949 KiB/s wr, 85 op/s 2024-03-25T09:25:36.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:36.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:36.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:36 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 247 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:36 smithi059 ceph-mon[32732]: osdmap e60: 8 total, 8 up, 8 in 2024-03-25T09:25:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:36 smithi059 ceph-mon[32732]: pgmap v474: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 853 KiB/s rd, 949 KiB/s wr, 85 op/s 2024-03-25T09:25:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:36 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 247 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:36 smithi040 ceph-mon[33094]: osdmap e60: 8 total, 8 up, 8 in 2024-03-25T09:25:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:36 smithi040 ceph-mon[33094]: pgmap v474: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 853 KiB/s rd, 949 KiB/s wr, 85 op/s 2024-03-25T09:25:37.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:37.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:37.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:38.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:38.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:765: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 1 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: OPTIMIZED 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 1 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: OPTIMIZED 2024-03-25T09:25:38.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 1 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: OPTIMIZED 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: ] 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode1' prefix='listener_nqn.2016-06.io.spdk:cnode1_client.nvmeof.nvmeof.a_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode1_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420'] 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode1_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode1', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode1' listener={'nqn': 'nqn.2016-06.io.spdk:cnode1', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=1 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:25:38.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode2' prefix='listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.a_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420'] 2024-03-25T09:25:38.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:25:38.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=1 2024-03-25T09:25:38.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:25:38.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:25:38.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode3' prefix='listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.a_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420'] 2024-03-25T09:25:38.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:25:38.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=1 2024-03-25T09:25:38.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:37] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:25:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:37.790+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:38.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:37 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:38.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:37 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:39.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:38 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:39.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:38 smithi040 ceph-mon[33094]: osdmap e61: 8 total, 8 up, 8 in 2024-03-25T09:25:39.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:38 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:39.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:38 smithi040 ceph-mon[33094]: pgmap v476: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 KiB/s rd, 0 op/s 2024-03-25T09:25:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:39.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:38 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:39.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:38 smithi059 ceph-mon[32732]: osdmap e61: 8 total, 8 up, 8 in 2024-03-25T09:25:39.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:38 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:39.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:38 smithi059 ceph-mon[32732]: pgmap v476: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 KiB/s rd, 0 op/s 2024-03-25T09:25:39.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:38 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:38 smithi019 ceph-mon[29386]: osdmap e61: 8 total, 8 up, 8 in 2024-03-25T09:25:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:38 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:39.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:38 smithi019 ceph-mon[29386]: pgmap v476: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 KiB/s rd, 0 op/s 2024-03-25T09:25:39.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:25:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n1 2024-03-25T09:25:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n10 2024-03-25T09:25:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n11 2024-03-25T09:25:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n12 2024-03-25T09:25:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n13 2024-03-25T09:25:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n14 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n15 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n16 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n17 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n18 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n19 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n2 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n20 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n3 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n4 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n5 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 1.2k 0.0k 0.0k 12.0k 0.0k 0.0k nvme2n6 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.8k 0.0k 0.0k 8.0k 0.0k nvme2n7 2024-03-25T09:25:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 2.0k 0.0k 0.0k 20.0k 0.0k 0.0k nvme2n8 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.4k 0.0k 0.0k 4.0k 0.0k 0.0k nvme2n9 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n1 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 5.2k 0.0k 0.0k 52.0k 0.0k nvme5n10 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n11 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n12 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n13 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n14 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n15 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n16 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n17 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n18 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n19 2024-03-25T09:25:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n2 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n20 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n3 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n4 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n5 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 3.6k 0.0k 0.0k 36.0k 0.0k 0.0k nvme5n6 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 3.6k 0.0k 0.0k 36.0k 0.0k 0.0k nvme5n7 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 4.8k 0.0k 0.0k 48.0k 0.0k 0.0k nvme5n8 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme5n9 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n1 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n10 2024-03-25T09:25:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n11 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n12 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n13 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n14 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n15 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n16 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n17 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n18 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n19 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n2 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n20 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n3 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n4 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 1.6k 0.0k 0.0k 16.0k 0.0k nvme8n5 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme8n6 2024-03-25T09:25:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme8n7 2024-03-25T09:25:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 3.2k 0.0k 0.0k 32.0k 0.0k nvme8n8 2024-03-25T09:25:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme8n9 2024-03-25T09:25:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:39.818 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:39.818 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:39 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:40.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:39 smithi019 ceph-mon[29386]: osdmap e62: 8 total, 8 up, 8 in 2024-03-25T09:25:40.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:39 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:39 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:40.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:39 smithi059 ceph-mon[32732]: osdmap e62: 8 total, 8 up, 8 in 2024-03-25T09:25:40.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:39 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:40.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:39 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:40.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:39 smithi040 ceph-mon[33094]: osdmap e62: 8 total, 8 up, 8 in 2024-03-25T09:25:40.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:39 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:40.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:765: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-25T09:25:40.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:25:40.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 1 2024-03-25T09:25:40.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: OPTIMIZED 2024-03-25T09:25:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:25:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-25T09:25:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:25:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 1 2024-03-25T09:25:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: OPTIMIZED 2024-03-25T09:25:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:25:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-25T09:25:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: states { 2024-03-25T09:25:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: grp_id: 1 2024-03-25T09:25:40.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: state: OPTIMIZED 2024-03-25T09:25:40.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: } 2024-03-25T09:25:40.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: ] 2024-03-25T09:25:40.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-25T09:25:40.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode1' prefix='listener_nqn.2016-06.io.spdk:cnode1_client.nvmeof.nvmeof.a_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode1_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420'] 2024-03-25T09:25:40.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode1_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode1', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:25:40.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode1' listener={'nqn': 'nqn.2016-06.io.spdk:cnode1', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=1 2024-03-25T09:25:40.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:25:40.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-25T09:25:40.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode2' prefix='listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.a_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420'] 2024-03-25T09:25:40.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode2_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:25:40.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=1 2024-03-25T09:25:40.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:25:40.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:1941: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-25T09:25:40.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:776: Iterate over nqn='nqn.2016-06.io.spdk:cnode3' prefix='listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.a_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420'] 2024-03-25T09:25:40.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:783: listener_key='listener_nqn.2016-06.io.spdk:cnode3_client.nvmeof.nvmeof.a_TCP_172.21.15.19_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-25T09:25:40.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:793: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'gateway_name': 'client.nvmeof.nvmeof.a', 'traddr': '172.21.15.19', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=1 2024-03-25T09:25:40.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:40] INFO grpc.py:805: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-25T09:25:41.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:41.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:41.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:41.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:41.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:41.166 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:41.166 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:41.166 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:41.166 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: osdmap e63: 8 total, 8 up, 8 in 2024-03-25T09:25:41.166 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:41.166 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 252 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:41.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:41.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:41.167 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:41.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:41.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:41.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:41.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:41.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:41.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:41.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:41.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: osdmap e63: 8 total, 8 up, 8 in 2024-03-25T09:25:41.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:41.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:40 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 252 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:41.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:41.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: osdmap e63: 8 total, 8 up, 8 in 2024-03-25T09:25:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:40 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 252 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:42.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:41 smithi019 ceph-mon[29386]: pgmap v479: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 215 B/s wr, 6 op/s 2024-03-25T09:25:42.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:41 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:42.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:41 smithi019 ceph-mon[29386]: osdmap e64: 8 total, 8 up, 8 in 2024-03-25T09:25:42.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:41 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:42.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:42.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:42.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:41 smithi059 ceph-mon[32732]: pgmap v479: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 215 B/s wr, 6 op/s 2024-03-25T09:25:42.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:41 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:42.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:41 smithi059 ceph-mon[32732]: osdmap e64: 8 total, 8 up, 8 in 2024-03-25T09:25:42.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:41 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:41 smithi040 ceph-mon[33094]: pgmap v479: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 215 B/s wr, 6 op/s 2024-03-25T09:25:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:41 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:41 smithi040 ceph-mon[33094]: osdmap e64: 8 total, 8 up, 8 in 2024-03-25T09:25:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:41 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:43.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:43 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:43.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:43 smithi040 ceph-mon[33094]: osdmap e65: 8 total, 8 up, 8 in 2024-03-25T09:25:43.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:43 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:43.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:43.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:43.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:43.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:42.790+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:43.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:42 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:43.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:42 smithi059 ceph-mon[32732]: osdmap e65: 8 total, 8 up, 8 in 2024-03-25T09:25:43.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:42 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:43.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:42 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:43.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:42 smithi019 ceph-mon[29386]: osdmap e65: 8 total, 8 up, 8 in 2024-03-25T09:25:43.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:42 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:44 smithi059 ceph-mon[32732]: pgmap v482: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 79 KiB/s rd, 37 KiB/s wr, 18 op/s 2024-03-25T09:25:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:44 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:44.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:44 smithi059 ceph-mon[32732]: osdmap e66: 8 total, 8 up, 8 in 2024-03-25T09:25:44.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:44 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:44 smithi040 ceph-mon[33094]: pgmap v482: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 79 KiB/s rd, 37 KiB/s wr, 18 op/s 2024-03-25T09:25:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:44 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:44 smithi040 ceph-mon[33094]: osdmap e66: 8 total, 8 up, 8 in 2024-03-25T09:25:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:44 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:44.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:44 smithi019 ceph-mon[29386]: pgmap v482: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 79 KiB/s rd, 37 KiB/s wr, 18 op/s 2024-03-25T09:25:44.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:44 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:44.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:44 smithi019 ceph-mon[29386]: osdmap e66: 8 total, 8 up, 8 in 2024-03-25T09:25:44.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:44 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:44.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:44.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:44.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:44.823 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:44.823 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 0/s 0/s 1.6 KiB/s 0 B/s 269.44 us 0.00 ns 2024-03-25T09:25:44.823 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 0/s 0/s 4 KiB/s 0 B/s 307.16 us 0.00 ns 2024-03-25T09:25:44.823 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 0/s 0/s 1.6 KiB/s 0 B/s 206.40 us 0.00 ns 2024-03-25T09:25:44.823 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 0/s 0/s 819 B/s 0 B/s 322.85 us 0.00 ns 2024-03-25T09:25:44.823 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 0/s 0/s 819 B/s 0 B/s 311.38 us 0.00 ns 2024-03-25T09:25:44.823 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 0/s 0/s 10 KiB/s 0 B/s 667.29 us 0.00 ns 2024-03-25T09:25:44.823 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 0/s 0/s 2.4 KiB/s 0 B/s 505.94 us 0.00 ns 2024-03-25T09:25:44.823 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 0/s 0/s 819 B/s 0 B/s 264.17 us 0.00 ns 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 0/s 0/s 6.4 KiB/s 0 B/s 347.96 us 0.00 ns 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 0/s 0/s 819 B/s 0 B/s 266.93 us 0.00 ns 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 0/s 0/s 819 B/s 0 B/s 261.47 us 0.00 ns 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 0/s 0/s 3.2 KiB/s 0 B/s 478.24 us 0.00 ns 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 0/s 0/s 0 B/s 819 B/s 0.00 ns 38.61 us 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 0/s 0/s 0 B/s 7.2 KiB/s 0.00 ns 27.52 us 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 0/s 0/s 0 B/s 9.6 KiB/s 0.00 ns 40.48 us 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 47.39 us 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 0/s 0/s 0 B/s 9.6 KiB/s 0.00 ns 27.64 us 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 0/s 0/s 0 B/s 5.6 KiB/s 0.00 ns 29.59 us 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 0/s 0/s 0 B/s 8 KiB/s 0.00 ns 36.75 us 2024-03-25T09:25:44.824 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 0/s 0/s 0 B/s 819 B/s 0.00 ns 36.33 us 2024-03-25T09:25:44.825 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 0/s 0/s 0 B/s 11 KiB/s 0.00 ns 28.48 us 2024-03-25T09:25:44.825 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 30.09 us 2024-03-25T09:25:44.825 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 26.01 us 2024-03-25T09:25:44.825 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 0/s 0/s 0 B/s 4 KiB/s 0.00 ns 31.09 us 2024-03-25T09:25:44.825 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 35.44 us 2024-03-25T09:25:44.825 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 0/s 0/s 0 B/s 7.2 KiB/s 0.00 ns 51.23 us 2024-03-25T09:25:44.825 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 35.38 us 2024-03-25T09:25:44.825 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 0/s 0/s 0 B/s 8.8 KiB/s 0.00 ns 36.02 us 2024-03-25T09:25:44.825 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 34.34 us 2024-03-25T09:25:44.825 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:45.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:45 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:45.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:45 smithi040 ceph-mon[33094]: osdmap e67: 8 total, 8 up, 8 in 2024-03-25T09:25:45.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:45 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:45.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:45.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:45.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:45.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:45 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:45.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:45 smithi019 ceph-mon[29386]: osdmap e67: 8 total, 8 up, 8 in 2024-03-25T09:25:45.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:45 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:45.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:45 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:45.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:45 smithi059 ceph-mon[32732]: osdmap e67: 8 total, 8 up, 8 in 2024-03-25T09:25:45.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:45 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:46.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: pgmap v485: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 71 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: osdmap e68: 8 total, 8 up, 8 in 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:46.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:46 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 257 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:46.312 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:46.312 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: pgmap v485: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 71 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: osdmap e68: 8 total, 8 up, 8 in 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:46 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 257 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: pgmap v485: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 71 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-03-25T09:25:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:46.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:46.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:46.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:46.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:46.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: osdmap e68: 8 total, 8 up, 8 in 2024-03-25T09:25:46.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:46.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 257 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:47.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:47 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:47.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:47 smithi040 ceph-mon[33094]: osdmap e69: 8 total, 8 up, 8 in 2024-03-25T09:25:47.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:47 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:47.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:47.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:47.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:47.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:47 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:47.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:47 smithi019 ceph-mon[29386]: osdmap e69: 8 total, 8 up, 8 in 2024-03-25T09:25:47.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:47 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:47.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:47 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:47.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:47 smithi059 ceph-mon[32732]: osdmap e69: 8 total, 8 up, 8 in 2024-03-25T09:25:47.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:47 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:48.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:47.790+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:48.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:48 smithi059 ceph-mon[32732]: pgmap v488: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 118 KiB/s rd, 32 KiB/s wr, 24 op/s 2024-03-25T09:25:48.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:48 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:48.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:48 smithi059 ceph-mon[32732]: osdmap e70: 8 total, 8 up, 8 in 2024-03-25T09:25:48.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:48 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:48.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:48 smithi019 ceph-mon[29386]: pgmap v488: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 118 KiB/s rd, 32 KiB/s wr, 24 op/s 2024-03-25T09:25:48.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:48 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:48.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:48 smithi019 ceph-mon[29386]: osdmap e70: 8 total, 8 up, 8 in 2024-03-25T09:25:48.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:48 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:48.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:48.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:48 smithi040 ceph-mon[33094]: pgmap v488: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 118 KiB/s rd, 32 KiB/s wr, 24 op/s 2024-03-25T09:25:48.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:48 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:48.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:48 smithi040 ceph-mon[33094]: osdmap e70: 8 total, 8 up, 8 in 2024-03-25T09:25:48.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:48 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:49.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:49 smithi040 ceph-mon[33094]: pgmap v490: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 107 KiB/s rd, 66 KiB/s wr, 26 op/s 2024-03-25T09:25:49.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:49 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:49.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:49 smithi040 ceph-mon[33094]: osdmap e71: 8 total, 8 up, 8 in 2024-03-25T09:25:49.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:49 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:49.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:49.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:49.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:49.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:49 smithi019 ceph-mon[29386]: pgmap v490: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 107 KiB/s rd, 66 KiB/s wr, 26 op/s 2024-03-25T09:25:49.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:49 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:49.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:49 smithi019 ceph-mon[29386]: osdmap e71: 8 total, 8 up, 8 in 2024-03-25T09:25:49.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:49 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:49.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:49 smithi059 ceph-mon[32732]: pgmap v490: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 107 KiB/s rd, 66 KiB/s wr, 26 op/s 2024-03-25T09:25:49.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:49 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:49.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:49 smithi059 ceph-mon[32732]: osdmap e71: 8 total, 8 up, 8 in 2024-03-25T09:25:49.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:49 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:49.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:49.679 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:25:49.679 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 3.6k 0.0k 0.0k 36.0k 0.0k nvme2n1 2024-03-25T09:25:49.679 INFO:tasks.workunit.client.3.smithi129.stdout: 0.20 2.0k 2.0k 0.0k 20.0k 20.0k 0.0k nvme2n10 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.20 0.8k 0.8k 0.0k 8.0k 8.0k 0.0k nvme2n11 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 3.6k 0.0k 0.0k 36.0k 0.0k nvme2n12 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.8k 0.0k 0.0k 8.0k 0.0k nvme2n13 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 3.6k 0.0k 0.0k 36.0k 0.0k 0.0k nvme2n14 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme2n15 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 3.2k 0.0k 0.0k 32.0k 0.0k 0.0k nvme2n16 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.8k 0.0k 0.0k 8.0k 0.0k 0.0k nvme2n17 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 2.8k 0.0k 0.0k 28.0k 0.0k nvme2n18 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 1.2k 0.0k 0.0k 12.0k 0.0k 0.0k nvme2n19 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.8k 0.0k 0.0k 8.0k 0.0k nvme2n2 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 2.4k 0.0k 0.0k 24.0k 0.0k nvme2n20 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 1.6k 0.0k 0.0k 16.0k 0.0k nvme2n3 2024-03-25T09:25:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 2.4k 0.0k 0.0k 24.0k 0.0k nvme2n4 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 1.6k 0.0k 0.0k 16.0k 0.0k 0.0k nvme2n5 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 1.6k 0.0k 0.0k 16.0k 0.0k nvme2n6 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme2n7 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 1.6k 0.0k 0.0k 16.0k 0.0k 0.0k nvme2n8 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 3.6k 0.0k 0.0k 36.0k 0.0k nvme2n9 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.4k 0.0k 0.0k 4.0k 0.0k 0.0k nvme5n1 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme5n10 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.20 1.2k 4.4k 0.0k 12.0k 44.0k 0.0k nvme5n11 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 1.2k 0.0k 0.0k 12.0k 0.0k 0.0k nvme5n12 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 4.8k 0.0k 0.0k 48.0k 0.0k 0.0k nvme5n13 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 2.8k 0.0k 0.0k 28.0k 0.0k 0.0k nvme5n14 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme5n15 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme5n16 2024-03-25T09:25:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.8k 0.0k 0.0k 8.0k 0.0k 0.0k nvme5n17 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 1.2k 0.0k 0.0k 12.0k 0.0k 0.0k nvme5n18 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme5n19 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 5.2k 0.0k 0.0k 52.0k 0.0k nvme5n2 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.8k 0.0k 0.0k 8.0k 0.0k nvme5n20 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 1.2k 0.0k 0.0k 12.0k 0.0k 0.0k nvme5n3 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 3.2k 0.0k 0.0k 32.0k 0.0k 0.0k nvme5n4 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 1.6k 0.0k 0.0k 16.0k 0.0k 0.0k nvme5n5 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 2.4k 0.0k 0.0k 24.0k 0.0k nvme5n6 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 4.0k 0.0k 0.0k 40.0k 0.0k 0.0k nvme5n7 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.8k 0.0k 0.0k 8.0k 0.0k nvme5n8 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 3.2k 0.0k 0.0k 32.0k 0.0k 0.0k nvme5n9 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 1.6k 0.0k 0.0k 16.0k 0.0k nvme8n1 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.20 5.2k 0.0k 0.0k 52.0k 0.0k 0.0k nvme8n10 2024-03-25T09:25:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 0.20 4.4k 0.4k 0.0k 44.0k 4.0k 0.0k nvme8n11 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.4k 0.0k 0.0k 4.0k 0.0k 0.0k nvme8n12 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 2.4k 0.0k 0.0k 24.0k 0.0k nvme8n13 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 3.2k 0.0k 0.0k 32.0k 0.0k 0.0k nvme8n14 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.8k 0.0k 0.0k 8.0k 0.0k 0.0k nvme8n15 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 1.6k 0.0k 0.0k 16.0k 0.0k nvme8n16 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 5.6k 0.0k 0.0k 56.0k 0.0k 0.0k nvme8n17 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme8n18 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 5.2k 0.0k 0.0k 52.0k 0.0k 0.0k nvme8n19 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme8n2 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 1.2k 0.0k 0.0k 12.0k 0.0k 0.0k nvme8n20 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.4k 0.0k 0.0k 4.0k 0.0k 0.0k nvme8n3 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.4k 0.0k 0.0k 4.0k 0.0k 0.0k nvme8n4 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 1.6k 0.0k 0.0k 16.0k 0.0k nvme8n5 2024-03-25T09:25:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 3.6k 0.0k 0.0k 36.0k 0.0k nvme8n6 2024-03-25T09:25:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme8n7 2024-03-25T09:25:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 2.4k 0.0k 0.0k 24.0k 0.0k 0.0k nvme8n8 2024-03-25T09:25:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme8n9 2024-03-25T09:25:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:49.826 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:49.826 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 0/s 0/s 1.6 KiB/s 0 B/s 241.56 us 0.00 ns 2024-03-25T09:25:49.826 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 0/s 0/s 3.2 KiB/s 0 B/s 266.39 us 0.00 ns 2024-03-25T09:25:49.826 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 0/s 0/s 4.8 KiB/s 0 B/s 505.84 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 0/s 0/s 7.2 KiB/s 0 B/s 262.00 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 0/s 0/s 7.2 KiB/s 0 B/s 337.90 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 0/s 0/s 5.6 KiB/s 0 B/s 562.82 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 0/s 0/s 10 KiB/s 0 B/s 287.47 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 0/s 0/s 4 KiB/s 0 B/s 278.95 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 0/s 0/s 819 B/s 0 B/s 346.03 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 0/s 0/s 1.6 KiB/s 0 B/s 347.27 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 0/s 0/s 7.2 KiB/s 0 B/s 304.48 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 0/s 0/s 4.8 KiB/s 0 B/s 344.50 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 0/s 0/s 3.2 KiB/s 0 B/s 277.05 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 0/s 0/s 2.4 KiB/s 0 B/s 278.57 us 0.00 ns 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 0/s 0/s 0 B/s 7.2 KiB/s 0.00 ns 31.06 us 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 48.86 us 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 0/s 0/s 0 B/s 819 B/s 0.00 ns 43.30 us 2024-03-25T09:25:49.827 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 0/s 0/s 0 B/s 8 KiB/s 0.00 ns 227.87 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 44.34 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 0/s 0/s 0 B/s 3.2 KiB/s 0.00 ns 27.56 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 0/s 0/s 0 B/s 6.4 KiB/s 0.00 ns 49.04 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 44.72 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 0/s 0/s 0 B/s 6.4 KiB/s 0.00 ns 42.69 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 60.34 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 39.29 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 0/s 0/s 0 B/s 819 B/s 0.00 ns 40.15 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 0/s 0/s 0 B/s 819 B/s 0.00 ns 32.41 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 0/s 0/s 0 B/s 6.4 KiB/s 0.00 ns 36.28 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 0/s 0/s 0 B/s 10 KiB/s 0.00 ns 53.81 us 2024-03-25T09:25:49.828 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:50.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:50 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:50.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:50 smithi019 ceph-mon[29386]: osdmap e72: 8 total, 8 up, 8 in 2024-03-25T09:25:50.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:50 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:50.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:50 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:50.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:50 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:50.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:50 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:50.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:50 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:50.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:50 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:50.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:50 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:50.311 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:50 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:50.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:50.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:50.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:50 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:50 smithi059 ceph-mon[32732]: osdmap e72: 8 total, 8 up, 8 in 2024-03-25T09:25:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:50 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:50 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:50 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:50 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:50 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:50.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:50 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:50.513 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:50 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:50.513 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:50 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-mon[33094]: osdmap e72: 8 total, 8 up, 8 in 2024-03-25T09:25:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:50.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:50.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:50.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:50.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:51 smithi040 ceph-mon[33094]: pgmap v493: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 73 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-03-25T09:25:51.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:51 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:51.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:51 smithi040 ceph-mon[33094]: osdmap e73: 8 total, 8 up, 8 in 2024-03-25T09:25:51.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:51 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:51.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:51 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 267 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:51.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:51.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:51.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:51.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:51 smithi019 ceph-mon[29386]: pgmap v493: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 73 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-03-25T09:25:51.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:51 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:51.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:51 smithi019 ceph-mon[29386]: osdmap e73: 8 total, 8 up, 8 in 2024-03-25T09:25:51.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:51 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:51.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:51 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 267 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:51 smithi059 ceph-mon[32732]: pgmap v493: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 73 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-03-25T09:25:51.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:51 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:51.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:51 smithi059 ceph-mon[32732]: osdmap e73: 8 total, 8 up, 8 in 2024-03-25T09:25:51.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:51 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:51.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:51 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 267 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:52.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:52 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:52.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:52 smithi019 ceph-mon[29386]: osdmap e74: 8 total, 8 up, 8 in 2024-03-25T09:25:52.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:52 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:52.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:52.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:52.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:52 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:52 smithi059 ceph-mon[32732]: osdmap e74: 8 total, 8 up, 8 in 2024-03-25T09:25:52.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:52 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:52 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:52 smithi040 ceph-mon[33094]: osdmap e74: 8 total, 8 up, 8 in 2024-03-25T09:25:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:52 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:53.067 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:52.791+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:53.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:53 smithi040 ceph-mon[33094]: pgmap v496: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 153 KiB/s rd, 93 KiB/s wr, 30 op/s 2024-03-25T09:25:53.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:53 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:53.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:53 smithi040 ceph-mon[33094]: osdmap e75: 8 total, 8 up, 8 in 2024-03-25T09:25:53.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:53 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:53.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:53.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:53.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:53.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:53 smithi019 ceph-mon[29386]: pgmap v496: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 153 KiB/s rd, 93 KiB/s wr, 30 op/s 2024-03-25T09:25:53.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:53 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:53.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:53 smithi019 ceph-mon[29386]: osdmap e75: 8 total, 8 up, 8 in 2024-03-25T09:25:53.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:53 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:53.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:53 smithi059 ceph-mon[32732]: pgmap v496: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 153 KiB/s rd, 93 KiB/s wr, 30 op/s 2024-03-25T09:25:53.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:53 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:53.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:53 smithi059 ceph-mon[32732]: osdmap e75: 8 total, 8 up, 8 in 2024-03-25T09:25:53.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:53 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:54.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:54 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:54.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:54 smithi019 ceph-mon[29386]: osdmap e76: 8 total, 8 up, 8 in 2024-03-25T09:25:54.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:54 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:54.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:54.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:54.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:54.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:54 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:54.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:54 smithi059 ceph-mon[32732]: osdmap e76: 8 total, 8 up, 8 in 2024-03-25T09:25:54.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:54 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:54.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:54 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:54.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:54 smithi040 ceph-mon[33094]: osdmap e76: 8 total, 8 up, 8 in 2024-03-25T09:25:54.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:54 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:54.830 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:54.830 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 0/s 0/s 4 KiB/s 0 B/s 267.54 us 0.00 ns 2024-03-25T09:25:54.830 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 0/s 0/s 7.2 KiB/s 0 B/s 311.20 us 0.00 ns 2024-03-25T09:25:54.830 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 0/s 0/s 3.2 KiB/s 0 B/s 316.22 us 0.00 ns 2024-03-25T09:25:54.830 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 0/s 0/s 1.6 KiB/s 0 B/s 281.99 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 0/s 0/s 8.8 KiB/s 0 B/s 240.88 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 0/s 0/s 1.6 KiB/s 10 KiB/s 314.92 us 48.74 us 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 0/s 0/s 819 B/s 0 B/s 295.29 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 0/s 0/s 2.4 KiB/s 0 B/s 307.84 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 0/s 0/s 8.8 KiB/s 0 B/s 259.27 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 0/s 0/s 3.2 KiB/s 0 B/s 339.79 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 0/s 0/s 4.8 KiB/s 0 B/s 297.07 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 0/s 0/s 3.2 KiB/s 0 B/s 292.29 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 0/s 0/s 8 KiB/s 4 KiB/s 275.24 us 41.51 us 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 0/s 0/s 1.6 KiB/s 0 B/s 210.80 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 0/s 0/s 819 B/s 0 B/s 266.72 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 0/s 0/s 1.6 KiB/s 0 B/s 249.75 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 0/s 0/s 8 KiB/s 0 B/s 242.50 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 0/s 0/s 3.2 KiB/s 0 B/s 305.70 us 0.00 ns 2024-03-25T09:25:54.831 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 0/s 0/s 1.6 KiB/s 0 B/s 263.71 us 0.00 ns 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 0/s 0/s 4.8 KiB/s 0 B/s 279.31 us 0.00 ns 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 0/s 0/s 4 KiB/s 0 B/s 411.41 us 0.00 ns 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 0/s 0/s 4 KiB/s 0 B/s 364.21 us 0.00 ns 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 0/s 0/s 819 B/s 0 B/s 226.83 us 0.00 ns 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 0/s 0/s 2.4 KiB/s 0 B/s 223.41 us 0.00 ns 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 0/s 0/s 819 B/s 0 B/s 513.04 us 0.00 ns 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 0/s 0/s 8 KiB/s 0 B/s 306.86 us 0.00 ns 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 0/s 0/s 3.2 KiB/s 0 B/s 281.08 us 0.00 ns 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 0/s 0/s 0 B/s 1 B/s 0.00 ns 31.29 us 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 0/s 0/s 0 B/s 3.2 KiB/s 0.00 ns 48.95 us 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 0/s 0/s 0 B/s 6.4 KiB/s 0.00 ns 48.46 us 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 0/s 0/s 0 B/s 819 B/s 0.00 ns 31.59 us 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 0/s 0/s 0 B/s 4.8 KiB/s 0.00 ns 79.82 us 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 0/s 0/s 0 B/s 12 KiB/s 0.00 ns 36.50 us 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 0/s 0/s 0 B/s 3.2 KiB/s 0.00 ns 42.39 us 2024-03-25T09:25:54.832 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 0/s 0/s 0 B/s 7.2 KiB/s 0.00 ns 30.41 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 0/s 0/s 0 B/s 6.4 KiB/s 0.00 ns 43.20 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 0/s 0/s 0 B/s 5.6 KiB/s 0.00 ns 28.62 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 0/s 0/s 0 B/s 6.4 KiB/s 0.00 ns 36.02 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 35.31 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 28.58 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 26.45 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 0/s 0/s 0 B/s 4.8 KiB/s 0.00 ns 30.50 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 0/s 0/s 0 B/s 6.4 KiB/s 0.00 ns 77.47 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 0/s 0/s 0 B/s 8.8 KiB/s 0.00 ns 37.95 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 0/s 0/s 0 B/s 4.8 KiB/s 0.00 ns 30.49 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 34.09 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 0/s 0/s 0 B/s 819 B/s 0.00 ns 33.58 us 2024-03-25T09:25:54.833 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: pgmap v499: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 110 KiB/s rd, 124 KiB/s wr, 31 op/s 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: osdmap e77: 8 total, 8 up, 8 in 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: { 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:25:55.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:55 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:25:55.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:55.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:55.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: pgmap v499: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 110 KiB/s rd, 124 KiB/s wr, 31 op/s 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: osdmap e77: 8 total, 8 up, 8 in 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: { 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:25:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:25:55.513 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: pgmap v499: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 110 KiB/s rd, 124 KiB/s wr, 31 op/s 2024-03-25T09:25:55.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:55.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: osdmap e77: 8 total, 8 up, 8 in 2024-03-25T09:25:55.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:55.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:25:55.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: { 2024-03-25T09:25:55.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:25:55.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:25:55.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:25:55.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:25:55.514 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:55 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:25:56.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:56 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:56.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:56 smithi019 ceph-mon[29386]: osdmap e78: 8 total, 8 up, 8 in 2024-03-25T09:25:56.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:56 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:56.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:56.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:56.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:56.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:56 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:56.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:56 smithi059 ceph-mon[32732]: osdmap e78: 8 total, 8 up, 8 in 2024-03-25T09:25:56.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:56 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:56 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:56 smithi040 ceph-mon[33094]: osdmap e78: 8 total, 8 up, 8 in 2024-03-25T09:25:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:56 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:57.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:57 smithi040 ceph-mon[33094]: pgmap v502: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 158 KiB/s rd, 119 KiB/s wr, 38 op/s 2024-03-25T09:25:57.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:57 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 272 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:57.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:57 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:57.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:57 smithi040 ceph-mon[33094]: osdmap e79: 8 total, 8 up, 8 in 2024-03-25T09:25:57.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:57 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:57.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:57.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:57.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:57 smithi019 ceph-mon[29386]: pgmap v502: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 158 KiB/s rd, 119 KiB/s wr, 38 op/s 2024-03-25T09:25:57.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:57 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 272 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:57.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:57 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:57.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:57 smithi019 ceph-mon[29386]: osdmap e79: 8 total, 8 up, 8 in 2024-03-25T09:25:57.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:57 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:57 smithi059 ceph-mon[32732]: pgmap v502: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 158 KiB/s rd, 119 KiB/s wr, 38 op/s 2024-03-25T09:25:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:57 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 272 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:25:57.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:57 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:57.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:57 smithi059 ceph-mon[32732]: osdmap e79: 8 total, 8 up, 8 in 2024-03-25T09:25:57.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:57 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"} : dispatch 2024-03-25T09:25:58.106 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:25:57.791+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:25:58.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:58 smithi019 ceph-mon[29386]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:58.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:58 smithi019 ceph-mon[29386]: osdmap e80: 8 total, 8 up, 8 in 2024-03-25T09:25:58.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:58.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:25:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:58.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:25:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:58.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:58 smithi059 ceph-mon[32732]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:58.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:58 smithi059 ceph-mon[32732]: osdmap e80: 8 total, 8 up, 8 in 2024-03-25T09:25:58.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:58 smithi040 ceph-mon[33094]: from='client.? 172.21.15.19:0/2777322440' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.59:0/1180794581"}]': finished 2024-03-25T09:25:58.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:58 smithi040 ceph-mon[33094]: osdmap e80: 8 total, 8 up, 8 in 2024-03-25T09:25:59.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:25:59 smithi059 ceph-mon[32732]: pgmap v505: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 259 KiB/s rd, 262 KiB/s wr, 56 op/s 2024-03-25T09:25:59.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:25:59 smithi040 ceph-mon[33094]: pgmap v505: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 259 KiB/s rd, 262 KiB/s wr, 56 op/s 2024-03-25T09:25:59.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:25:59.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:25:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:25:59.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:25:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:25:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:25:59 smithi019 ceph-mon[29386]: pgmap v505: 33 pgs: 33 active+clean; 1011 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 259 KiB/s rd, 262 KiB/s wr, 56 op/s 2024-03-25T09:25:59.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:25:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 44.4k 48.0k 0.0k 444.0k 480.0k 0.0k nvme2n1 2024-03-25T09:25:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 4.10 40.8k 43.6k 0.0k 408.0k 436.0k 0.0k nvme2n10 2024-03-25T09:25:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 4.10 45.2k 41.6k 0.0k 452.0k 416.0k 0.0k nvme2n11 2024-03-25T09:25:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 45.2k 39.6k 0.0k 452.0k 396.0k 0.0k nvme2n12 2024-03-25T09:25:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 69.6k 26.8k 0.0k 696.0k 268.0k 0.0k nvme2n13 2024-03-25T09:25:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 40.8k 28.4k 0.0k 408.0k 284.0k 0.0k nvme2n14 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 38.8k 43.6k 0.0k 388.0k 436.0k 0.0k nvme2n15 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 32.4k 57.2k 0.0k 324.0k 572.0k 0.0k nvme2n16 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 53.6k 44.8k 0.0k 536.0k 448.0k 0.0k nvme2n17 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 52.8k 46.4k 0.0k 528.0k 464.0k 0.0k nvme2n18 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 41.6k 50.0k 0.0k 416.0k 500.0k 0.0k nvme2n19 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 54.4k 24.4k 0.0k 544.0k 244.0k 0.0k nvme2n2 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 50.4k 31.2k 0.0k 504.0k 312.0k 0.0k nvme2n20 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 36.0k 56.0k 0.0k 360.0k 560.0k 0.0k nvme2n3 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 45.6k 27.2k 0.0k 456.0k 272.0k 0.0k nvme2n4 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 36.8k 61.2k 0.0k 368.0k 612.0k 0.0k nvme2n5 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 24.4k 54.0k 0.0k 244.0k 540.0k 0.0k nvme2n6 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 44.0k 46.4k 0.0k 440.0k 464.0k 0.0k nvme2n7 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 41.2k 31.6k 0.0k 412.0k 316.0k 0.0k nvme2n8 2024-03-25T09:25:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 4.10 44.0k 54.4k 0.0k 440.0k 544.0k 0.0k nvme2n9 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 61.6k 36.8k 0.0k 616.0k 368.0k 0.0k nvme5n1 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.10 40.8k 36.4k 0.0k 408.0k 364.0k 0.0k nvme5n10 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.10 38.4k 46.4k 0.0k 384.0k 464.0k 0.0k nvme5n11 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 39.6k 54.8k 0.0k 396.0k 548.0k 0.0k nvme5n12 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 37.6k 46.4k 0.0k 376.0k 464.0k 0.0k nvme5n13 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 35.6k 51.6k 0.0k 356.0k 516.0k 0.0k nvme5n14 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 67.2k 17.2k 0.0k 672.0k 172.0k 0.0k nvme5n15 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 51.2k 33.2k 0.0k 512.0k 332.0k 0.0k nvme5n16 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 58.8k 39.6k 0.0k 588.0k 396.0k 0.0k nvme5n17 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 62.8k 41.6k 0.0k 628.0k 416.0k 0.0k nvme5n18 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 37.6k 44.8k 0.0k 376.0k 448.0k 0.0k nvme5n19 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 44.0k 32.0k 0.0k 440.0k 320.0k 0.0k nvme5n2 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 40.0k 33.2k 0.0k 400.0k 332.0k 0.0k nvme5n20 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 40.8k 47.6k 0.0k 408.0k 476.0k 0.0k nvme5n3 2024-03-25T09:25:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 38.8k 39.2k 0.0k 388.0k 392.0k 0.0k nvme5n4 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 52.0k 30.4k 0.0k 520.0k 304.0k 0.0k nvme5n5 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 47.2k 44.8k 0.0k 472.0k 448.0k 0.0k nvme5n6 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 42.8k 52.0k 0.0k 428.0k 520.0k 0.0k nvme5n7 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 33.2k 38.0k 0.0k 332.0k 380.0k 0.0k nvme5n8 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 52.4k 58.4k 0.0k 524.0k 584.0k 0.0k nvme5n9 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 55.6k 44.8k 0.0k 556.0k 448.0k 0.0k nvme8n1 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.10 30.8k 46.0k 0.0k 308.0k 460.0k 0.0k nvme8n10 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.10 46.4k 54.8k 0.0k 464.0k 548.0k 0.0k nvme8n11 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 36.8k 44.0k 0.0k 368.0k 440.0k 0.0k nvme8n12 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 31.6k 61.6k 0.0k 316.0k 616.0k 0.0k nvme8n13 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 46.0k 41.2k 0.0k 460.0k 412.0k 0.0k nvme8n14 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 48.8k 51.6k 0.0k 488.0k 516.0k 0.0k nvme8n15 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 40.8k 52.4k 0.0k 408.0k 524.0k 0.0k nvme8n16 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 31.6k 44.4k 0.0k 316.0k 444.0k 0.0k nvme8n17 2024-03-25T09:25:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 43.2k 49.2k 0.0k 432.0k 492.0k 0.0k nvme8n18 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 30.0k 60.0k 0.0k 300.0k 600.0k 0.0k nvme8n19 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 29.6k 42.8k 0.0k 296.0k 428.0k 0.0k nvme8n2 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 48.4k 35.2k 0.0k 484.0k 352.0k 0.0k nvme8n20 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 29.6k 44.8k 0.0k 296.0k 448.0k 0.0k nvme8n3 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 42.8k 60.8k 0.0k 428.0k 608.0k 0.0k nvme8n4 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 51.2k 52.0k 0.0k 512.0k 520.0k 0.0k nvme8n5 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 41.6k 40.4k 0.0k 416.0k 404.0k 0.0k nvme8n6 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 32.4k 38.4k 0.0k 324.0k 384.0k 0.0k nvme8n7 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 4.20 60.8k 32.4k 0.0k 608.0k 324.0k 0.0k nvme8n8 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 4.10 41.6k 54.4k 0.0k 416.0k 544.0k 0.0k nvme8n9 2024-03-25T09:25:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:25:59.835 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:25:59.835 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 3/s 67 KiB/s 86 KiB/s 1.10 ms 154.42 us 2024-03-25T09:25:59.835 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 2/s 1/s 72 KiB/s 46 KiB/s 1.16 ms 168.15 us 2024-03-25T09:25:59.835 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 2/s 2/s 64 KiB/s 58 KiB/s 1.09 ms 173.13 us 2024-03-25T09:25:59.835 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 2/s 1/s 58 KiB/s 26 KiB/s 1.14 ms 160.10 us 2024-03-25T09:25:59.835 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 2/s 1/s 38 KiB/s 35 KiB/s 1.08 ms 153.75 us 2024-03-25T09:25:59.835 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 2/s 1/s 55 KiB/s 27 KiB/s 1.28 ms 171.78 us 2024-03-25T09:25:59.835 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 2/s 1/s 64 KiB/s 28 KiB/s 1.18 ms 158.11 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 2/s 1/s 63 KiB/s 36 KiB/s 1.08 ms 157.60 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 2/s 1/s 54 KiB/s 59 KiB/s 1.15 ms 171.82 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 1/s 2/s 39 KiB/s 50 KiB/s 1.12 ms 168.94 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 1/s 1/s 42 KiB/s 20 KiB/s 1.23 ms 178.08 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 1/s 1/s 46 KiB/s 22 KiB/s 1.16 ms 152.78 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 1/s 1/s 57 KiB/s 22 KiB/s 1.15 ms 175.40 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 1/s 2/s 46 KiB/s 23 KiB/s 1.18 ms 151.41 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 1/s 2/s 32 KiB/s 52 KiB/s 1.12 ms 246.93 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 1/s 1/s 24 KiB/s 18 KiB/s 1.12 ms 171.92 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 1/s 1/s 18 KiB/s 34 KiB/s 1.14 ms 158.55 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 1/s 2/s 27 KiB/s 57 KiB/s 1.08 ms 159.42 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 1/s 1/s 28 KiB/s 22 KiB/s 1.06 ms 147.42 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 1/s 1/s 31 KiB/s 15 KiB/s 1.11 ms 159.80 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 1/s 1/s 16 KiB/s 26 KiB/s 1.07 ms 178.90 us 2024-03-25T09:25:59.836 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 1/s 1/s 43 KiB/s 19 KiB/s 1.06 ms 165.16 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 1/s 1/s 31 KiB/s 35 KiB/s 1.17 ms 174.12 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 1/s 0/s 34 KiB/s 6.4 KiB/s 1.18 ms 58.67 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 1/s 1/s 15 KiB/s 24 KiB/s 1.19 ms 170.03 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 1/s 1/s 35 KiB/s 18 KiB/s 1.17 ms 164.99 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 1/s 0/s 26 KiB/s 4.8 KiB/s 1.17 ms 75.82 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 1/s 1/s 18 KiB/s 40 KiB/s 1.09 ms 174.28 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 1/s 0/s 46 KiB/s 6.4 KiB/s 1.21 ms 28.31 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 1/s 2/s 20 KiB/s 55 KiB/s 1.16 ms 152.94 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 1/s 1/s 20 KiB/s 20 KiB/s 1.00 ms 146.01 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 1/s 1/s 22 KiB/s 26 KiB/s 1.12 ms 156.64 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 0/s 0/s 18 KiB/s 10 KiB/s 975.63 us 122.31 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 0/s 1/s 14 KiB/s 19 KiB/s 824.44 us 165.26 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 0/s 1/s 8 KiB/s 46 KiB/s 1.05 ms 195.45 us 2024-03-25T09:25:59.837 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 0/s 2/s 9.6 KiB/s 40 KiB/s 813.89 us 168.07 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 0/s 0/s 21 KiB/s 10 KiB/s 662.01 us 99.94 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 0/s 1/s 7.2 KiB/s 25 KiB/s 703.15 us 159.74 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 0/s 1/s 4.8 KiB/s 19 KiB/s 549.02 us 178.44 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 0/s 0/s 10 KiB/s 10 KiB/s 727.27 us 93.68 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 0/s 0/s 4.8 KiB/s 4.8 KiB/s 626.69 us 131.30 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 0/s 0/s 7.2 KiB/s 4 KiB/s 733.12 us 29.99 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 0/s 1/s 5.6 KiB/s 22 KiB/s 672.39 us 181.24 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 0/s 0/s 13 KiB/s 8 KiB/s 745.50 us 69.57 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 0/s 1/s 14 KiB/s 42 KiB/s 557.78 us 158.79 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 0/s 0/s 4.8 KiB/s 8.8 KiB/s 538.44 us 57.55 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 0/s 0/s 4 KiB/s 1.6 KiB/s 1.70 ms 41.91 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 0/s 0/s 12 KiB/s 6.4 KiB/s 498.50 us 41.21 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 0/s 2/s 3.2 KiB/s 31 KiB/s 463.50 us 175.51 us 2024-03-25T09:25:59.838 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 0/s 0/s 1.6 KiB/s 7.2 KiB/s 225.59 us 96.97 us 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 0/s 0/s 3.2 KiB/s 7.2 KiB/s 239.73 us 61.59 us 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 0/s 0/s 2.4 KiB/s 1 B/s 281.38 us 29.36 us 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 0/s 0/s 2.4 KiB/s 1.6 KiB/s 281.44 us 28.01 us 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 0/s 0/s 6.4 KiB/s 0 B/s 258.90 us 0.00 ns 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 0/s 0/s 4 KiB/s 0 B/s 233.09 us 0.00 ns 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 0/s 0/s 0 B/s 819 B/s 0.00 ns 52.62 us 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 42.75 us 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 35.23 us 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 32.09 us 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 0/s 0/s 0 B/s 5.6 KiB/s 0.00 ns 72.87 us 2024-03-25T09:25:59.839 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:00.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:00 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:00.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:00 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:00.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:00 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:00.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:00 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:00.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:00 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:00.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:00 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:00.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:00 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:00.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:00.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:00.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:00 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:00 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:00 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:00 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:00 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:00 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:00 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:00 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:00 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:00 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:00 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:00 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:00 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:00.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:00 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:01 smithi040 ceph-mon[33094]: pgmap v506: 33 pgs: 33 active+clean; 1012 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-03-25T09:26:01.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:01.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:01.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:01 smithi019 ceph-mon[29386]: pgmap v506: 33 pgs: 33 active+clean; 1012 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-03-25T09:26:01.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:01 smithi059 ceph-mon[32732]: pgmap v506: 33 pgs: 33 active+clean; 1012 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-03-25T09:26:02.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:02.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:02.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:03.114 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:02.790+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:03 smithi040 ceph-mon[33094]: pgmap v507: 33 pgs: 33 active+clean; 1013 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 396 op/s 2024-03-25T09:26:03.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:03.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:03.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:03.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:03 smithi019 ceph-mon[29386]: pgmap v507: 33 pgs: 33 active+clean; 1013 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 396 op/s 2024-03-25T09:26:03.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:03 smithi059 ceph-mon[32732]: pgmap v507: 33 pgs: 33 active+clean; 1013 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 396 op/s 2024-03-25T09:26:04.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:04.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:04.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:04.839 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:04.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 9/s 6/s 148 KiB/s 130 KiB/s 1.08 ms 163.40 us 2024-03-25T09:26:04.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 8/s 5/s 178 KiB/s 116 KiB/s 1.09 ms 171.92 us 2024-03-25T09:26:04.839 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 7/s 6/s 147 KiB/s 138 KiB/s 1.15 ms 170.88 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 7/s 5/s 159 KiB/s 95 KiB/s 1.13 ms 172.52 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 7/s 7/s 173 KiB/s 122 KiB/s 1.13 ms 168.28 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 7/s 7/s 126 KiB/s 114 KiB/s 1.16 ms 154.81 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 7/s 124 KiB/s 110 KiB/s 1.11 ms 169.86 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 7/s 6/s 140 KiB/s 102 KiB/s 1.12 ms 156.96 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 7/s 7/s 125 KiB/s 154 KiB/s 1.10 ms 169.95 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 7/s 7/s 174 KiB/s 130 KiB/s 1.20 ms 156.52 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 7/s 6/s 144 KiB/s 114 KiB/s 1.12 ms 163.05 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 7/s 6/s 149 KiB/s 117 KiB/s 1.08 ms 172.96 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 7/s 7/s 132 KiB/s 131 KiB/s 1.12 ms 175.03 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 7/s 5/s 145 KiB/s 125 KiB/s 1.12 ms 155.93 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 5/s 154 KiB/s 133 KiB/s 1.14 ms 158.64 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 7/s 4/s 139 KiB/s 78 KiB/s 1.13 ms 158.62 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 7/s 4/s 150 KiB/s 109 KiB/s 1.10 ms 159.19 us 2024-03-25T09:26:04.840 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 7/s 5/s 173 KiB/s 113 KiB/s 1.09 ms 170.30 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 6/s 127 KiB/s 125 KiB/s 1.14 ms 166.66 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 6/s 130 KiB/s 147 KiB/s 1.13 ms 169.14 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 6/s 5/s 163 KiB/s 114 KiB/s 1.13 ms 163.92 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 3/s 127 KiB/s 59 KiB/s 1.08 ms 202.55 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 6/s 161 KiB/s 132 KiB/s 1.13 ms 175.65 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 7/s 120 KiB/s 134 KiB/s 1.10 ms 160.02 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 7/s 125 KiB/s 120 KiB/s 1.07 ms 165.65 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 4/s 130 KiB/s 111 KiB/s 1.07 ms 168.05 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 6/s 119 KiB/s 133 KiB/s 1.19 ms 168.09 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 7/s 114 KiB/s 129 KiB/s 1.13 ms 161.98 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 6/s 127 KiB/s 122 KiB/s 1.07 ms 163.69 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 4/s 116 KiB/s 76 KiB/s 1.05 ms 172.65 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 5/s 117 KiB/s 88 KiB/s 1.13 ms 156.02 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 7/s 127 KiB/s 114 KiB/s 1.06 ms 163.53 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 5/s 116 KiB/s 88 KiB/s 1.09 ms 168.00 us 2024-03-25T09:26:04.841 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 5/s 144 KiB/s 107 KiB/s 1.11 ms 161.22 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 5/s 126 KiB/s 90 KiB/s 1.07 ms 172.26 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 122 KiB/s 86 KiB/s 1.12 ms 160.29 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 5/s 129 KiB/s 114 KiB/s 1.12 ms 172.42 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 8/s 129 KiB/s 142 KiB/s 1.19 ms 170.26 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 122 KiB/s 100 KiB/s 1.11 ms 180.02 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 8/s 128 KiB/s 165 KiB/s 1.18 ms 165.95 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 6/s 98 KiB/s 170 KiB/s 1.12 ms 167.96 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 5/s 146 KiB/s 124 KiB/s 1.08 ms 165.74 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 5/s 115 KiB/s 113 KiB/s 1.06 ms 189.96 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 6/s 96 KiB/s 97 KiB/s 1.09 ms 179.03 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 5/s 108 KiB/s 115 KiB/s 1.14 ms 154.30 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 5/s 122 KiB/s 121 KiB/s 1.08 ms 160.89 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 7/s 84 KiB/s 138 KiB/s 1.07 ms 159.86 us 2024-03-25T09:26:04.842 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 5/s 106 KiB/s 112 KiB/s 1.13 ms 178.11 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 5/s 82 KiB/s 104 KiB/s 1.04 ms 157.63 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 6/s 78 KiB/s 140 KiB/s 1.10 ms 169.47 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 6/s 81 KiB/s 123 KiB/s 1.07 ms 170.51 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 7/s 89 KiB/s 142 KiB/s 1.09 ms 160.11 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 6/s 94 KiB/s 127 KiB/s 1.13 ms 165.19 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 4/s 121 KiB/s 88 KiB/s 1.14 ms 159.96 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 7/s 122 KiB/s 138 KiB/s 1.13 ms 181.87 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 6/s 90 KiB/s 119 KiB/s 1.10 ms 176.81 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 5/s 126 KiB/s 110 KiB/s 1.07 ms 174.98 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 8/s 88 KiB/s 163 KiB/s 1.11 ms 165.57 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 7/s 87 KiB/s 114 KiB/s 1.14 ms 186.88 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 7/s 80 KiB/s 130 KiB/s 1.15 ms 159.27 us 2024-03-25T09:26:04.843 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:05.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:05 smithi040 ceph-mon[33094]: pgmap v508: 33 pgs: 33 active+clean; 1013 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-03-25T09:26:05.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:05 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:05.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:05 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:05.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:05 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:05.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:05 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:05.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:05 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:05.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:05 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:05.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:05 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:05.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:05.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:05.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:05.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:05 smithi019 ceph-mon[29386]: pgmap v508: 33 pgs: 33 active+clean; 1013 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-03-25T09:26:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:05 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:05 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:05 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:05 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:05 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:05 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:05 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:05 smithi059 ceph-mon[32732]: pgmap v508: 33 pgs: 33 active+clean; 1013 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-03-25T09:26:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:05 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:05 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:05 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:05 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:05 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:05 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:05 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:06.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:06 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 277 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:06.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:06 smithi019 ceph-mon[29386]: osdmap e81: 8 total, 8 up, 8 in 2024-03-25T09:26:06.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:06.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:06.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:06 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 277 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:06 smithi059 ceph-mon[32732]: osdmap e81: 8 total, 8 up, 8 in 2024-03-25T09:26:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:06 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 277 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:06 smithi040 ceph-mon[33094]: osdmap e81: 8 total, 8 up, 8 in 2024-03-25T09:26:07.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:07.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:07.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:07.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:07 smithi019 ceph-mon[29386]: pgmap v510: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 688 op/s 2024-03-25T09:26:07.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:07 smithi059 ceph-mon[32732]: pgmap v510: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 688 op/s 2024-03-25T09:26:07.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:07 smithi040 ceph-mon[33094]: pgmap v510: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 688 op/s 2024-03-25T09:26:08.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:07.792+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:08.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:08.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:08.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:09.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:09.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:09.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:09.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:09 smithi019 ceph-mon[29386]: pgmap v511: 33 pgs: 33 active+clean; 1016 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.3 MiB/s wr, 756 op/s 2024-03-25T09:26:09.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:09.679 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 156.0k 121.6k 0.0k 1.5M 1.2M 0.0k nvme2n1 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 142.8k 144.0k 0.0k 1.4M 1.4M 0.0k nvme2n10 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 133.2k 156.4k 0.0k 1.3M 1.5M 0.0k nvme2n11 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 149.6k 161.2k 0.0k 1.5M 1.6M 0.0k nvme2n12 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 126.8k 150.0k 0.0k 1.2M 1.5M 0.0k nvme2n13 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 147.2k 151.2k 0.0k 1.4M 1.5M 0.0k nvme2n14 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 145.6k 131.6k 0.0k 1.4M 1.3M 0.0k nvme2n15 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 171.6k 136.4k 0.0k 1.7M 1.3M 0.0k nvme2n16 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 132.8k 148.0k 0.0k 1.3M 1.4M 0.0k nvme2n17 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 166.4k 128.4k 0.0k 1.6M 1.3M 0.0k nvme2n18 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 174.4k 122.8k 0.0k 1.7M 1.2M 0.0k nvme2n19 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 138.0k 143.6k 0.0k 1.3M 1.4M 0.0k nvme2n2 2024-03-25T09:26:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 124.8k 139.6k 0.0k 1.2M 1.4M 0.0k nvme2n20 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 124.8k 147.2k 0.0k 1.2M 1.4M 0.0k nvme2n3 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 133.2k 162.4k 0.0k 1.3M 1.6M 0.0k nvme2n4 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 149.6k 166.0k 0.0k 1.5M 1.6M 0.0k nvme2n5 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 149.6k 136.4k 0.0k 1.5M 1.3M 0.0k nvme2n6 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 149.2k 103.2k 0.0k 1.5M 1.0M 0.0k nvme2n7 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 133.6k 145.2k 0.0k 1.3M 1.4M 0.0k nvme2n8 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 123.2k 130.8k 0.0k 1.2M 1.3M 0.0k nvme2n9 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 145.6k 142.4k 0.0k 1.4M 1.4M 0.0k nvme5n1 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 113.2k 143.2k 0.0k 1.1M 1.4M 0.0k nvme5n10 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 163.6k 150.0k 0.0k 1.6M 1.5M 0.0k nvme5n11 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 128.4k 140.8k 0.0k 1.3M 1.4M 0.0k nvme5n12 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 140.8k 145.6k 0.0k 1.4M 1.4M 0.0k nvme5n13 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 143.2k 138.0k 0.0k 1.4M 1.3M 0.0k nvme5n14 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 120.8k 136.4k 0.0k 1.2M 1.3M 0.0k nvme5n15 2024-03-25T09:26:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 130.0k 143.6k 0.0k 1.3M 1.4M 0.0k nvme5n16 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 152.4k 126.8k 0.0k 1.5M 1.2M 0.0k nvme5n17 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 125.2k 147.2k 0.0k 1.2M 1.4M 0.0k nvme5n18 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 166.4k 122.4k 0.0k 1.6M 1.2M 0.0k nvme5n19 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 132.0k 144.4k 0.0k 1.3M 1.4M 0.0k nvme5n2 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 134.4k 142.0k 0.0k 1.3M 1.4M 0.0k nvme5n20 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 117.6k 147.2k 0.0k 1.1M 1.4M 0.0k nvme5n3 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 126.4k 170.8k 0.0k 1.2M 1.7M 0.0k nvme5n4 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 121.2k 164.4k 0.0k 1.2M 1.6M 0.0k nvme5n5 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 150.0k 130.4k 0.0k 1.5M 1.3M 0.0k nvme5n6 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 153.2k 123.6k 0.0k 1.5M 1.2M 0.0k nvme5n7 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 126.0k 134.0k 0.0k 1.2M 1.3M 0.0k nvme5n8 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 140.4k 123.6k 0.0k 1.4M 1.2M 0.0k nvme5n9 2024-03-25T09:26:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 122.0k 178.4k 0.0k 1.2M 1.7M 0.0k nvme8n1 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 154.4k 174.4k 0.0k 1.5M 1.7M 0.0k nvme8n10 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 156.8k 138.8k 0.0k 1.5M 1.4M 0.0k nvme8n11 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 123.6k 154.8k 0.0k 1.2M 1.5M 0.0k nvme8n12 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 169.6k 160.8k 0.0k 1.7M 1.6M 0.0k nvme8n13 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 130.8k 134.0k 0.0k 1.3M 1.3M 0.0k nvme8n14 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 126.0k 162.0k 0.0k 1.2M 1.6M 0.0k nvme8n15 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 154.0k 128.4k 0.0k 1.5M 1.3M 0.0k nvme8n16 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 127.6k 147.6k 0.0k 1.2M 1.4M 0.0k nvme8n17 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 146.8k 132.0k 0.0k 1.4M 1.3M 0.0k nvme8n18 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 128.0k 159.6k 0.0k 1.2M 1.6M 0.0k nvme8n19 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 142.0k 135.2k 0.0k 1.4M 1.3M 0.0k nvme8n2 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 180.0k 136.8k 0.0k 1.8M 1.3M 0.0k nvme8n20 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 166.4k 125.6k 0.0k 1.6M 1.2M 0.0k nvme8n3 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 140.0k 130.0k 0.0k 1.4M 1.3M 0.0k nvme8n4 2024-03-25T09:26:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 136.8k 133.2k 0.0k 1.3M 1.3M 0.0k nvme8n5 2024-03-25T09:26:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 158.4k 128.0k 0.0k 1.5M 1.2M 0.0k nvme8n6 2024-03-25T09:26:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 119.6k 167.6k 0.0k 1.2M 1.6M 0.0k nvme8n7 2024-03-25T09:26:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 14.40 116.0k 144.8k 0.0k 1.1M 1.4M 0.0k nvme8n8 2024-03-25T09:26:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 14.50 141.2k 119.6k 0.0k 1.4M 1.2M 0.0k nvme8n9 2024-03-25T09:26:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:09.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:09 smithi059 ceph-mon[32732]: pgmap v511: 33 pgs: 33 active+clean; 1016 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.3 MiB/s wr, 756 op/s 2024-03-25T09:26:09.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:09 smithi040 ceph-mon[33094]: pgmap v511: 33 pgs: 33 active+clean; 1016 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.3 MiB/s wr, 756 op/s 2024-03-25T09:26:09.843 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:09.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 10/s 6/s 202 KiB/s 126 KiB/s 1.15 ms 183.64 us 2024-03-25T09:26:09.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 9/s 6/s 178 KiB/s 122 KiB/s 1.13 ms 166.33 us 2024-03-25T09:26:09.843 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 9/s 5/s 177 KiB/s 102 KiB/s 1.14 ms 160.85 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 8/s 8/s 172 KiB/s 125 KiB/s 1.11 ms 173.33 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 8/s 6/s 174 KiB/s 164 KiB/s 1.11 ms 174.68 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 8/s 5/s 179 KiB/s 95 KiB/s 1.10 ms 156.83 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 8/s 6/s 157 KiB/s 118 KiB/s 1.13 ms 162.47 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 8/s 8/s 156 KiB/s 120 KiB/s 1.12 ms 173.29 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 8/s 6/s 157 KiB/s 88 KiB/s 1.10 ms 172.49 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 8/s 6/s 178 KiB/s 160 KiB/s 1.14 ms 159.24 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 8/s 7/s 154 KiB/s 134 KiB/s 1.15 ms 169.52 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 8/s 6/s 204 KiB/s 131 KiB/s 1.14 ms 164.50 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 8/s 8/s 168 KiB/s 165 KiB/s 1.10 ms 159.20 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 8/s 6/s 134 KiB/s 124 KiB/s 1.17 ms 169.96 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 8/s 6/s 178 KiB/s 119 KiB/s 1.13 ms 166.03 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 8/s 7/s 172 KiB/s 114 KiB/s 1.14 ms 159.93 us 2024-03-25T09:26:09.844 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 8/s 7/s 179 KiB/s 130 KiB/s 1.13 ms 184.89 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 8/s 8/s 162 KiB/s 159 KiB/s 1.12 ms 157.44 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 8/s 7/s 171 KiB/s 106 KiB/s 1.11 ms 164.74 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 8/s 8/s 154 KiB/s 141 KiB/s 1.09 ms 176.24 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 8/s 6/s 139 KiB/s 96 KiB/s 1.05 ms 181.29 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 8/s 7/s 145 KiB/s 144 KiB/s 1.18 ms 166.78 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 8/s 7/s 150 KiB/s 143 KiB/s 1.13 ms 157.15 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 8/s 8/s 170 KiB/s 143 KiB/s 1.09 ms 167.01 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 7/s 8/s 118 KiB/s 136 KiB/s 1.17 ms 180.06 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 4/s 192 KiB/s 70 KiB/s 1.12 ms 156.14 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 6/s 170 KiB/s 141 KiB/s 1.16 ms 171.03 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 7/s 8/s 158 KiB/s 164 KiB/s 1.15 ms 192.71 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 7/s 10/s 166 KiB/s 216 KiB/s 1.14 ms 170.80 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 6/s 131 KiB/s 127 KiB/s 1.15 ms 179.20 us 2024-03-25T09:26:09.845 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 7/s 8/s 143 KiB/s 165 KiB/s 1.19 ms 163.65 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 7/s 8/s 130 KiB/s 174 KiB/s 1.13 ms 177.49 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 7/s 7/s 125 KiB/s 144 KiB/s 1.12 ms 164.54 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 7/s 6/s 141 KiB/s 104 KiB/s 1.10 ms 161.65 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 7/s 6/s 147 KiB/s 108 KiB/s 1.08 ms 184.93 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 7/s 6/s 131 KiB/s 115 KiB/s 1.12 ms 163.08 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 7/s 9/s 161 KiB/s 166 KiB/s 1.13 ms 174.34 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 7/s 7/s 134 KiB/s 102 KiB/s 1.08 ms 172.03 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 7/s 7/s 141 KiB/s 102 KiB/s 1.12 ms 164.23 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 7/s 6/s 142 KiB/s 130 KiB/s 1.19 ms 173.09 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 7/s 166 KiB/s 128 KiB/s 1.09 ms 155.15 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 7/s 6/s 150 KiB/s 91 KiB/s 1.12 ms 179.83 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 7/s 7/s 149 KiB/s 132 KiB/s 1.11 ms 171.08 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 7/s 6/s 146 KiB/s 91 KiB/s 1.08 ms 149.05 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 6/s 141 KiB/s 160 KiB/s 1.19 ms 180.56 us 2024-03-25T09:26:09.846 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 7/s 147 KiB/s 142 KiB/s 1.06 ms 171.02 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 7/s 130 KiB/s 165 KiB/s 1.06 ms 171.48 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 7/s 113 KiB/s 124 KiB/s 1.09 ms 159.91 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 7/s 122 KiB/s 132 KiB/s 1.07 ms 168.19 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 8/s 121 KiB/s 92 KiB/s 1.11 ms 171.95 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 8/s 138 KiB/s 149 KiB/s 1.17 ms 163.96 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 8/s 142 KiB/s 169 KiB/s 1.09 ms 168.94 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 8/s 123 KiB/s 138 KiB/s 1.09 ms 149.93 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 8/s 96 KiB/s 139 KiB/s 1.24 ms 164.32 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 8/s 99 KiB/s 186 KiB/s 1.13 ms 150.45 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 10/s 111 KiB/s 178 KiB/s 1.08 ms 178.33 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 9/s 111 KiB/s 201 KiB/s 1.11 ms 172.71 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 9/s 104 KiB/s 212 KiB/s 1.06 ms 157.85 us 2024-03-25T09:26:09.847 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 9/s 110 KiB/s 188 KiB/s 1.09 ms 163.18 us 2024-03-25T09:26:09.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 5/s 98 KiB/s 88 KiB/s 1.11 ms 152.73 us 2024-03-25T09:26:09.848 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:10.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 282 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:10.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:10.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:10.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:10.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:10 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:10.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:10 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:10 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:10 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:10 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:10 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:10 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:10 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 282 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:10 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:10 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:10 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:10 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:10 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:10 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:10.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:10 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:10.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:10 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 282 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:11.279 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:11.280 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:11.280 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:11.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:11 smithi019 ceph-mon[29386]: pgmap v512: 33 pgs: 33 active+clean; 1016 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 8.0 MiB/s wr, 828 op/s 2024-03-25T09:26:11.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:11 smithi059 ceph-mon[32732]: pgmap v512: 33 pgs: 33 active+clean; 1016 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 8.0 MiB/s wr, 828 op/s 2024-03-25T09:26:11.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:11 smithi040 ceph-mon[33094]: pgmap v512: 33 pgs: 33 active+clean; 1016 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 8.0 MiB/s wr, 828 op/s 2024-03-25T09:26:12.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:12.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:12.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:12.792+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:13.281 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:13.281 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:13.281 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:13.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:13 smithi019 ceph-mon[29386]: pgmap v513: 33 pgs: 33 active+clean; 1018 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.3 MiB/s wr, 873 op/s 2024-03-25T09:26:13.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:13 smithi059 ceph-mon[32732]: pgmap v513: 33 pgs: 33 active+clean; 1018 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.3 MiB/s wr, 873 op/s 2024-03-25T09:26:13.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:13 smithi040 ceph-mon[33094]: pgmap v513: 33 pgs: 33 active+clean; 1018 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.3 MiB/s wr, 873 op/s 2024-03-25T09:26:14.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:14.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:14.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:14.847 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 10/s 8/s 212 KiB/s 160 KiB/s 1.23 ms 173.43 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 9/s 4/s 162 KiB/s 71 KiB/s 1.14 ms 163.54 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 9/s 7/s 195 KiB/s 140 KiB/s 1.14 ms 210.18 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 8/s 7/s 165 KiB/s 127 KiB/s 1.27 ms 162.17 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 8/s 7/s 164 KiB/s 146 KiB/s 1.13 ms 205.23 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 8/s 6/s 145 KiB/s 116 KiB/s 1.11 ms 178.70 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 8/s 9/s 158 KiB/s 163 KiB/s 1.20 ms 169.36 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 8/s 7/s 165 KiB/s 120 KiB/s 1.17 ms 162.15 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 8/s 7/s 126 KiB/s 126 KiB/s 1.11 ms 177.19 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 8/s 7/s 145 KiB/s 152 KiB/s 1.11 ms 149.53 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 7/s 5/s 126 KiB/s 112 KiB/s 1.10 ms 210.14 us 2024-03-25T09:26:14.848 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 7/s 7/s 166 KiB/s 130 KiB/s 1.16 ms 175.30 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 7/s 9/s 146 KiB/s 146 KiB/s 1.06 ms 169.22 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 7/s 7/s 132 KiB/s 118 KiB/s 1.18 ms 160.17 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 7/s 8/s 143 KiB/s 166 KiB/s 1.19 ms 199.96 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 7/s 7/s 147 KiB/s 114 KiB/s 1.14 ms 178.74 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 7/s 6/s 158 KiB/s 135 KiB/s 1.18 ms 175.35 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 7/s 7/s 143 KiB/s 126 KiB/s 1.09 ms 152.74 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 7/s 7/s 148 KiB/s 113 KiB/s 1.13 ms 159.70 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 7/s 5/s 139 KiB/s 120 KiB/s 1.19 ms 175.48 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 7/s 4/s 130 KiB/s 96 KiB/s 1.12 ms 164.33 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 7/s 6/s 108 KiB/s 130 KiB/s 1.20 ms 172.22 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 7/s 5/s 156 KiB/s 102 KiB/s 1.06 ms 187.54 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 7/s 5/s 164 KiB/s 121 KiB/s 1.13 ms 173.78 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 7/s 6/s 123 KiB/s 130 KiB/s 1.19 ms 175.90 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 7/s 7/s 142 KiB/s 113 KiB/s 1.27 ms 163.04 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 8/s 134 KiB/s 136 KiB/s 1.14 ms 163.50 us 2024-03-25T09:26:14.849 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 7/s 134 KiB/s 120 KiB/s 1.26 ms 157.00 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 8/s 98 KiB/s 170 KiB/s 1.10 ms 164.32 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 7/s 142 KiB/s 152 KiB/s 1.15 ms 174.82 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 7/s 115 KiB/s 137 KiB/s 1.08 ms 159.47 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 7/s 150 KiB/s 167 KiB/s 1.10 ms 167.30 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 7/s 119 KiB/s 148 KiB/s 1.14 ms 154.87 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 4/s 105 KiB/s 79 KiB/s 1.20 ms 163.09 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 7/s 142 KiB/s 146 KiB/s 1.16 ms 177.04 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 7/s 137 KiB/s 166 KiB/s 1.12 ms 196.63 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 5/s 109 KiB/s 95 KiB/s 1.12 ms 165.49 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 6/s 120 KiB/s 130 KiB/s 1.17 ms 193.76 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 9/s 113 KiB/s 139 KiB/s 1.12 ms 165.39 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 6/s 136 KiB/s 109 KiB/s 1.15 ms 182.57 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 6/s 107 KiB/s 94 KiB/s 1.10 ms 163.38 us 2024-03-25T09:26:14.850 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 7/s 119 KiB/s 113 KiB/s 1.16 ms 162.74 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 7/s 94 KiB/s 130 KiB/s 1.07 ms 171.34 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 7/s 100 KiB/s 134 KiB/s 1.08 ms 168.16 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 3/s 126 KiB/s 70 KiB/s 1.10 ms 218.01 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 7/s 105 KiB/s 90 KiB/s 1.17 ms 187.50 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 7/s 118 KiB/s 108 KiB/s 1.18 ms 174.77 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 6/s 122 KiB/s 146 KiB/s 1.07 ms 176.25 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 6/s 95 KiB/s 88 KiB/s 1.16 ms 182.78 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 5/s 128 KiB/s 80 KiB/s 1.22 ms 168.28 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 6/s 102 KiB/s 122 KiB/s 1.11 ms 165.62 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 7/s 119 KiB/s 137 KiB/s 1.12 ms 168.46 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 6/s 100 KiB/s 141 KiB/s 1.27 ms 176.21 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 6/s 103 KiB/s 144 KiB/s 1.09 ms 189.11 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 6/s 74 KiB/s 118 KiB/s 1.11 ms 153.95 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 5/s 92 KiB/s 101 KiB/s 1.20 ms 178.68 us 2024-03-25T09:26:14.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 7/s 86 KiB/s 130 KiB/s 1.20 ms 166.67 us 2024-03-25T09:26:14.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 6/s 89 KiB/s 102 KiB/s 1.24 ms 180.51 us 2024-03-25T09:26:14.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 6/s 104 KiB/s 157 KiB/s 1.17 ms 207.72 us 2024-03-25T09:26:14.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 6/s 76 KiB/s 129 KiB/s 1.12 ms 147.95 us 2024-03-25T09:26:14.852 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:15.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-mon[33094]: pgmap v514: 33 pgs: 33 active+clean; 1018 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 8.3 MiB/s wr, 875 op/s 2024-03-25T09:26:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:15.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 287 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:15.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:15.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:15.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:15.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:15 smithi019 ceph-mon[29386]: pgmap v514: 33 pgs: 33 active+clean; 1018 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 8.3 MiB/s wr, 875 op/s 2024-03-25T09:26:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:15 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:15 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:15 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:15 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:15 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:15 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:15 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:15 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 287 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:15.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:15 smithi059 ceph-mon[32732]: pgmap v514: 33 pgs: 33 active+clean; 1018 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 8.3 MiB/s wr, 875 op/s 2024-03-25T09:26:15.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:15 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:15.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:15 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:15 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:15 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:15 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:15 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:15 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:15 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 287 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:16.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:16.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:16.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:17.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:17 smithi040 ceph-mon[33094]: pgmap v515: 33 pgs: 33 active+clean; 1019 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 829 op/s 2024-03-25T09:26:17.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:17.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:17.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:17.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:17 smithi019 ceph-mon[29386]: pgmap v515: 33 pgs: 33 active+clean; 1019 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 829 op/s 2024-03-25T09:26:17.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:17 smithi059 ceph-mon[32732]: pgmap v515: 33 pgs: 33 active+clean; 1019 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 829 op/s 2024-03-25T09:26:18.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:17.792+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:18.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:18.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:18.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:19.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:19 smithi040 ceph-mon[33094]: pgmap v516: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 8.2 MiB/s wr, 829 op/s 2024-03-25T09:26:19.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:19.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:19.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:19.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:19 smithi019 ceph-mon[29386]: pgmap v516: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 8.2 MiB/s wr, 829 op/s 2024-03-25T09:26:19.673 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 183.6k 196.4k 0.0k 1.8M 1.9M 0.0k nvme2n1 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 159.2k 216.4k 0.0k 1.6M 2.1M 0.0k nvme2n10 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 208.8k 177.6k 0.0k 2.0M 1.7M 0.0k nvme2n11 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 192.0k 162.8k 0.0k 1.9M 1.6M 0.0k nvme2n12 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 202.8k 138.8k 0.0k 2.0M 1.4M 0.0k nvme2n13 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 163.2k 133.6k 0.0k 1.6M 1.3M 0.0k nvme2n14 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 185.2k 155.2k 0.0k 1.8M 1.5M 0.0k nvme2n15 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 169.6k 143.6k 0.0k 1.7M 1.4M 0.0k nvme2n16 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 160.0k 173.6k 0.0k 1.6M 1.7M 0.0k nvme2n17 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 190.4k 161.6k 0.0k 1.9M 1.6M 0.0k nvme2n18 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 184.8k 158.8k 0.0k 1.8M 1.6M 0.0k nvme2n19 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 199.2k 188.4k 0.0k 1.9M 1.8M 0.0k nvme2n2 2024-03-25T09:26:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 204.8k 207.2k 0.0k 2.0M 2.0M 0.0k nvme2n20 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 206.8k 162.8k 0.0k 2.0M 1.6M 0.0k nvme2n3 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 168.8k 194.0k 0.0k 1.6M 1.9M 0.0k nvme2n4 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 158.8k 195.2k 0.0k 1.6M 1.9M 0.0k nvme2n5 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 208.0k 157.2k 0.0k 2.0M 1.5M 0.0k nvme2n6 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 168.4k 167.6k 0.0k 1.6M 1.6M 0.0k nvme2n7 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 142.8k 138.4k 0.0k 1.4M 1.4M 0.0k nvme2n8 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 188.4k 184.0k 0.0k 1.8M 1.8M 0.0k nvme2n9 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 206.0k 183.2k 0.0k 2.0M 1.8M 0.0k nvme5n1 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 193.6k 121.6k 0.0k 1.9M 1.2M 0.0k nvme5n10 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 152.8k 221.2k 0.0k 1.5M 2.2M 0.0k nvme5n11 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 142.0k 147.6k 0.0k 1.4M 1.4M 0.0k nvme5n12 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 186.4k 209.2k 0.0k 1.8M 2.0M 0.0k nvme5n13 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 157.6k 162.0k 0.0k 1.5M 1.6M 0.0k nvme5n14 2024-03-25T09:26:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 184.0k 166.4k 0.0k 1.8M 1.6M 0.0k nvme5n15 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 208.8k 177.6k 0.0k 2.0M 1.7M 0.0k nvme5n16 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 198.0k 195.6k 0.0k 1.9M 1.9M 0.0k nvme5n17 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 156.0k 133.2k 0.0k 1.5M 1.3M 0.0k nvme5n18 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 171.6k 203.2k 0.0k 1.7M 2.0M 0.0k nvme5n19 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 129.6k 176.8k 0.0k 1.3M 1.7M 0.0k nvme5n2 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 154.0k 146.8k 0.0k 1.5M 1.4M 0.0k nvme5n20 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 132.0k 142.8k 0.0k 1.3M 1.4M 0.0k nvme5n3 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 163.6k 129.6k 0.0k 1.6M 1.3M 0.0k nvme5n4 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 197.6k 161.2k 0.0k 1.9M 1.6M 0.0k nvme5n5 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 180.8k 174.4k 0.0k 1.8M 1.7M 0.0k nvme5n6 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 200.0k 151.6k 0.0k 2.0M 1.5M 0.0k nvme5n7 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 154.0k 133.6k 0.0k 1.5M 1.3M 0.0k nvme5n8 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 184.8k 206.4k 0.0k 1.8M 2.0M 0.0k nvme5n9 2024-03-25T09:26:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 160.8k 172.8k 0.0k 1.6M 1.7M 0.0k nvme8n1 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 208.8k 190.0k 0.0k 2.0M 1.9M 0.0k nvme8n10 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 185.2k 226.8k 0.0k 1.8M 2.2M 0.0k nvme8n11 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 178.4k 152.4k 0.0k 1.7M 1.5M 0.0k nvme8n12 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 172.0k 150.8k 0.0k 1.7M 1.5M 0.0k nvme8n13 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 209.2k 197.6k 0.0k 2.0M 1.9M 0.0k nvme8n14 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 144.8k 202.4k 0.0k 1.4M 2.0M 0.0k nvme8n15 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 175.2k 193.2k 0.0k 1.7M 1.9M 0.0k nvme8n16 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 202.4k 154.0k 0.0k 2.0M 1.5M 0.0k nvme8n17 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 192.4k 171.2k 0.0k 1.9M 1.7M 0.0k nvme8n18 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 121.6k 222.0k 0.0k 1.2M 2.2M 0.0k nvme8n19 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 250.8k 147.6k 0.0k 2.4M 1.4M 0.0k nvme8n2 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.30 159.6k 172.0k 0.0k 1.6M 1.7M 0.0k nvme8n20 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 169.2k 176.8k 0.0k 1.7M 1.7M 0.0k nvme8n3 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 183.2k 180.4k 0.0k 1.8M 1.8M 0.0k nvme8n4 2024-03-25T09:26:19.695 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 158.0k 177.6k 0.0k 1.5M 1.7M 0.0k nvme8n5 2024-03-25T09:26:19.696 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 167.2k 188.4k 0.0k 1.6M 1.8M 0.0k nvme8n6 2024-03-25T09:26:19.696 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 193.2k 180.8k 0.0k 1.9M 1.8M 0.0k nvme8n7 2024-03-25T09:26:19.696 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 222.4k 182.0k 0.0k 2.2M 1.8M 0.0k nvme8n8 2024-03-25T09:26:19.696 INFO:tasks.workunit.client.3.smithi129.stdout: 13.40 150.8k 145.2k 0.0k 1.5M 1.4M 0.0k nvme8n9 2024-03-25T09:26:19.696 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:19.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:19 smithi059 ceph-mon[32732]: pgmap v516: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 8.2 MiB/s wr, 829 op/s 2024-03-25T09:26:19.851 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:19.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 10/s 7/s 234 KiB/s 172 KiB/s 1.16 ms 222.46 us 2024-03-25T09:26:19.851 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 9/s 7/s 170 KiB/s 198 KiB/s 1.13 ms 185.60 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 9/s 6/s 245 KiB/s 146 KiB/s 1.23 ms 218.79 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 8/s 7/s 242 KiB/s 212 KiB/s 1.20 ms 310.19 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 8/s 7/s 188 KiB/s 169 KiB/s 1.19 ms 214.25 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 8/s 7/s 208 KiB/s 216 KiB/s 1.16 ms 287.83 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 8/s 7/s 250 KiB/s 202 KiB/s 1.24 ms 329.00 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 8/s 7/s 290 KiB/s 177 KiB/s 1.17 ms 301.60 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 8/s 7/s 257 KiB/s 169 KiB/s 1.21 ms 245.16 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 7/s 7/s 222 KiB/s 185 KiB/s 1.14 ms 337.26 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 7/s 7/s 170 KiB/s 115 KiB/s 1.18 ms 196.97 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 7/s 9/s 210 KiB/s 203 KiB/s 1.20 ms 240.28 us 2024-03-25T09:26:19.852 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 7/s 6/s 213 KiB/s 174 KiB/s 1.17 ms 264.75 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 7/s 7/s 178 KiB/s 202 KiB/s 1.13 ms 250.91 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 8/s 176 KiB/s 223 KiB/s 1.23 ms 202.87 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 7/s 6/s 176 KiB/s 170 KiB/s 1.24 ms 266.07 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 7/s 6/s 92 KiB/s 108 KiB/s 1.18 ms 168.98 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 7/s 8/s 186 KiB/s 183 KiB/s 1.18 ms 288.92 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 7/s 5/s 222 KiB/s 132 KiB/s 1.19 ms 385.30 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 7/s 6/s 182 KiB/s 174 KiB/s 1.17 ms 263.68 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 7/s 6/s 202 KiB/s 214 KiB/s 1.25 ms 297.84 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 7/s 6/s 224 KiB/s 170 KiB/s 1.23 ms 314.18 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 7/s 147 KiB/s 158 KiB/s 1.20 ms 225.78 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 7/s 6/s 168 KiB/s 169 KiB/s 1.25 ms 246.18 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 8/s 167 KiB/s 220 KiB/s 1.20 ms 273.05 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 7/s 6/s 204 KiB/s 159 KiB/s 1.17 ms 206.96 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 7/s 6/s 159 KiB/s 197 KiB/s 1.22 ms 257.15 us 2024-03-25T09:26:19.853 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 7/s 6/s 165 KiB/s 127 KiB/s 1.16 ms 210.98 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 7/s 8/s 223 KiB/s 242 KiB/s 1.13 ms 239.61 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 8/s 134 KiB/s 162 KiB/s 1.13 ms 201.13 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 6/s 8/s 129 KiB/s 122 KiB/s 1.17 ms 166.68 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 8/s 231 KiB/s 254 KiB/s 1.23 ms 302.92 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 7/s 214 KiB/s 208 KiB/s 1.18 ms 270.20 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 7/s 157 KiB/s 150 KiB/s 1.11 ms 212.41 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 6/s 4/s 149 KiB/s 111 KiB/s 1.21 ms 247.28 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 7/s 108 KiB/s 117 KiB/s 1.25 ms 196.46 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 9/s 104 KiB/s 182 KiB/s 1.08 ms 212.34 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 6/s 109 KiB/s 92 KiB/s 1.18 ms 198.08 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 9/s 179 KiB/s 166 KiB/s 1.19 ms 207.54 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 6/s 169 KiB/s 139 KiB/s 1.19 ms 319.46 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 7/s 147 KiB/s 177 KiB/s 1.22 ms 246.21 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 6/s 158 KiB/s 121 KiB/s 1.19 ms 191.98 us 2024-03-25T09:26:19.854 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 6/s 5/s 183 KiB/s 197 KiB/s 1.26 ms 424.91 us 2024-03-25T09:26:19.855 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 7/s 150 KiB/s 190 KiB/s 1.11 ms 263.30 us 2024-03-25T09:26:19.855 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 6/s 158 KiB/s 170 KiB/s 1.18 ms 287.63 us 2024-03-25T09:26:19.855 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 7/s 102 KiB/s 170 KiB/s 1.14 ms 184.59 us 2024-03-25T09:26:19.855 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 9/s 130 KiB/s 217 KiB/s 1.16 ms 189.79 us 2024-03-25T09:26:19.855 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 10/s 146 KiB/s 254 KiB/s 1.21 ms 209.32 us 2024-03-25T09:26:19.855 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 9/s 141 KiB/s 270 KiB/s 1.16 ms 247.25 us 2024-03-25T09:26:19.855 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 7/s 152 KiB/s 177 KiB/s 1.20 ms 258.90 us 2024-03-25T09:26:19.855 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 7/s 124 KiB/s 133 KiB/s 1.17 ms 244.33 us 2024-03-25T09:26:19.855 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 6/s 143 KiB/s 190 KiB/s 1.16 ms 258.39 us 2024-03-25T09:26:19.855 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 8/s 166 KiB/s 208 KiB/s 1.14 ms 287.83 us 2024-03-25T09:26:19.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 8/s 179 KiB/s 230 KiB/s 1.19 ms 236.05 us 2024-03-25T09:26:19.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 5/s 86 KiB/s 90 KiB/s 1.14 ms 207.92 us 2024-03-25T09:26:19.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 7/s 158 KiB/s 218 KiB/s 1.27 ms 346.63 us 2024-03-25T09:26:19.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 8/s 168 KiB/s 195 KiB/s 1.12 ms 267.98 us 2024-03-25T09:26:19.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 7/s 97 KiB/s 151 KiB/s 1.17 ms 202.06 us 2024-03-25T09:26:19.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 7/s 148 KiB/s 228 KiB/s 1.29 ms 266.71 us 2024-03-25T09:26:19.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 114 KiB/s 166 KiB/s 1.23 ms 331.75 us 2024-03-25T09:26:19.856 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:20.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 292 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:20.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:20.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:20 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:20 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:20 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:20.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:20 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:20.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:20 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:20.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:20 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:20.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:20 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:20.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:20 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 292 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:20 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:20 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:20 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:20 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:20 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:20.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:20 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:20.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:20 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:20.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:20 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 292 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:21.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:21 smithi040 ceph-mon[33094]: pgmap v517: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.5 MiB/s wr, 804 op/s 2024-03-25T09:26:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:21.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:21.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:21 smithi019 ceph-mon[29386]: pgmap v517: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.5 MiB/s wr, 804 op/s 2024-03-25T09:26:21.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:21 smithi059 ceph-mon[32732]: pgmap v517: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.5 MiB/s wr, 804 op/s 2024-03-25T09:26:22.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:22.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:22.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:22.793+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:23.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:23 smithi040 ceph-mon[33094]: pgmap v518: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 10 MiB/s wr, 877 op/s 2024-03-25T09:26:23.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:23.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:23.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:23.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:23 smithi019 ceph-mon[29386]: pgmap v518: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 10 MiB/s wr, 877 op/s 2024-03-25T09:26:23.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:23 smithi059 ceph-mon[32732]: pgmap v518: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 10 MiB/s wr, 877 op/s 2024-03-25T09:26:24.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:24.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:24.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:24.856 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:24.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 9/s 4/s 262 KiB/s 114 KiB/s 1.20 ms 332.92 us 2024-03-25T09:26:24.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 8/s 4/s 249 KiB/s 138 KiB/s 1.15 ms 431.15 us 2024-03-25T09:26:24.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 8/s 5/s 272 KiB/s 161 KiB/s 1.18 ms 339.49 us 2024-03-25T09:26:24.856 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 8/s 4/s 242 KiB/s 141 KiB/s 1.19 ms 407.14 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 8/s 6/s 226 KiB/s 185 KiB/s 1.26 ms 341.06 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 7/s 4/s 305 KiB/s 170 KiB/s 1.20 ms 318.02 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 7/s 5/s 271 KiB/s 158 KiB/s 1.19 ms 342.58 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 5/s 242 KiB/s 143 KiB/s 1.19 ms 307.85 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 7/s 5/s 210 KiB/s 154 KiB/s 1.22 ms 344.41 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 7/s 6/s 222 KiB/s 189 KiB/s 1.23 ms 296.56 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 7/s 4/s 256 KiB/s 144 KiB/s 1.26 ms 314.48 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 7/s 5/s 232 KiB/s 146 KiB/s 1.24 ms 406.29 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 5/s 262 KiB/s 150 KiB/s 1.32 ms 307.40 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 7/s 4/s 198 KiB/s 138 KiB/s 1.23 ms 380.03 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 6/s 222 KiB/s 217 KiB/s 1.22 ms 294.90 us 2024-03-25T09:26:24.857 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 7/s 7/s 228 KiB/s 210 KiB/s 1.42 ms 309.24 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 7/s 5/s 225 KiB/s 178 KiB/s 1.16 ms 279.13 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 7/s 6/s 230 KiB/s 194 KiB/s 1.18 ms 339.08 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 7/s 6/s 230 KiB/s 199 KiB/s 1.24 ms 295.91 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 7/s 5/s 184 KiB/s 154 KiB/s 1.22 ms 273.78 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 6/s 6/s 262 KiB/s 178 KiB/s 1.29 ms 253.80 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 5/s 231 KiB/s 198 KiB/s 1.25 ms 413.04 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 7/s 243 KiB/s 222 KiB/s 1.30 ms 313.11 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 6/s 194 KiB/s 183 KiB/s 1.22 ms 278.79 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 6/s 208 KiB/s 183 KiB/s 1.18 ms 281.68 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 5/s 191 KiB/s 158 KiB/s 1.22 ms 293.70 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 6/s 201 KiB/s 250 KiB/s 1.15 ms 362.46 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 6/s 204 KiB/s 213 KiB/s 1.28 ms 304.27 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 6/s 194 KiB/s 181 KiB/s 1.33 ms 293.18 us 2024-03-25T09:26:24.858 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 5/s 198 KiB/s 161 KiB/s 1.16 ms 244.41 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 7/s 204 KiB/s 236 KiB/s 1.26 ms 352.25 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 6/s 172 KiB/s 184 KiB/s 1.25 ms 282.94 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 6/s 194 KiB/s 241 KiB/s 1.25 ms 371.03 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 6/s 198 KiB/s 162 KiB/s 1.26 ms 296.96 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 6/s 184 KiB/s 167 KiB/s 1.18 ms 325.99 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 6/s 163 KiB/s 146 KiB/s 1.24 ms 282.85 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 6/s 182 KiB/s 168 KiB/s 1.34 ms 284.64 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 6/s 183 KiB/s 194 KiB/s 1.19 ms 362.72 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 6/s 5/s 154 KiB/s 160 KiB/s 1.29 ms 277.71 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 6/s 182 KiB/s 175 KiB/s 1.23 ms 267.39 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 7/s 207 KiB/s 229 KiB/s 1.25 ms 308.31 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 6/s 188 KiB/s 191 KiB/s 1.24 ms 396.96 us 2024-03-25T09:26:24.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 6/s 198 KiB/s 185 KiB/s 1.19 ms 331.40 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 6/s 5/s 190 KiB/s 172 KiB/s 1.24 ms 316.67 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 7/s 185 KiB/s 248 KiB/s 1.17 ms 347.86 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 5/s 190 KiB/s 182 KiB/s 1.18 ms 374.05 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 6/s 170 KiB/s 181 KiB/s 1.25 ms 311.41 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 7/s 221 KiB/s 213 KiB/s 1.25 ms 357.75 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 5/s 157 KiB/s 173 KiB/s 1.22 ms 343.89 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 6/s 190 KiB/s 207 KiB/s 1.24 ms 248.15 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 7/s 147 KiB/s 178 KiB/s 1.36 ms 289.39 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 7/s 158 KiB/s 166 KiB/s 1.19 ms 350.89 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 4/s 186 KiB/s 106 KiB/s 1.21 ms 273.22 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 6/s 189 KiB/s 166 KiB/s 1.25 ms 317.11 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 7/s 178 KiB/s 222 KiB/s 1.21 ms 366.44 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 8/s 135 KiB/s 240 KiB/s 1.17 ms 324.09 us 2024-03-25T09:26:24.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 5/s 158 KiB/s 187 KiB/s 1.19 ms 363.73 us 2024-03-25T09:26:24.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 6/s 146 KiB/s 171 KiB/s 1.23 ms 347.90 us 2024-03-25T09:26:24.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 7/s 147 KiB/s 196 KiB/s 1.26 ms 301.54 us 2024-03-25T09:26:24.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 7/s 139 KiB/s 219 KiB/s 1.21 ms 305.94 us 2024-03-25T09:26:24.861 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-mon[33094]: pgmap v519: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 9.2 MiB/s rd, 9.6 MiB/s wr, 744 op/s 2024-03-25T09:26:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:25.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 297 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:25.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:25.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:25.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:25.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:25 smithi019 ceph-mon[29386]: pgmap v519: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 9.2 MiB/s rd, 9.6 MiB/s wr, 744 op/s 2024-03-25T09:26:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:25 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:25 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:25 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:25 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:25 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:25 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:25 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:25 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 297 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:25 smithi059 ceph-mon[32732]: pgmap v519: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 9.2 MiB/s rd, 9.6 MiB/s wr, 744 op/s 2024-03-25T09:26:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:25 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:25 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:25 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:25.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:25 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:25.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:25 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:25.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:25 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:25.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:25 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:25.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:25 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 297 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:26.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:26.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:26.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:27.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:27 smithi040 ceph-mon[33094]: pgmap v520: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 847 op/s 2024-03-25T09:26:27.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:27.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:27.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:27.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:27 smithi019 ceph-mon[29386]: pgmap v520: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 847 op/s 2024-03-25T09:26:27.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:27 smithi059 ceph-mon[32732]: pgmap v520: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 847 op/s 2024-03-25T09:26:28.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:27.793+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:28.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:28.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:28.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:29.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:29 smithi040 ceph-mon[33094]: pgmap v521: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 763 op/s 2024-03-25T09:26:29.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:29.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:29.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:29.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:29 smithi019 ceph-mon[29386]: pgmap v521: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 763 op/s 2024-03-25T09:26:29.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:26:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 162.8k 206.0k 0.0k 1.6M 2.0M 0.0k nvme2n1 2024-03-25T09:26:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 189.6k 171.2k 0.0k 1.9M 1.7M 0.0k nvme2n10 2024-03-25T09:26:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 165.6k 183.6k 0.0k 1.6M 1.8M 0.0k nvme2n11 2024-03-25T09:26:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 165.6k 217.2k 0.0k 1.6M 2.1M 0.0k nvme2n12 2024-03-25T09:26:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 186.0k 216.8k 0.0k 1.8M 2.1M 0.0k nvme2n13 2024-03-25T09:26:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 176.4k 166.8k 0.0k 1.7M 1.6M 0.0k nvme2n14 2024-03-25T09:26:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 195.2k 217.6k 0.0k 1.9M 2.1M 0.0k nvme2n15 2024-03-25T09:26:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 195.2k 171.2k 0.0k 1.9M 1.7M 0.0k nvme2n16 2024-03-25T09:26:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 193.2k 206.0k 0.0k 1.9M 2.0M 0.0k nvme2n17 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 173.6k 186.8k 0.0k 1.7M 1.8M 0.0k nvme2n18 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 165.2k 164.8k 0.0k 1.6M 1.6M 0.0k nvme2n19 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 158.0k 197.2k 0.0k 1.5M 1.9M 0.0k nvme2n2 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 158.4k 179.6k 0.0k 1.5M 1.8M 0.0k nvme2n20 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 174.0k 192.8k 0.0k 1.7M 1.9M 0.0k nvme2n3 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 159.2k 149.6k 0.0k 1.6M 1.5M 0.0k nvme2n4 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 166.8k 210.8k 0.0k 1.6M 2.1M 0.0k nvme2n5 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 179.6k 199.2k 0.0k 1.8M 1.9M 0.0k nvme2n6 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 224.8k 172.0k 0.0k 2.2M 1.7M 0.0k nvme2n7 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 180.8k 241.2k 0.0k 1.8M 2.4M 0.0k nvme2n8 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 225.2k 140.8k 0.0k 2.2M 1.4M 0.0k nvme2n9 2024-03-25T09:26:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 178.0k 166.0k 0.0k 1.7M 1.6M 0.0k nvme5n1 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 174.4k 192.8k 0.0k 1.7M 1.9M 0.0k nvme5n10 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 147.2k 213.6k 0.0k 1.4M 2.1M 0.0k nvme5n11 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 196.0k 192.0k 0.0k 1.9M 1.9M 0.0k nvme5n12 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 159.2k 203.2k 0.0k 1.6M 2.0M 0.0k nvme5n13 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 180.0k 168.8k 0.0k 1.8M 1.6M 0.0k nvme5n14 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 192.4k 158.0k 0.0k 1.9M 1.5M 0.0k nvme5n15 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 183.2k 172.0k 0.0k 1.8M 1.7M 0.0k nvme5n16 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 154.8k 224.0k 0.0k 1.5M 2.2M 0.0k nvme5n17 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 197.2k 214.0k 0.0k 1.9M 2.1M 0.0k nvme5n18 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 170.4k 164.0k 0.0k 1.7M 1.6M 0.0k nvme5n19 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 188.8k 216.4k 0.0k 1.8M 2.1M 0.0k nvme5n2 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 184.0k 190.8k 0.0k 1.8M 1.9M 0.0k nvme5n20 2024-03-25T09:26:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 224.8k 180.0k 0.0k 2.2M 1.8M 0.0k nvme5n3 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 180.8k 214.8k 0.0k 1.8M 2.1M 0.0k nvme5n4 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 180.4k 166.8k 0.0k 1.8M 1.6M 0.0k nvme5n5 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 206.0k 179.6k 0.0k 2.0M 1.8M 0.0k nvme5n6 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 198.8k 166.0k 0.0k 1.9M 1.6M 0.0k nvme5n7 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 167.6k 204.4k 0.0k 1.6M 2.0M 0.0k nvme5n8 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 179.6k 179.6k 0.0k 1.8M 1.8M 0.0k nvme5n9 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 181.6k 206.0k 0.0k 1.8M 2.0M 0.0k nvme8n1 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 215.2k 148.0k 0.0k 2.1M 1.4M 0.0k nvme8n10 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 178.4k 172.4k 0.0k 1.7M 1.7M 0.0k nvme8n11 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 155.6k 212.0k 0.0k 1.5M 2.1M 0.0k nvme8n12 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 163.6k 191.2k 0.0k 1.6M 1.9M 0.0k nvme8n13 2024-03-25T09:26:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 231.6k 147.6k 0.0k 2.3M 1.4M 0.0k nvme8n14 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 147.6k 183.2k 0.0k 1.4M 1.8M 0.0k nvme8n15 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 166.8k 195.6k 0.0k 1.6M 1.9M 0.0k nvme8n16 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 190.0k 179.6k 0.0k 1.9M 1.8M 0.0k nvme8n17 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 172.4k 198.4k 0.0k 1.7M 1.9M 0.0k nvme8n18 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 191.2k 165.2k 0.0k 1.9M 1.6M 0.0k nvme8n19 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 172.4k 201.2k 0.0k 1.7M 2.0M 0.0k nvme8n2 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 197.2k 190.8k 0.0k 1.9M 1.9M 0.0k nvme8n20 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 201.2k 185.2k 0.0k 2.0M 1.8M 0.0k nvme8n3 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 153.6k 189.2k 0.0k 1.5M 1.8M 0.0k nvme8n4 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 177.6k 195.6k 0.0k 1.7M 1.9M 0.0k nvme8n5 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 186.8k 170.8k 0.0k 1.8M 1.7M 0.0k nvme8n6 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 155.6k 158.8k 0.0k 1.5M 1.6M 0.0k nvme8n7 2024-03-25T09:26:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 212.4k 179.6k 0.0k 2.1M 1.8M 0.0k nvme8n8 2024-03-25T09:26:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 232.4k 169.6k 0.0k 2.3M 1.7M 0.0k nvme8n9 2024-03-25T09:26:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:29.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:29 smithi059 ceph-mon[32732]: pgmap v521: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 763 op/s 2024-03-25T09:26:29.859 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:29.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 8/s 5/s 226 KiB/s 134 KiB/s 1.36 ms 261.00 us 2024-03-25T09:26:29.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 8/s 5/s 244 KiB/s 133 KiB/s 1.23 ms 336.83 us 2024-03-25T09:26:29.859 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 8/s 5/s 234 KiB/s 161 KiB/s 1.24 ms 292.58 us 2024-03-25T09:26:29.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 8/s 5/s 252 KiB/s 174 KiB/s 1.22 ms 286.06 us 2024-03-25T09:26:29.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 8/s 6/s 220 KiB/s 180 KiB/s 1.20 ms 373.01 us 2024-03-25T09:26:29.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 8/s 5/s 238 KiB/s 150 KiB/s 1.24 ms 262.44 us 2024-03-25T09:26:29.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 7/s 5/s 200 KiB/s 131 KiB/s 1.24 ms 280.90 us 2024-03-25T09:26:29.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 7/s 6/s 228 KiB/s 166 KiB/s 1.33 ms 356.26 us 2024-03-25T09:26:29.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 7/s 5/s 257 KiB/s 183 KiB/s 1.24 ms 280.40 us 2024-03-25T09:26:29.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 7/s 4/s 225 KiB/s 126 KiB/s 1.29 ms 402.98 us 2024-03-25T09:26:29.860 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 6/s 229 KiB/s 193 KiB/s 1.25 ms 376.27 us 2024-03-25T09:26:29.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 7/s 5/s 214 KiB/s 144 KiB/s 1.29 ms 349.22 us 2024-03-25T09:26:29.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 7/s 6/s 186 KiB/s 177 KiB/s 1.29 ms 323.77 us 2024-03-25T09:26:29.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 7/s 6/s 182 KiB/s 175 KiB/s 1.19 ms 284.48 us 2024-03-25T09:26:29.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 7/s 7/s 174 KiB/s 169 KiB/s 1.26 ms 356.65 us 2024-03-25T09:26:29.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 7/s 5/s 221 KiB/s 141 KiB/s 1.29 ms 301.69 us 2024-03-25T09:26:29.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 7/s 5/s 202 KiB/s 163 KiB/s 1.18 ms 338.15 us 2024-03-25T09:26:29.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 6/s 243 KiB/s 175 KiB/s 1.26 ms 254.92 us 2024-03-25T09:26:29.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 7/s 6/s 234 KiB/s 195 KiB/s 1.27 ms 287.34 us 2024-03-25T09:26:29.861 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 7/s 5/s 215 KiB/s 208 KiB/s 1.19 ms 353.15 us 2024-03-25T09:26:29.862 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 6/s 190 KiB/s 223 KiB/s 1.21 ms 308.84 us 2024-03-25T09:26:29.862 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 6/s 181 KiB/s 205 KiB/s 1.21 ms 316.63 us 2024-03-25T09:26:29.862 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 6/s 174 KiB/s 122 KiB/s 1.40 ms 265.35 us 2024-03-25T09:26:29.862 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 6/s 218 KiB/s 169 KiB/s 1.31 ms 293.11 us 2024-03-25T09:26:29.862 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 6/s 177 KiB/s 208 KiB/s 1.22 ms 365.12 us 2024-03-25T09:26:29.862 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 6/s 173 KiB/s 169 KiB/s 1.30 ms 258.37 us 2024-03-25T09:26:29.862 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 6/s 170 KiB/s 144 KiB/s 1.18 ms 315.78 us 2024-03-25T09:26:29.862 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 5/s 167 KiB/s 122 KiB/s 1.22 ms 274.71 us 2024-03-25T09:26:29.862 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 5/s 199 KiB/s 172 KiB/s 1.23 ms 287.56 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 5/s 171 KiB/s 154 KiB/s 1.16 ms 296.64 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 5/s 184 KiB/s 148 KiB/s 1.21 ms 325.78 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 7/s 167 KiB/s 230 KiB/s 1.20 ms 312.08 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 5/s 186 KiB/s 167 KiB/s 1.24 ms 347.57 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 5/s 168 KiB/s 166 KiB/s 1.25 ms 317.75 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 5/s 202 KiB/s 174 KiB/s 1.21 ms 328.92 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 6/s 186 KiB/s 158 KiB/s 1.29 ms 350.00 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 6/s 159 KiB/s 139 KiB/s 1.25 ms 313.42 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 6/s 230 KiB/s 202 KiB/s 1.23 ms 298.90 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 6/s 204 KiB/s 184 KiB/s 1.20 ms 290.95 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 7/s 166 KiB/s 210 KiB/s 1.23 ms 363.27 us 2024-03-25T09:26:29.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 6/s 184 KiB/s 197 KiB/s 1.23 ms 345.49 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 7/s 140 KiB/s 164 KiB/s 1.21 ms 282.93 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 5/s 178 KiB/s 146 KiB/s 1.24 ms 293.55 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 6/s 151 KiB/s 182 KiB/s 1.26 ms 283.02 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 6/s 180 KiB/s 198 KiB/s 1.25 ms 298.95 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 6/s 187 KiB/s 175 KiB/s 1.27 ms 329.46 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 8/s 175 KiB/s 203 KiB/s 1.21 ms 294.43 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 6/s 139 KiB/s 211 KiB/s 1.24 ms 296.63 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 6/s 142 KiB/s 178 KiB/s 1.20 ms 300.30 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 7/s 166 KiB/s 179 KiB/s 1.30 ms 267.20 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 7/s 201 KiB/s 224 KiB/s 1.27 ms 342.46 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 6/s 182 KiB/s 138 KiB/s 1.38 ms 265.25 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 7/s 146 KiB/s 196 KiB/s 1.23 ms 308.02 us 2024-03-25T09:26:29.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 8/s 142 KiB/s 242 KiB/s 1.18 ms 313.09 us 2024-03-25T09:26:29.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 6/s 169 KiB/s 206 KiB/s 1.25 ms 312.84 us 2024-03-25T09:26:29.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 5/s 127 KiB/s 152 KiB/s 1.19 ms 281.73 us 2024-03-25T09:26:29.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 8/s 119 KiB/s 234 KiB/s 1.22 ms 334.27 us 2024-03-25T09:26:29.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 8/s 138 KiB/s 204 KiB/s 1.43 ms 298.94 us 2024-03-25T09:26:29.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 7/s 138 KiB/s 206 KiB/s 1.36 ms 308.15 us 2024-03-25T09:26:29.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 8/s 149 KiB/s 243 KiB/s 1.25 ms 372.26 us 2024-03-25T09:26:29.865 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:30.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:30.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:30.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:30.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:30.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:30.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:30.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:30.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:30.561 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 302 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:30.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:30.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:30 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:30 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:30 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:30 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:30 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:30 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:30 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:30 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 302 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:30 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:30 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:30 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:30 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:30 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:30.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:30 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:30.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:30 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:30.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:30 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 302 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:31.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:31 smithi040 ceph-mon[33094]: pgmap v522: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 738 op/s 2024-03-25T09:26:31.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:31 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:26:31.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:31.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:31.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:31.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:31 smithi019 ceph-mon[29386]: pgmap v522: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 738 op/s 2024-03-25T09:26:31.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:31 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:26:31.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:31 smithi059 ceph-mon[32732]: pgmap v522: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 738 op/s 2024-03-25T09:26:31.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:31 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:26:32.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:26:32.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-25T09:26:32.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-25T09:26:32.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-mon[29386]: Adjusting osd_memory_target on smithi059 to 5697M 2024-03-25T09:26:32.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:26:32.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:26:32.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:26:32.560 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:26:32.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:32.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:32.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:32.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:26:32.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-25T09:26:32.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-25T09:26:32.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:32 smithi059 ceph-mon[32732]: Adjusting osd_memory_target on smithi059 to 5697M 2024-03-25T09:26:32.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:26:32.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:26:32.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:26:32.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:26:32.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-25T09:26:32.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-25T09:26:32.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-25T09:26:32.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:32 smithi040 ceph-mon[33094]: Adjusting osd_memory_target on smithi059 to 5697M 2024-03-25T09:26:32.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:26:32.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:26:32.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:26:32.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:26:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:32.793+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:33.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:33.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:33.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:34.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:34 smithi019 ceph-mon[29386]: pgmap v523: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 831 op/s 2024-03-25T09:26:34.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:34.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:34.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:34.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:34 smithi059 ceph-mon[32732]: pgmap v523: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 831 op/s 2024-03-25T09:26:34.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:34 smithi040 ceph-mon[33094]: pgmap v523: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 831 op/s 2024-03-25T09:26:34.863 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:34.863 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 8/s 6/s 233 KiB/s 150 KiB/s 1.24 ms 290.27 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 8/s 5/s 225 KiB/s 118 KiB/s 1.43 ms 272.06 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 8/s 5/s 232 KiB/s 153 KiB/s 1.28 ms 296.35 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 7/s 4/s 218 KiB/s 98 KiB/s 1.32 ms 248.27 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 7/s 5/s 190 KiB/s 197 KiB/s 1.23 ms 364.69 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 7/s 6/s 217 KiB/s 158 KiB/s 1.36 ms 363.19 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 7/s 5/s 185 KiB/s 162 KiB/s 1.32 ms 324.51 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 7/s 5/s 199 KiB/s 150 KiB/s 1.21 ms 296.08 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 7/s 5/s 165 KiB/s 126 KiB/s 1.25 ms 296.38 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 7/s 6/s 138 KiB/s 156 KiB/s 1.16 ms 369.28 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 7/s 6/s 190 KiB/s 166 KiB/s 1.21 ms 278.09 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 7/s 5/s 205 KiB/s 118 KiB/s 1.31 ms 251.95 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 7/s 6/s 206 KiB/s 138 KiB/s 1.26 ms 337.81 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 7/s 6/s 229 KiB/s 162 KiB/s 1.29 ms 361.57 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 7/s 5/s 176 KiB/s 200 KiB/s 1.25 ms 378.55 us 2024-03-25T09:26:34.864 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 7/s 7/s 185 KiB/s 183 KiB/s 1.26 ms 299.88 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 7/s 6/s 195 KiB/s 194 KiB/s 1.27 ms 298.55 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 7/s 6/s 207 KiB/s 188 KiB/s 1.40 ms 287.73 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 7/s 5/s 184 KiB/s 170 KiB/s 1.25 ms 281.40 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 6/s 170 KiB/s 207 KiB/s 1.30 ms 305.88 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 6/s 198 KiB/s 143 KiB/s 1.38 ms 311.35 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 5/s 170 KiB/s 150 KiB/s 1.24 ms 362.68 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 6/s 195 KiB/s 202 KiB/s 1.27 ms 342.39 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 6/s 208 KiB/s 175 KiB/s 1.23 ms 326.36 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 5/s 186 KiB/s 120 KiB/s 1.27 ms 273.42 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 5/s 202 KiB/s 154 KiB/s 1.26 ms 280.67 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 5/s 159 KiB/s 174 KiB/s 1.19 ms 301.24 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 6/s 230 KiB/s 179 KiB/s 1.29 ms 360.40 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 6/s 222 KiB/s 144 KiB/s 1.27 ms 290.04 us 2024-03-25T09:26:34.865 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 5/s 196 KiB/s 142 KiB/s 1.29 ms 292.69 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 4/s 174 KiB/s 114 KiB/s 1.27 ms 279.51 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 5/s 166 KiB/s 173 KiB/s 1.24 ms 294.83 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 5/s 152 KiB/s 146 KiB/s 1.26 ms 271.67 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 5/s 194 KiB/s 144 KiB/s 1.26 ms 275.88 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 6/s 214 KiB/s 158 KiB/s 1.27 ms 289.73 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 6/s 176 KiB/s 189 KiB/s 1.28 ms 280.21 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 6/s 8/s 184 KiB/s 201 KiB/s 1.25 ms 338.54 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 6/s 154 KiB/s 157 KiB/s 1.21 ms 291.76 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 7/s 177 KiB/s 194 KiB/s 1.20 ms 278.06 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 7/s 162 KiB/s 170 KiB/s 1.38 ms 266.13 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 6/s 166 KiB/s 174 KiB/s 1.31 ms 239.15 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 6/s 146 KiB/s 159 KiB/s 1.19 ms 280.13 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 6/s 7/s 202 KiB/s 210 KiB/s 1.29 ms 285.67 us 2024-03-25T09:26:34.866 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 6/s 144 KiB/s 181 KiB/s 1.25 ms 304.82 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 6/s 158 KiB/s 178 KiB/s 1.35 ms 341.18 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 6/s 152 KiB/s 189 KiB/s 1.48 ms 267.21 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 7/s 159 KiB/s 218 KiB/s 1.25 ms 279.86 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 6/s 169 KiB/s 135 KiB/s 1.27 ms 268.38 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 7/s 146 KiB/s 186 KiB/s 1.25 ms 300.88 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 7/s 121 KiB/s 160 KiB/s 1.25 ms 266.86 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 5/s 158 KiB/s 115 KiB/s 1.30 ms 285.22 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 8/s 141 KiB/s 210 KiB/s 1.23 ms 798.35 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 7/s 138 KiB/s 230 KiB/s 1.33 ms 327.39 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 8/s 152 KiB/s 219 KiB/s 1.26 ms 280.55 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 7/s 149 KiB/s 215 KiB/s 1.31 ms 309.98 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 7/s 163 KiB/s 196 KiB/s 1.21 ms 295.14 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 7/s 162 KiB/s 170 KiB/s 1.31 ms 295.78 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 7/s 126 KiB/s 224 KiB/s 1.20 ms 351.01 us 2024-03-25T09:26:34.867 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 8/s 134 KiB/s 216 KiB/s 1.31 ms 296.24 us 2024-03-25T09:26:34.868 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 8/s 119 KiB/s 201 KiB/s 1.28 ms 349.77 us 2024-03-25T09:26:34.868 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:35.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:35.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:35.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:36.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:36.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-mon[29386]: pgmap v524: 33 pgs: 33 active+clean; 1020 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.4 MiB/s rd, 10 MiB/s wr, 717 op/s 2024-03-25T09:26:36.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:36.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:36.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:36.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:36.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:36.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:36.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:36.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 307 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:36.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:36.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:36 smithi059 ceph-mon[32732]: pgmap v524: 33 pgs: 33 active+clean; 1020 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.4 MiB/s rd, 10 MiB/s wr, 717 op/s 2024-03-25T09:26:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:36 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:36 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:36 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:36 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:36 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:36 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:36 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:36.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:36 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 307 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:36 smithi040 ceph-mon[33094]: pgmap v524: 33 pgs: 33 active+clean; 1020 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.4 MiB/s rd, 10 MiB/s wr, 717 op/s 2024-03-25T09:26:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:36 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:36 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:36 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:36 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:36 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:36.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:36 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:36.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:36 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:36.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:36 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 307 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:37.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:37.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:37.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:37.794+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:38 smithi059 ceph-mon[32732]: pgmap v525: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 831 op/s 2024-03-25T09:26:38.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:38 smithi019 ceph-mon[29386]: pgmap v525: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 831 op/s 2024-03-25T09:26:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:38.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:38.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:38 smithi040 ceph-mon[33094]: pgmap v525: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 831 op/s 2024-03-25T09:26:39.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:39.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:39.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:39.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:26:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 170.8k 180.0k 0.0k 1.7M 1.8M 0.0k nvme2n1 2024-03-25T09:26:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 162.0k 145.6k 0.0k 1.6M 1.4M 0.0k nvme2n10 2024-03-25T09:26:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 162.8k 182.0k 0.0k 1.6M 1.8M 0.0k nvme2n11 2024-03-25T09:26:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 144.4k 171.6k 0.0k 1.4M 1.7M 0.0k nvme2n12 2024-03-25T09:26:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 186.4k 138.0k 0.0k 1.8M 1.3M 0.0k nvme2n13 2024-03-25T09:26:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 190.4k 151.2k 0.0k 1.9M 1.5M 0.0k nvme2n14 2024-03-25T09:26:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 148.8k 160.0k 0.0k 1.5M 1.6M 0.0k nvme2n15 2024-03-25T09:26:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 169.2k 153.6k 0.0k 1.7M 1.5M 0.0k nvme2n16 2024-03-25T09:26:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 187.6k 116.8k 0.0k 1.8M 1.1M 0.0k nvme2n17 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 144.0k 187.2k 0.0k 1.4M 1.8M 0.0k nvme2n18 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 147.6k 174.8k 0.0k 1.4M 1.7M 0.0k nvme2n19 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 175.6k 165.2k 0.0k 1.7M 1.6M 0.0k nvme2n2 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 174.4k 179.6k 0.0k 1.7M 1.8M 0.0k nvme2n20 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 177.6k 160.8k 0.0k 1.7M 1.6M 0.0k nvme2n3 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 125.6k 222.4k 0.0k 1.2M 2.2M 0.0k nvme2n4 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 165.6k 170.4k 0.0k 1.6M 1.7M 0.0k nvme2n5 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 190.4k 139.2k 0.0k 1.9M 1.4M 0.0k nvme2n6 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 176.8k 149.6k 0.0k 1.7M 1.5M 0.0k nvme2n7 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 180.0k 179.2k 0.0k 1.8M 1.8M 0.0k nvme2n8 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 163.6k 170.8k 0.0k 1.6M 1.7M 0.0k nvme2n9 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 170.8k 186.8k 0.0k 1.7M 1.8M 0.0k nvme5n1 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 172.4k 143.2k 0.0k 1.7M 1.4M 0.0k nvme5n10 2024-03-25T09:26:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 161.2k 185.2k 0.0k 1.6M 1.8M 0.0k nvme5n11 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 192.0k 151.2k 0.0k 1.9M 1.5M 0.0k nvme5n12 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 185.6k 170.4k 0.0k 1.8M 1.7M 0.0k nvme5n13 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 188.4k 156.4k 0.0k 1.8M 1.5M 0.0k nvme5n14 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 204.4k 146.0k 0.0k 2.0M 1.4M 0.0k nvme5n15 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 147.6k 191.6k 0.0k 1.4M 1.9M 0.0k nvme5n16 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 175.2k 156.4k 0.0k 1.7M 1.5M 0.0k nvme5n17 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 155.2k 186.8k 0.0k 1.5M 1.8M 0.0k nvme5n18 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 141.6k 158.0k 0.0k 1.4M 1.5M 0.0k nvme5n19 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 182.0k 176.0k 0.0k 1.8M 1.7M 0.0k nvme5n2 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 151.2k 160.8k 0.0k 1.5M 1.6M 0.0k nvme5n20 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 167.6k 183.6k 0.0k 1.6M 1.8M 0.0k nvme5n3 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 180.4k 157.6k 0.0k 1.8M 1.5M 0.0k nvme5n4 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 176.0k 163.2k 0.0k 1.7M 1.6M 0.0k nvme5n5 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 150.4k 139.6k 0.0k 1.5M 1.4M 0.0k nvme5n6 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 177.2k 176.4k 0.0k 1.7M 1.7M 0.0k nvme5n7 2024-03-25T09:26:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 137.2k 223.6k 0.0k 1.3M 2.2M 0.0k nvme5n8 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 163.6k 177.6k 0.0k 1.6M 1.7M 0.0k nvme5n9 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 126.8k 204.0k 0.0k 1.2M 2.0M 0.0k nvme8n1 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 183.6k 149.6k 0.0k 1.8M 1.5M 0.0k nvme8n10 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 120.4k 197.6k 0.0k 1.2M 1.9M 0.0k nvme8n11 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 165.2k 162.4k 0.0k 1.6M 1.6M 0.0k nvme8n12 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 138.4k 158.8k 0.0k 1.4M 1.6M 0.0k nvme8n13 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 191.6k 149.2k 0.0k 1.9M 1.5M 0.0k nvme8n14 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 172.0k 154.8k 0.0k 1.7M 1.5M 0.0k nvme8n15 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 140.4k 188.8k 0.0k 1.4M 1.8M 0.0k nvme8n16 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 167.2k 156.0k 0.0k 1.6M 1.5M 0.0k nvme8n17 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 150.8k 178.0k 0.0k 1.5M 1.7M 0.0k nvme8n18 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 167.2k 156.4k 0.0k 1.6M 1.5M 0.0k nvme8n19 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 181.2k 135.2k 0.0k 1.8M 1.3M 0.0k nvme8n2 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 168.0k 162.0k 0.0k 1.6M 1.6M 0.0k nvme8n20 2024-03-25T09:26:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 168.0k 140.0k 0.0k 1.6M 1.4M 0.0k nvme8n3 2024-03-25T09:26:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 160.8k 182.8k 0.0k 1.6M 1.8M 0.0k nvme8n4 2024-03-25T09:26:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 199.2k 158.8k 0.0k 1.9M 1.6M 0.0k nvme8n5 2024-03-25T09:26:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 155.2k 198.0k 0.0k 1.5M 1.9M 0.0k nvme8n6 2024-03-25T09:26:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 156.8k 174.8k 0.0k 1.5M 1.7M 0.0k nvme8n7 2024-03-25T09:26:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 211.2k 166.4k 0.0k 2.1M 1.6M 0.0k nvme8n8 2024-03-25T09:26:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.90 153.6k 158.0k 0.0k 1.5M 1.5M 0.0k nvme8n9 2024-03-25T09:26:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:39.868 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:39.868 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 8/s 5/s 239 KiB/s 154 KiB/s 1.33 ms 278.45 us 2024-03-25T09:26:39.868 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 8/s 5/s 226 KiB/s 142 KiB/s 1.30 ms 336.27 us 2024-03-25T09:26:39.868 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 8/s 4/s 202 KiB/s 115 KiB/s 1.31 ms 345.63 us 2024-03-25T09:26:39.868 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 8/s 7/s 191 KiB/s 162 KiB/s 1.29 ms 293.07 us 2024-03-25T09:26:39.868 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 5/s 189 KiB/s 130 KiB/s 1.30 ms 290.27 us 2024-03-25T09:26:39.868 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 7/s 5/s 210 KiB/s 151 KiB/s 1.29 ms 302.61 us 2024-03-25T09:26:39.868 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 7/s 6/s 219 KiB/s 161 KiB/s 1.49 ms 267.65 us 2024-03-25T09:26:39.868 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 7/s 7/s 212 KiB/s 198 KiB/s 1.24 ms 327.23 us 2024-03-25T09:26:39.868 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 7/s 6/s 152 KiB/s 164 KiB/s 1.29 ms 292.20 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 7/s 6/s 162 KiB/s 152 KiB/s 1.24 ms 293.40 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 7/s 5/s 208 KiB/s 131 KiB/s 1.26 ms 238.23 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 7/s 6/s 194 KiB/s 134 KiB/s 1.24 ms 234.99 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 7/s 5/s 186 KiB/s 146 KiB/s 1.23 ms 262.52 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 7/s 6/s 170 KiB/s 165 KiB/s 1.27 ms 254.51 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 7/s 6/s 170 KiB/s 197 KiB/s 1.30 ms 321.78 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 7/s 6/s 187 KiB/s 171 KiB/s 1.27 ms 301.16 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 7/s 5/s 155 KiB/s 166 KiB/s 1.32 ms 312.25 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 7/s 7/s 174 KiB/s 173 KiB/s 1.23 ms 343.82 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 7/s 6/s 185 KiB/s 171 KiB/s 1.28 ms 369.16 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 7/s 5/s 178 KiB/s 149 KiB/s 1.37 ms 297.50 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 6/s 155 KiB/s 173 KiB/s 1.31 ms 272.43 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 6/s 176 KiB/s 166 KiB/s 1.29 ms 291.40 us 2024-03-25T09:26:39.869 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 6/s 5/s 215 KiB/s 129 KiB/s 1.29 ms 336.49 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 6/s 177 KiB/s 182 KiB/s 1.35 ms 327.48 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 6/s 179 KiB/s 166 KiB/s 1.24 ms 306.68 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 6/s 6/s 194 KiB/s 158 KiB/s 1.28 ms 368.18 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 7/s 180 KiB/s 187 KiB/s 1.39 ms 320.33 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 6/s 176 KiB/s 142 KiB/s 1.23 ms 346.31 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 5/s 162 KiB/s 150 KiB/s 1.33 ms 324.22 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 6/s 173 KiB/s 167 KiB/s 1.33 ms 269.53 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 6/s 178 KiB/s 150 KiB/s 1.29 ms 282.26 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 5/s 183 KiB/s 134 KiB/s 1.27 ms 341.70 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 7/s 179 KiB/s 179 KiB/s 1.33 ms 331.12 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 7/s 185 KiB/s 171 KiB/s 1.25 ms 451.41 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 6/s 147 KiB/s 175 KiB/s 1.25 ms 280.35 us 2024-03-25T09:26:39.870 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 6/s 130 KiB/s 142 KiB/s 1.25 ms 234.00 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 6/s 146 KiB/s 206 KiB/s 1.33 ms 308.33 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 7/s 171 KiB/s 182 KiB/s 1.31 ms 324.96 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 7/s 160 KiB/s 177 KiB/s 1.25 ms 272.90 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 6/s 6/s 182 KiB/s 155 KiB/s 1.28 ms 268.08 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 5/s 163 KiB/s 123 KiB/s 1.40 ms 282.83 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 6/s 152 KiB/s 124 KiB/s 1.32 ms 305.95 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 6/s 6/s 96 KiB/s 152 KiB/s 1.20 ms 300.79 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 7/s 152 KiB/s 192 KiB/s 1.31 ms 361.80 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 7/s 154 KiB/s 162 KiB/s 1.25 ms 311.19 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 5/s 164 KiB/s 168 KiB/s 1.27 ms 304.83 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 5/s 125 KiB/s 145 KiB/s 1.29 ms 279.78 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 6/s 137 KiB/s 154 KiB/s 1.28 ms 259.57 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 6/s 160 KiB/s 184 KiB/s 1.27 ms 276.95 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 6/s 150 KiB/s 178 KiB/s 1.25 ms 303.03 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 6/s 195 KiB/s 118 KiB/s 1.32 ms 291.94 us 2024-03-25T09:26:39.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 7/s 166 KiB/s 167 KiB/s 1.36 ms 373.56 us 2024-03-25T09:26:39.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 6/s 184 KiB/s 164 KiB/s 1.32 ms 325.81 us 2024-03-25T09:26:39.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 7/s 137 KiB/s 156 KiB/s 1.25 ms 393.51 us 2024-03-25T09:26:39.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 9/s 130 KiB/s 233 KiB/s 1.37 ms 285.72 us 2024-03-25T09:26:39.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 6/s 125 KiB/s 122 KiB/s 1.38 ms 265.56 us 2024-03-25T09:26:39.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 7/s 138 KiB/s 181 KiB/s 1.33 ms 313.82 us 2024-03-25T09:26:39.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 7/s 151 KiB/s 187 KiB/s 1.40 ms 298.50 us 2024-03-25T09:26:39.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 7/s 129 KiB/s 159 KiB/s 1.28 ms 257.84 us 2024-03-25T09:26:39.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 7/s 99 KiB/s 156 KiB/s 1.30 ms 279.64 us 2024-03-25T09:26:39.872 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:40 smithi019 ceph-mon[29386]: pgmap v526: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 762 op/s 2024-03-25T09:26:40.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:40.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:40.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:40 smithi059 ceph-mon[32732]: pgmap v526: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 762 op/s 2024-03-25T09:26:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:40 smithi040 ceph-mon[33094]: pgmap v526: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 762 op/s 2024-03-25T09:26:41.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:41 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:41 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:41 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:41 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:41 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:41 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:41 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:41.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:41 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 312 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:41.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:41.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:41.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:41.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:41.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:41.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:41.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:41.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 312 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:41.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:41.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:41.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:41.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:41 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:41.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:41 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:41.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:41 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:41.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:41 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:41.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:41 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:41.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:41 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:41.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:41 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:41.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:41 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 312 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:42.279 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:42 smithi019 ceph-mon[29386]: pgmap v527: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 9.8 MiB/s wr, 745 op/s 2024-03-25T09:26:42.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:42.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:42 smithi059 ceph-mon[32732]: pgmap v527: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 9.8 MiB/s wr, 745 op/s 2024-03-25T09:26:42.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:42 smithi040 ceph-mon[33094]: pgmap v527: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 9.8 MiB/s wr, 745 op/s 2024-03-25T09:26:42.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:42.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:43.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:42.794+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:43.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:43.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:43.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:44.284 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:44 smithi019 ceph-mon[29386]: pgmap v528: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 837 op/s 2024-03-25T09:26:44.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:44 smithi059 ceph-mon[32732]: pgmap v528: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 837 op/s 2024-03-25T09:26:44.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:44 smithi040 ceph-mon[33094]: pgmap v528: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 837 op/s 2024-03-25T09:26:44.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:44.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:44.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:44.871 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:44.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 8/s 5/s 229 KiB/s 149 KiB/s 1.28 ms 302.98 us 2024-03-25T09:26:44.871 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 8/s 6/s 185 KiB/s 154 KiB/s 1.24 ms 279.99 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 8/s 5/s 177 KiB/s 133 KiB/s 1.32 ms 267.55 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 8/s 5/s 181 KiB/s 127 KiB/s 1.25 ms 321.43 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 7/s 4/s 166 KiB/s 117 KiB/s 1.32 ms 285.53 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 7/s 5/s 152 KiB/s 135 KiB/s 1.25 ms 303.26 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 7/s 5/s 169 KiB/s 122 KiB/s 1.41 ms 304.66 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 7/s 4/s 188 KiB/s 120 KiB/s 1.30 ms 349.17 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 7/s 6/s 155 KiB/s 135 KiB/s 1.32 ms 357.23 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 5/s 172 KiB/s 83 KiB/s 1.32 ms 259.85 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 7/s 5/s 178 KiB/s 123 KiB/s 1.24 ms 256.95 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 7/s 5/s 168 KiB/s 115 KiB/s 1.26 ms 419.77 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 7/s 5/s 198 KiB/s 114 KiB/s 1.52 ms 271.64 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 7/s 6/s 189 KiB/s 150 KiB/s 1.29 ms 289.01 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 7/s 6/s 176 KiB/s 138 KiB/s 1.32 ms 376.57 us 2024-03-25T09:26:44.872 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 6/s 6/s 150 KiB/s 141 KiB/s 1.27 ms 278.70 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 5/s 126 KiB/s 97 KiB/s 1.32 ms 333.99 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 6/s 177 KiB/s 142 KiB/s 1.33 ms 251.23 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 6/s 183 KiB/s 154 KiB/s 1.24 ms 276.64 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 5/s 158 KiB/s 133 KiB/s 1.26 ms 291.17 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 5/s 182 KiB/s 103 KiB/s 1.28 ms 290.39 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 5/s 167 KiB/s 137 KiB/s 1.23 ms 276.25 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 6/s 160 KiB/s 135 KiB/s 1.19 ms 295.23 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 7/s 166 KiB/s 186 KiB/s 1.31 ms 249.70 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 6/s 158 KiB/s 154 KiB/s 1.31 ms 280.76 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 4/s 166 KiB/s 94 KiB/s 1.33 ms 280.87 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 6/s 161 KiB/s 165 KiB/s 1.35 ms 280.33 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 5/s 123 KiB/s 141 KiB/s 1.28 ms 326.53 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 6/s 5/s 162 KiB/s 139 KiB/s 1.33 ms 294.68 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 4/s 157 KiB/s 97 KiB/s 1.35 ms 259.04 us 2024-03-25T09:26:44.873 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 5/s 182 KiB/s 145 KiB/s 1.25 ms 319.63 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 6/s 147 KiB/s 134 KiB/s 1.47 ms 348.17 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 6/s 148 KiB/s 202 KiB/s 1.33 ms 314.29 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 6/s 125 KiB/s 147 KiB/s 1.26 ms 266.46 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 6/s 159 KiB/s 158 KiB/s 1.46 ms 317.09 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 6/s 157 KiB/s 149 KiB/s 1.31 ms 267.42 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 7/s 148 KiB/s 150 KiB/s 1.37 ms 284.87 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 7/s 134 KiB/s 156 KiB/s 1.35 ms 307.53 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 7/s 159 KiB/s 166 KiB/s 1.28 ms 321.24 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 5/s 178 KiB/s 116 KiB/s 1.28 ms 249.71 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 7/s 174 KiB/s 148 KiB/s 1.35 ms 299.68 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 5/s 118 KiB/s 144 KiB/s 1.27 ms 280.30 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 6/s 142 KiB/s 150 KiB/s 1.36 ms 358.38 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 7/s 155 KiB/s 178 KiB/s 1.33 ms 364.86 us 2024-03-25T09:26:44.874 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 6/s 147 KiB/s 149 KiB/s 1.28 ms 339.66 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 6/s 110 KiB/s 170 KiB/s 1.28 ms 435.78 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 7/s 124 KiB/s 165 KiB/s 1.29 ms 304.56 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 6/s 110 KiB/s 132 KiB/s 1.21 ms 252.93 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 7/s 131 KiB/s 145 KiB/s 1.32 ms 288.63 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 7/s 126 KiB/s 174 KiB/s 1.29 ms 266.00 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 5/s 129 KiB/s 119 KiB/s 1.34 ms 247.50 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 7/s 141 KiB/s 181 KiB/s 1.26 ms 312.16 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 7/s 138 KiB/s 165 KiB/s 1.32 ms 265.37 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 7/s 120 KiB/s 158 KiB/s 1.24 ms 280.90 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 7/s 125 KiB/s 183 KiB/s 1.26 ms 322.89 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 7/s 128 KiB/s 189 KiB/s 1.32 ms 314.22 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 5/s 110 KiB/s 140 KiB/s 1.32 ms 376.43 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 8/s 106 KiB/s 208 KiB/s 1.30 ms 322.84 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 7/s 99 KiB/s 177 KiB/s 1.34 ms 299.62 us 2024-03-25T09:26:44.875 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 7/s 100 KiB/s 186 KiB/s 1.30 ms 269.78 us 2024-03-25T09:26:44.876 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:45.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:45.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:45.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:46.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-mon[29386]: pgmap v529: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.0 MiB/s wr, 719 op/s 2024-03-25T09:26:46.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:46.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:46.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:46.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:46.297 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:46.297 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:46.297 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:46.297 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 317 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:46 smithi059 ceph-mon[32732]: pgmap v529: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.0 MiB/s wr, 719 op/s 2024-03-25T09:26:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:46 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:46 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:46 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:46 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:46 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:46 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:46 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:46.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:46 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 317 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:46 smithi040 ceph-mon[33094]: pgmap v529: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.0 MiB/s wr, 719 op/s 2024-03-25T09:26:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:46 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:46 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:46 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:46 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:46 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:46.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:46 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:46.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:46 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:46.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:46 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 317 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:46.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:46.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:46.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:47.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:47.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:47.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:47.794+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:48 smithi059 ceph-mon[32732]: pgmap v530: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 826 op/s 2024-03-25T09:26:48.308 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:48 smithi019 ceph-mon[29386]: pgmap v530: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 826 op/s 2024-03-25T09:26:48.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:48 smithi040 ceph-mon[33094]: pgmap v530: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 826 op/s 2024-03-25T09:26:48.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:48.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:48.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:49.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:26:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 125.2k 180.0k 0.0k 1.2M 1.8M 0.0k nvme2n1 2024-03-25T09:26:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 142.0k 168.0k 0.0k 1.4M 1.6M 0.0k nvme2n10 2024-03-25T09:26:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 149.6k 110.4k 0.0k 1.5M 1.1M 0.0k nvme2n11 2024-03-25T09:26:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 153.6k 119.6k 0.0k 1.5M 1.2M 0.0k nvme2n12 2024-03-25T09:26:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 178.8k 139.6k 0.0k 1.7M 1.4M 0.0k nvme2n13 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 180.4k 147.6k 0.0k 1.8M 1.4M 0.0k nvme2n14 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 179.2k 127.2k 0.0k 1.8M 1.2M 0.0k nvme2n15 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 161.2k 148.4k 0.0k 1.6M 1.4M 0.0k nvme2n16 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 152.8k 141.6k 0.0k 1.5M 1.4M 0.0k nvme2n17 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 139.2k 141.2k 0.0k 1.4M 1.4M 0.0k nvme2n18 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 145.2k 124.4k 0.0k 1.4M 1.2M 0.0k nvme2n19 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 154.8k 102.0k 0.0k 1.5M 1020.0k 0.0k nvme2n2 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 173.2k 115.6k 0.0k 1.7M 1.1M 0.0k nvme2n20 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 151.2k 123.2k 0.0k 1.5M 1.2M 0.0k nvme2n3 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 172.4k 138.8k 0.0k 1.7M 1.4M 0.0k nvme2n4 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 135.6k 153.2k 0.0k 1.3M 1.5M 0.0k nvme2n5 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 158.0k 141.2k 0.0k 1.5M 1.4M 0.0k nvme2n6 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 156.4k 138.4k 0.0k 1.5M 1.4M 0.0k nvme2n7 2024-03-25T09:26:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 146.4k 154.8k 0.0k 1.4M 1.5M 0.0k nvme2n8 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 130.0k 129.2k 0.0k 1.3M 1.3M 0.0k nvme2n9 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 115.6k 184.4k 0.0k 1.1M 1.8M 0.0k nvme5n1 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 141.2k 149.6k 0.0k 1.4M 1.5M 0.0k nvme5n10 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 145.6k 153.6k 0.0k 1.4M 1.5M 0.0k nvme5n11 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 133.2k 130.0k 0.0k 1.3M 1.3M 0.0k nvme5n12 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 136.4k 139.6k 0.0k 1.3M 1.4M 0.0k nvme5n13 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 154.8k 153.6k 0.0k 1.5M 1.5M 0.0k nvme5n14 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 140.0k 136.8k 0.0k 1.4M 1.3M 0.0k nvme5n15 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 136.8k 152.8k 0.0k 1.3M 1.5M 0.0k nvme5n16 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 184.0k 143.6k 0.0k 1.8M 1.4M 0.0k nvme5n17 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 147.6k 158.0k 0.0k 1.4M 1.5M 0.0k nvme5n18 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 134.4k 157.6k 0.0k 1.3M 1.5M 0.0k nvme5n19 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 155.6k 141.2k 0.0k 1.5M 1.4M 0.0k nvme5n2 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 123.2k 165.2k 0.0k 1.2M 1.6M 0.0k nvme5n20 2024-03-25T09:26:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 136.8k 156.0k 0.0k 1.3M 1.5M 0.0k nvme5n3 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 156.8k 130.8k 0.0k 1.5M 1.3M 0.0k nvme5n4 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 122.4k 162.8k 0.0k 1.2M 1.6M 0.0k nvme5n5 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 167.2k 127.2k 0.0k 1.6M 1.2M 0.0k nvme5n6 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 176.4k 146.4k 0.0k 1.7M 1.4M 0.0k nvme5n7 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 152.0k 168.8k 0.0k 1.5M 1.6M 0.0k nvme5n8 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 146.0k 168.4k 0.0k 1.4M 1.6M 0.0k nvme5n9 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 132.8k 149.6k 0.0k 1.3M 1.5M 0.0k nvme8n1 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 149.2k 139.6k 0.0k 1.5M 1.4M 0.0k nvme8n10 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 137.2k 157.2k 0.0k 1.3M 1.5M 0.0k nvme8n11 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 163.6k 116.4k 0.0k 1.6M 1.1M 0.0k nvme8n12 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 140.8k 159.2k 0.0k 1.4M 1.6M 0.0k nvme8n13 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 132.0k 125.2k 0.0k 1.3M 1.2M 0.0k nvme8n14 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 158.8k 157.6k 0.0k 1.6M 1.5M 0.0k nvme8n15 2024-03-25T09:26:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 112.8k 173.6k 0.0k 1.1M 1.7M 0.0k nvme8n16 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 145.2k 125.2k 0.0k 1.4M 1.2M 0.0k nvme8n17 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 152.4k 150.8k 0.0k 1.5M 1.5M 0.0k nvme8n18 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 83.6k 198.8k 0.0k 836.0k 1.9M 0.0k nvme8n19 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 152.0k 134.4k 0.0k 1.5M 1.3M 0.0k nvme8n2 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 178.4k 151.2k 0.0k 1.7M 1.5M 0.0k nvme8n20 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.80 131.6k 143.2k 0.0k 1.3M 1.4M 0.0k nvme8n3 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 146.0k 133.2k 0.0k 1.4M 1.3M 0.0k nvme8n4 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 161.2k 118.4k 0.0k 1.6M 1.2M 0.0k nvme8n5 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 121.2k 164.8k 0.0k 1.2M 1.6M 0.0k nvme8n6 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 137.2k 140.0k 0.0k 1.3M 1.4M 0.0k nvme8n7 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 154.4k 116.4k 0.0k 1.5M 1.1M 0.0k nvme8n8 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.70 160.8k 143.6k 0.0k 1.6M 1.4M 0.0k nvme8n9 2024-03-25T09:26:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:49.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:49.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:49.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:49.875 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 8/s 4/s 219 KiB/s 82 KiB/s 1.31 ms 254.40 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 8/s 5/s 166 KiB/s 135 KiB/s 1.38 ms 403.85 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 6/s 175 KiB/s 162 KiB/s 1.31 ms 275.11 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 7/s 4/s 174 KiB/s 125 KiB/s 1.32 ms 365.52 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 7/s 5/s 198 KiB/s 106 KiB/s 1.46 ms 265.70 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 7/s 6/s 186 KiB/s 153 KiB/s 1.37 ms 404.32 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 7/s 6/s 134 KiB/s 118 KiB/s 1.36 ms 323.51 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 7/s 4/s 172 KiB/s 92 KiB/s 1.26 ms 319.20 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 7/s 6/s 170 KiB/s 166 KiB/s 1.35 ms 305.77 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 7/s 5/s 153 KiB/s 117 KiB/s 1.33 ms 260.38 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 7/s 5/s 165 KiB/s 102 KiB/s 1.33 ms 304.33 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 6/s 143 KiB/s 153 KiB/s 1.36 ms 264.32 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 7/s 5/s 188 KiB/s 119 KiB/s 1.37 ms 277.77 us 2024-03-25T09:26:49.876 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 7/s 5/s 162 KiB/s 103 KiB/s 1.42 ms 271.00 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 7/s 6/s 166 KiB/s 134 KiB/s 1.24 ms 286.56 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 7/s 6/s 190 KiB/s 129 KiB/s 1.34 ms 264.83 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 6/s 135 KiB/s 154 KiB/s 1.40 ms 306.14 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 6/s 175 KiB/s 203 KiB/s 1.24 ms 288.10 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 6/s 159 KiB/s 179 KiB/s 1.32 ms 283.48 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 6/s 164 KiB/s 148 KiB/s 1.33 ms 287.73 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 7/s 164 KiB/s 165 KiB/s 1.34 ms 265.73 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 6/s 137 KiB/s 140 KiB/s 1.30 ms 291.43 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 6/s 6/s 152 KiB/s 146 KiB/s 1.38 ms 269.25 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 5/s 149 KiB/s 127 KiB/s 1.34 ms 333.49 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 6/s 123 KiB/s 123 KiB/s 1.33 ms 308.01 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 7/s 155 KiB/s 179 KiB/s 1.22 ms 287.54 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 6/s 157 KiB/s 151 KiB/s 1.33 ms 373.33 us 2024-03-25T09:26:49.877 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 6/s 167 KiB/s 134 KiB/s 1.29 ms 282.55 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 7/s 157 KiB/s 152 KiB/s 1.53 ms 324.13 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 6/s 90 KiB/s 150 KiB/s 1.24 ms 282.22 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 6/s 5/s 152 KiB/s 122 KiB/s 1.33 ms 297.48 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 7/s 134 KiB/s 155 KiB/s 1.36 ms 271.47 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 7/s 148 KiB/s 171 KiB/s 1.41 ms 283.18 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 7/s 123 KiB/s 140 KiB/s 1.29 ms 261.18 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 5/s 115 KiB/s 95 KiB/s 1.31 ms 257.80 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 5/s 158 KiB/s 134 KiB/s 1.33 ms 292.05 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 6/s 169 KiB/s 178 KiB/s 1.35 ms 326.67 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 7/s 126 KiB/s 158 KiB/s 1.39 ms 312.18 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 6/s 136 KiB/s 153 KiB/s 1.38 ms 347.82 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 6/s 118 KiB/s 174 KiB/s 1.34 ms 273.88 us 2024-03-25T09:26:49.878 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 6/s 128 KiB/s 133 KiB/s 1.39 ms 341.27 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 4/s 183 KiB/s 104 KiB/s 1.35 ms 264.88 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 6/s 145 KiB/s 153 KiB/s 1.36 ms 287.95 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 7/s 148 KiB/s 155 KiB/s 1.35 ms 300.23 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 5/s 144 KiB/s 134 KiB/s 1.28 ms 282.34 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 6/s 6/s 113 KiB/s 125 KiB/s 1.36 ms 369.37 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 6/s 143 KiB/s 136 KiB/s 1.34 ms 279.50 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 6/s 113 KiB/s 142 KiB/s 1.35 ms 314.51 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 6/s 130 KiB/s 170 KiB/s 1.33 ms 279.84 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 7/s 129 KiB/s 146 KiB/s 1.28 ms 256.14 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 7/s 123 KiB/s 133 KiB/s 1.40 ms 298.49 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 6/s 133 KiB/s 141 KiB/s 1.24 ms 247.09 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 6/s 114 KiB/s 178 KiB/s 1.44 ms 323.05 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 6/s 78 KiB/s 173 KiB/s 1.30 ms 314.84 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 7/s 106 KiB/s 151 KiB/s 1.38 ms 280.37 us 2024-03-25T09:26:49.879 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 5/s 103 KiB/s 147 KiB/s 1.27 ms 310.25 us 2024-03-25T09:26:49.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 8/s 129 KiB/s 222 KiB/s 1.32 ms 287.14 us 2024-03-25T09:26:49.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 7/s 79 KiB/s 150 KiB/s 1.29 ms 267.84 us 2024-03-25T09:26:49.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 8/s 116 KiB/s 214 KiB/s 1.39 ms 323.27 us 2024-03-25T09:26:49.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 8/s 121 KiB/s 205 KiB/s 1.23 ms 418.25 us 2024-03-25T09:26:49.880 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:50.320 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:50 smithi019 ceph-mon[29386]: pgmap v531: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.9 MiB/s wr, 751 op/s 2024-03-25T09:26:50.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:50 smithi059 ceph-mon[32732]: pgmap v531: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.9 MiB/s wr, 751 op/s 2024-03-25T09:26:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:50 smithi040 ceph-mon[33094]: pgmap v531: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.9 MiB/s wr, 751 op/s 2024-03-25T09:26:50.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:50.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:50.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:51.290 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:51.290 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:51.290 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:51.290 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:51.290 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:51.290 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:51.290 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:51.290 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 322 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:51.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:51 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:51.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:51 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:51.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:51 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:51.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:51 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:51.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:51 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:51.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:51 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:51.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:51 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:51.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:51 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 322 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:51 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:51.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:51 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:51.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:51 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:51.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:51 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:51.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:51 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:51.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:51 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:51.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:51 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:51.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:51 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 322 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:51.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:51.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:51.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:52.333 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:52 smithi019 ceph-mon[29386]: pgmap v532: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.4 MiB/s wr, 732 op/s 2024-03-25T09:26:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:52 smithi059 ceph-mon[32732]: pgmap v532: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.4 MiB/s wr, 732 op/s 2024-03-25T09:26:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:52 smithi040 ceph-mon[33094]: pgmap v532: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.4 MiB/s wr, 732 op/s 2024-03-25T09:26:52.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:52.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:52.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:53.046 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:52.795+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:53.302 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:53 smithi040 ceph-mon[33094]: pgmap v533: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 MiB/s rd, 9.3 MiB/s wr, 830 op/s 2024-03-25T09:26:53.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:53 smithi019 ceph-mon[29386]: pgmap v533: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 MiB/s rd, 9.3 MiB/s wr, 830 op/s 2024-03-25T09:26:53.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:53 smithi059 ceph-mon[32732]: pgmap v533: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 MiB/s rd, 9.3 MiB/s wr, 830 op/s 2024-03-25T09:26:53.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:53.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:53.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:54.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:54.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:54.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:54.879 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 7/s 5/s 186 KiB/s 94 KiB/s 1.39 ms 247.06 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 7/s 7/s 178 KiB/s 141 KiB/s 1.53 ms 299.39 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 7/s 5/s 159 KiB/s 90 KiB/s 1.31 ms 246.89 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 7/s 5/s 194 KiB/s 124 KiB/s 1.30 ms 323.82 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 7/s 6/s 179 KiB/s 164 KiB/s 1.43 ms 328.31 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 7/s 6/s 157 KiB/s 130 KiB/s 1.37 ms 286.16 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 7/s 5/s 154 KiB/s 125 KiB/s 1.35 ms 360.78 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 7/s 6/s 155 KiB/s 137 KiB/s 1.32 ms 265.36 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 7/s 5/s 143 KiB/s 115 KiB/s 1.27 ms 382.11 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 7/s 6/s 163 KiB/s 140 KiB/s 1.49 ms 323.32 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 7/s 7/s 178 KiB/s 166 KiB/s 1.33 ms 301.90 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 7/s 5/s 159 KiB/s 121 KiB/s 1.36 ms 245.99 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 7/s 5/s 193 KiB/s 143 KiB/s 1.43 ms 285.63 us 2024-03-25T09:26:54.880 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 5/s 181 KiB/s 140 KiB/s 1.42 ms 363.87 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 5/s 136 KiB/s 95 KiB/s 1.30 ms 249.02 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 7/s 6/s 147 KiB/s 133 KiB/s 1.37 ms 235.32 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 7/s 7/s 174 KiB/s 141 KiB/s 1.25 ms 337.02 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 5/s 122 KiB/s 92 KiB/s 1.49 ms 282.25 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 7/s 158 KiB/s 122 KiB/s 1.31 ms 285.19 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 7/s 173 KiB/s 194 KiB/s 1.41 ms 279.00 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 7/s 142 KiB/s 141 KiB/s 1.29 ms 258.79 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 6/s 195 KiB/s 103 KiB/s 1.31 ms 291.54 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 6/s 174 KiB/s 120 KiB/s 1.40 ms 276.75 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 6/s 115 KiB/s 142 KiB/s 1.37 ms 283.41 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 7/s 146 KiB/s 157 KiB/s 1.31 ms 304.68 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 5/s 141 KiB/s 113 KiB/s 1.34 ms 285.64 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 5/s 162 KiB/s 103 KiB/s 1.35 ms 301.96 us 2024-03-25T09:26:54.881 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 5/s 126 KiB/s 150 KiB/s 1.34 ms 303.87 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 6/s 5/s 122 KiB/s 120 KiB/s 1.46 ms 274.24 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 4/s 138 KiB/s 79 KiB/s 1.33 ms 241.54 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 6/s 118 KiB/s 142 KiB/s 1.33 ms 285.87 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 8/s 147 KiB/s 160 KiB/s 1.34 ms 354.16 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 6/s 130 KiB/s 149 KiB/s 1.33 ms 278.53 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 5/s 145 KiB/s 104 KiB/s 1.36 ms 253.71 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 6/s 111 KiB/s 109 KiB/s 1.25 ms 236.64 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 6/s 143 KiB/s 134 KiB/s 1.39 ms 296.89 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 6/s 139 KiB/s 141 KiB/s 1.38 ms 260.05 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 6/s 100 KiB/s 160 KiB/s 1.31 ms 276.83 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 6/s 131 KiB/s 143 KiB/s 1.36 ms 324.41 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 6/s 7/s 162 KiB/s 152 KiB/s 1.34 ms 290.10 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 6/s 142 KiB/s 161 KiB/s 1.41 ms 266.37 us 2024-03-25T09:26:54.882 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 6/s 7/s 164 KiB/s 167 KiB/s 1.43 ms 288.88 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 7/s 106 KiB/s 160 KiB/s 1.30 ms 264.35 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 6/s 125 KiB/s 150 KiB/s 1.24 ms 293.54 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 6/s 118 KiB/s 146 KiB/s 1.38 ms 340.11 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 7/s 128 KiB/s 146 KiB/s 1.34 ms 299.20 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 7/s 101 KiB/s 137 KiB/s 1.21 ms 331.15 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 7/s 90 KiB/s 151 KiB/s 1.22 ms 296.24 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 7/s 112 KiB/s 142 KiB/s 1.34 ms 287.10 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 7/s 114 KiB/s 156 KiB/s 1.33 ms 297.12 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 7/s 142 KiB/s 174 KiB/s 1.42 ms 316.39 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 6/s 136 KiB/s 119 KiB/s 1.25 ms 310.34 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 6/s 118 KiB/s 116 KiB/s 1.33 ms 290.01 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 8/s 118 KiB/s 182 KiB/s 1.44 ms 264.97 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 7/s 109 KiB/s 155 KiB/s 1.44 ms 316.34 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 5/s 94 KiB/s 130 KiB/s 1.32 ms 389.99 us 2024-03-25T09:26:54.883 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 8/s 90 KiB/s 182 KiB/s 1.27 ms 290.44 us 2024-03-25T09:26:54.884 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 8/s 98 KiB/s 158 KiB/s 1.44 ms 340.44 us 2024-03-25T09:26:54.884 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 7/s 74 KiB/s 149 KiB/s 1.34 ms 253.22 us 2024-03-25T09:26:54.884 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 7/s 67 KiB/s 142 KiB/s 1.37 ms 263.20 us 2024-03-25T09:26:54.884 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:55.314 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-mon[33094]: pgmap v534: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 715 op/s 2024-03-25T09:26:55.314 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:55.314 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-mon[33094]: { 2024-03-25T09:26:55.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:26:55.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:26:55.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:26:55.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:26:55.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:26:55.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:55 smithi019 ceph-mon[29386]: pgmap v534: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 715 op/s 2024-03-25T09:26:55.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:55 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:55.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:55 smithi019 ceph-mon[29386]: { 2024-03-25T09:26:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:55 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:26:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:55 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:26:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:55 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:26:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:55 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:26:55.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:55 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:26:55.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:55 smithi059 ceph-mon[32732]: pgmap v534: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 715 op/s 2024-03-25T09:26:55.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:55 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:26:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:55 smithi059 ceph-mon[32732]: { 2024-03-25T09:26:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:55 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:26:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:55 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:26:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:55 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:26:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:55 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:26:55.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:55 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:26:55.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:55.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:55.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:56.364 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:56 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 327 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:56.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:56 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 327 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:56 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 327 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:26:56.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:56.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:56.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:57.326 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:57 smithi040 ceph-mon[33094]: pgmap v535: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.7 MiB/s rd, 8.7 MiB/s wr, 821 op/s 2024-03-25T09:26:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:57 smithi019 ceph-mon[29386]: pgmap v535: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.7 MiB/s rd, 8.7 MiB/s wr, 821 op/s 2024-03-25T09:26:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:57 smithi059 ceph-mon[32732]: pgmap v535: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.7 MiB/s rd, 8.7 MiB/s wr, 821 op/s 2024-03-25T09:26:57.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:57.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:57.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:26:57.795+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:26:58.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:58.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:26:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:58.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:26:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:59.338 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:26:59 smithi040 ceph-mon[33094]: pgmap v536: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 752 op/s 2024-03-25T09:26:59.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:26:59 smithi019 ceph-mon[29386]: pgmap v536: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 752 op/s 2024-03-25T09:26:59.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:26:59 smithi059 ceph-mon[32732]: pgmap v536: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 752 op/s 2024-03-25T09:26:59.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:26:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 120.0k 149.2k 0.0k 1.2M 1.5M 0.0k nvme2n1 2024-03-25T09:26:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 106.4k 160.4k 0.0k 1.0M 1.6M 0.0k nvme2n10 2024-03-25T09:26:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 115.6k 130.0k 0.0k 1.1M 1.3M 0.0k nvme2n11 2024-03-25T09:26:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 150.0k 102.4k 0.0k 1.5M 1.0M 0.0k nvme2n12 2024-03-25T09:26:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 120.8k 118.0k 0.0k 1.2M 1.2M 0.0k nvme2n13 2024-03-25T09:26:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 131.2k 116.0k 0.0k 1.3M 1.1M 0.0k nvme2n14 2024-03-25T09:26:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 122.0k 134.4k 0.0k 1.2M 1.3M 0.0k nvme2n15 2024-03-25T09:26:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 149.2k 115.2k 0.0k 1.5M 1.1M 0.0k nvme2n16 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 130.0k 102.4k 0.0k 1.3M 1.0M 0.0k nvme2n17 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 138.4k 141.6k 0.0k 1.4M 1.4M 0.0k nvme2n18 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 120.0k 130.0k 0.0k 1.2M 1.3M 0.0k nvme2n19 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 147.6k 126.0k 0.0k 1.4M 1.2M 0.0k nvme2n2 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 139.2k 124.8k 0.0k 1.4M 1.2M 0.0k nvme2n20 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 129.6k 125.6k 0.0k 1.3M 1.2M 0.0k nvme2n3 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 136.0k 108.4k 0.0k 1.3M 1.1M 0.0k nvme2n4 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 146.4k 107.2k 0.0k 1.4M 1.0M 0.0k nvme2n5 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 133.2k 120.8k 0.0k 1.3M 1.2M 0.0k nvme2n6 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 146.8k 133.6k 0.0k 1.4M 1.3M 0.0k nvme2n7 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 134.0k 168.8k 0.0k 1.3M 1.6M 0.0k nvme2n8 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 124.8k 132.8k 0.0k 1.2M 1.3M 0.0k nvme2n9 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 103.6k 143.2k 0.0k 1.0M 1.4M 0.0k nvme5n1 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 159.6k 125.2k 0.0k 1.6M 1.2M 0.0k nvme5n10 2024-03-25T09:26:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 124.4k 134.8k 0.0k 1.2M 1.3M 0.0k nvme5n11 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 136.8k 153.6k 0.0k 1.3M 1.5M 0.0k nvme5n12 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 101.2k 123.6k 0.0k 1012.0k 1.2M 0.0k nvme5n13 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 134.4k 108.4k 0.0k 1.3M 1.1M 0.0k nvme5n14 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 145.2k 120.0k 0.0k 1.4M 1.2M 0.0k nvme5n15 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 118.4k 117.2k 0.0k 1.2M 1.1M 0.0k nvme5n16 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 93.2k 126.4k 0.0k 932.0k 1.2M 0.0k nvme5n17 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 139.6k 120.4k 0.0k 1.4M 1.2M 0.0k nvme5n18 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 103.6k 120.4k 0.0k 1.0M 1.2M 0.0k nvme5n19 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 130.0k 136.0k 0.0k 1.3M 1.3M 0.0k nvme5n2 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 114.0k 180.8k 0.0k 1.1M 1.8M 0.0k nvme5n20 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 146.4k 108.4k 0.0k 1.4M 1.1M 0.0k nvme5n3 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 134.4k 119.2k 0.0k 1.3M 1.2M 0.0k nvme5n4 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 136.4k 140.8k 0.0k 1.3M 1.4M 0.0k nvme5n5 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 97.6k 154.4k 0.0k 976.0k 1.5M 0.0k nvme5n6 2024-03-25T09:26:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 112.8k 131.6k 0.0k 1.1M 1.3M 0.0k nvme5n7 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 140.4k 142.8k 0.0k 1.4M 1.4M 0.0k nvme5n8 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 113.6k 146.4k 0.0k 1.1M 1.4M 0.0k nvme5n9 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 130.8k 133.2k 0.0k 1.3M 1.3M 0.0k nvme8n1 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 134.4k 124.4k 0.0k 1.3M 1.2M 0.0k nvme8n10 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 135.2k 101.2k 0.0k 1.3M 1012.0k 0.0k nvme8n11 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 160.0k 94.0k 0.0k 1.6M 940.0k 0.0k nvme8n12 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 124.4k 113.2k 0.0k 1.2M 1.1M 0.0k nvme8n13 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 124.4k 133.2k 0.0k 1.2M 1.3M 0.0k nvme8n14 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 102.4k 159.6k 0.0k 1.0M 1.6M 0.0k nvme8n15 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 104.4k 126.0k 0.0k 1.0M 1.2M 0.0k nvme8n16 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 147.6k 87.2k 0.0k 1.4M 872.0k 0.0k nvme8n17 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 124.8k 132.8k 0.0k 1.2M 1.3M 0.0k nvme8n18 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 144.4k 137.6k 0.0k 1.4M 1.3M 0.0k nvme8n19 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 156.8k 99.6k 0.0k 1.5M 996.0k 0.0k nvme8n2 2024-03-25T09:26:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 129.6k 114.4k 0.0k 1.3M 1.1M 0.0k nvme8n20 2024-03-25T09:26:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 98.0k 116.0k 0.0k 980.0k 1.1M 0.0k nvme8n3 2024-03-25T09:26:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 123.2k 114.4k 0.0k 1.2M 1.1M 0.0k nvme8n4 2024-03-25T09:26:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 114.0k 127.6k 0.0k 1.1M 1.2M 0.0k nvme8n5 2024-03-25T09:26:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 131.2k 120.4k 0.0k 1.3M 1.2M 0.0k nvme8n6 2024-03-25T09:26:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 116.0k 136.0k 0.0k 1.1M 1.3M 0.0k nvme8n7 2024-03-25T09:26:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 107.2k 143.2k 0.0k 1.0M 1.4M 0.0k nvme8n8 2024-03-25T09:26:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.50 126.4k 110.0k 0.0k 1.2M 1.1M 0.0k nvme8n9 2024-03-25T09:26:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:26:59.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:26:59.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:26:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:26:59.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:26:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:26:59.884 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:26:59.884 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 8/s 4/s 146 KiB/s 82 KiB/s 1.37 ms 268.57 us 2024-03-25T09:26:59.884 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 7/s 5/s 159 KiB/s 95 KiB/s 1.28 ms 256.26 us 2024-03-25T09:26:59.884 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 7/s 5/s 138 KiB/s 84 KiB/s 1.47 ms 268.09 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 7/s 5/s 194 KiB/s 92 KiB/s 1.47 ms 282.50 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 7/s 4/s 134 KiB/s 73 KiB/s 1.41 ms 331.32 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 7/s 6/s 111 KiB/s 113 KiB/s 1.36 ms 348.58 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 7/s 7/s 139 KiB/s 174 KiB/s 1.31 ms 308.08 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 5/s 126 KiB/s 128 KiB/s 1.34 ms 290.53 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 7/s 6/s 162 KiB/s 138 KiB/s 1.49 ms 275.78 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 7/s 6/s 133 KiB/s 143 KiB/s 1.27 ms 360.49 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 7/s 5/s 166 KiB/s 105 KiB/s 1.38 ms 278.58 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 7/s 5/s 172 KiB/s 113 KiB/s 1.34 ms 272.79 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 5/s 171 KiB/s 107 KiB/s 1.37 ms 329.00 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 5/s 129 KiB/s 105 KiB/s 1.33 ms 289.94 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 5/s 163 KiB/s 94 KiB/s 1.33 ms 289.78 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 5/s 119 KiB/s 102 KiB/s 1.39 ms 254.97 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 6/s 139 KiB/s 119 KiB/s 1.37 ms 257.37 us 2024-03-25T09:26:59.885 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 5/s 150 KiB/s 110 KiB/s 1.29 ms 258.99 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 6/s 150 KiB/s 156 KiB/s 1.36 ms 255.63 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 6/s 118 KiB/s 125 KiB/s 1.37 ms 293.80 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 6/s 120 KiB/s 135 KiB/s 1.44 ms 330.69 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 6/s 136 KiB/s 127 KiB/s 1.34 ms 359.71 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 6/s 150 KiB/s 156 KiB/s 1.34 ms 304.76 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 6/s 118 KiB/s 98 KiB/s 1.32 ms 285.96 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 6/s 130 KiB/s 111 KiB/s 1.40 ms 286.34 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 6/s 108 KiB/s 118 KiB/s 1.40 ms 327.02 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 6/s 131 KiB/s 106 KiB/s 1.36 ms 257.74 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 8/s 103 KiB/s 144 KiB/s 1.40 ms 270.63 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 5/s 116 KiB/s 95 KiB/s 1.61 ms 274.76 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 7/s 140 KiB/s 156 KiB/s 1.28 ms 276.18 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 7/s 109 KiB/s 148 KiB/s 1.47 ms 283.72 us 2024-03-25T09:26:59.886 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 8/s 121 KiB/s 169 KiB/s 1.41 ms 299.71 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 7/s 140 KiB/s 122 KiB/s 1.42 ms 303.76 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 6/s 120 KiB/s 147 KiB/s 1.41 ms 324.76 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 7/s 96 KiB/s 128 KiB/s 1.33 ms 317.37 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 6/s 94 KiB/s 130 KiB/s 1.36 ms 255.26 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 6/s 97 KiB/s 138 KiB/s 1.32 ms 298.35 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 6/s 90 KiB/s 155 KiB/s 1.44 ms 289.24 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 5/s 111 KiB/s 106 KiB/s 1.43 ms 267.87 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 6/s 114 KiB/s 135 KiB/s 1.36 ms 319.10 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 6/s 129 KiB/s 143 KiB/s 1.40 ms 277.49 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 4/s 117 KiB/s 126 KiB/s 1.32 ms 425.36 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 8/s 126 KiB/s 165 KiB/s 1.42 ms 267.77 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 6/s 101 KiB/s 122 KiB/s 1.46 ms 324.50 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 7/s 121 KiB/s 166 KiB/s 1.36 ms 289.23 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 6/s 129 KiB/s 126 KiB/s 1.37 ms 362.21 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 6/s 111 KiB/s 143 KiB/s 1.42 ms 293.74 us 2024-03-25T09:26:59.887 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 5/s 120 KiB/s 119 KiB/s 1.28 ms 282.27 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 7/s 122 KiB/s 176 KiB/s 1.40 ms 281.28 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 7/s 134 KiB/s 182 KiB/s 1.35 ms 279.54 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 7/s 98 KiB/s 160 KiB/s 1.52 ms 318.47 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 7/s 98 KiB/s 135 KiB/s 1.36 ms 319.59 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 7/s 106 KiB/s 136 KiB/s 1.31 ms 254.53 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 6/s 126 KiB/s 149 KiB/s 1.40 ms 376.42 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 8/s 74 KiB/s 142 KiB/s 1.38 ms 286.27 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 7/s 86 KiB/s 129 KiB/s 1.29 ms 302.59 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 6/s 89 KiB/s 116 KiB/s 1.40 ms 264.08 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 7/s 102 KiB/s 133 KiB/s 1.40 ms 305.31 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 7/s 80 KiB/s 155 KiB/s 1.36 ms 338.40 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 6/s 73 KiB/s 134 KiB/s 1.34 ms 265.38 us 2024-03-25T09:26:59.888 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:00.396 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:00 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:00.396 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:00 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:00.396 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:00 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:00.396 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:00 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:00.396 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:00 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:00.397 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:00 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:00.397 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:00 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:00 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:00 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:00 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:00 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:00.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:00 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:00 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:00.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:00 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:00 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:00 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:00 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:00 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:00 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:00 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:00.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:00 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:00.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:00.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:00.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:01.350 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:01 smithi040 ceph-mon[33094]: pgmap v537: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 7.4 MiB/s wr, 739 op/s 2024-03-25T09:27:01.351 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:01 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 337 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:01 smithi019 ceph-mon[29386]: pgmap v537: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 7.4 MiB/s wr, 739 op/s 2024-03-25T09:27:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:01 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 337 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:01.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:01 smithi059 ceph-mon[32732]: pgmap v537: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 7.4 MiB/s wr, 739 op/s 2024-03-25T09:27:01.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:01 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 337 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:01.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:01.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:01.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:02.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:02.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:02.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:03.065 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:02.795+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:03.363 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:03 smithi040 ceph-mon[33094]: pgmap v538: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.2 MiB/s wr, 830 op/s 2024-03-25T09:27:03.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:03 smithi019 ceph-mon[29386]: pgmap v538: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.2 MiB/s wr, 830 op/s 2024-03-25T09:27:03.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:03 smithi059 ceph-mon[32732]: pgmap v538: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.2 MiB/s wr, 830 op/s 2024-03-25T09:27:03.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:03.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:03.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:04.888 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 8/s 4/s 186 KiB/s 95 KiB/s 1.40 ms 262.06 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 8/s 5/s 176 KiB/s 114 KiB/s 1.49 ms 276.53 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 8/s 5/s 146 KiB/s 102 KiB/s 1.31 ms 229.16 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 8/s 5/s 132 KiB/s 72 KiB/s 1.43 ms 296.75 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 7/s 7/s 136 KiB/s 189 KiB/s 1.29 ms 283.17 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 7/s 5/s 158 KiB/s 120 KiB/s 1.30 ms 296.95 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 7/s 5/s 168 KiB/s 93 KiB/s 1.40 ms 300.06 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 7/s 5/s 154 KiB/s 127 KiB/s 1.32 ms 264.35 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 7/s 7/s 127 KiB/s 116 KiB/s 1.39 ms 275.52 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 7/s 5/s 153 KiB/s 109 KiB/s 1.41 ms 300.97 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 7/s 6/s 150 KiB/s 121 KiB/s 1.39 ms 291.20 us 2024-03-25T09:27:04.889 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 5/s 166 KiB/s 126 KiB/s 1.41 ms 300.50 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 7/s 6/s 183 KiB/s 94 KiB/s 1.40 ms 254.90 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 7/s 5/s 158 KiB/s 112 KiB/s 1.41 ms 277.86 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 7/s 7/s 122 KiB/s 148 KiB/s 1.47 ms 283.17 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 6/s 132 KiB/s 120 KiB/s 1.42 ms 276.74 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 7/s 162 KiB/s 142 KiB/s 1.38 ms 234.93 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 5/s 142 KiB/s 90 KiB/s 1.34 ms 266.81 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 6/s 148 KiB/s 130 KiB/s 1.33 ms 282.91 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 6/s 103 KiB/s 165 KiB/s 1.60 ms 298.01 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 6/s 163 KiB/s 126 KiB/s 1.43 ms 255.45 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 6/s 134 KiB/s 89 KiB/s 1.57 ms 261.51 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 5/s 131 KiB/s 114 KiB/s 1.36 ms 268.67 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 7/s 113 KiB/s 154 KiB/s 1.47 ms 274.95 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 5/s 108 KiB/s 115 KiB/s 1.41 ms 247.69 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 6/s 98 KiB/s 128 KiB/s 1.40 ms 275.06 us 2024-03-25T09:27:04.890 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 7/s 132 KiB/s 125 KiB/s 1.47 ms 329.26 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 4/s 134 KiB/s 71 KiB/s 1.37 ms 243.72 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 7/s 100 KiB/s 159 KiB/s 1.38 ms 287.27 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 6/s 7/s 101 KiB/s 162 KiB/s 1.51 ms 264.13 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 6/s 104 KiB/s 105 KiB/s 1.40 ms 252.04 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 7/s 122 KiB/s 143 KiB/s 1.41 ms 300.44 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 4/s 130 KiB/s 114 KiB/s 1.33 ms 470.49 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 6/s 121 KiB/s 150 KiB/s 1.49 ms 322.88 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 6/s 121 KiB/s 122 KiB/s 1.45 ms 268.99 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 6/s 142 KiB/s 134 KiB/s 1.36 ms 306.26 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 6/s 139 KiB/s 154 KiB/s 1.40 ms 271.47 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 6/s 106 KiB/s 110 KiB/s 1.29 ms 341.44 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 7/s 113 KiB/s 165 KiB/s 1.41 ms 274.78 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 6/s 98 KiB/s 134 KiB/s 1.34 ms 364.72 us 2024-03-25T09:27:04.891 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 6/s 133 KiB/s 124 KiB/s 1.45 ms 284.65 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 6/s 89 KiB/s 136 KiB/s 1.39 ms 306.83 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 7/s 111 KiB/s 152 KiB/s 1.34 ms 323.93 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 6/s 158 KiB/s 118 KiB/s 1.36 ms 283.10 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 7/s 122 KiB/s 134 KiB/s 1.33 ms 303.89 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 7/s 87 KiB/s 140 KiB/s 1.42 ms 283.01 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 6/s 92 KiB/s 138 KiB/s 1.40 ms 269.38 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 6/s 105 KiB/s 96 KiB/s 1.35 ms 294.13 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 6/s 98 KiB/s 127 KiB/s 1.45 ms 257.65 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 6/s 110 KiB/s 121 KiB/s 1.36 ms 288.12 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 6/s 82 KiB/s 130 KiB/s 1.37 ms 283.64 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 7/s 99 KiB/s 136 KiB/s 1.38 ms 259.54 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 5/s 108 KiB/s 119 KiB/s 1.38 ms 290.89 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 7/s 100 KiB/s 116 KiB/s 1.43 ms 323.11 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 6/s 96 KiB/s 118 KiB/s 1.33 ms 307.54 us 2024-03-25T09:27:04.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 7/s 69 KiB/s 116 KiB/s 1.38 ms 297.40 us 2024-03-25T09:27:04.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 7/s 113 KiB/s 142 KiB/s 1.39 ms 324.42 us 2024-03-25T09:27:04.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 6/s 94 KiB/s 105 KiB/s 1.34 ms 295.95 us 2024-03-25T09:27:04.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 6/s 79 KiB/s 140 KiB/s 1.40 ms 264.35 us 2024-03-25T09:27:04.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 6/s 90 KiB/s 124 KiB/s 1.43 ms 328.93 us 2024-03-25T09:27:04.893 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:04.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:04.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:04.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:05.375 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-mon[33094]: pgmap v539: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 708 op/s 2024-03-25T09:27:05.375 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:05.375 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:05.375 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:05.375 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:05.376 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:05.376 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:05.376 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:05.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:05 smithi019 ceph-mon[29386]: pgmap v539: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 708 op/s 2024-03-25T09:27:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:05 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:05 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:05 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:05 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:05 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:05 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:05.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:05 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:05 smithi059 ceph-mon[32732]: pgmap v539: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 708 op/s 2024-03-25T09:27:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:05 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:05 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:05 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:05 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:05 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:05 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:05.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:05 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:05.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:05.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:05.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:06.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:06 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 342 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:06 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 342 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:06 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 342 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:06.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:06.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:06.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:07.387 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:07 smithi040 ceph-mon[33094]: pgmap v540: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.8 MiB/s wr, 816 op/s 2024-03-25T09:27:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:07 smithi019 ceph-mon[29386]: pgmap v540: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.8 MiB/s wr, 816 op/s 2024-03-25T09:27:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:07 smithi059 ceph-mon[32732]: pgmap v540: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.8 MiB/s wr, 816 op/s 2024-03-25T09:27:07.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:07.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:07.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:08.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:07.795+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:08.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:08.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:08.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:09.399 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:09 smithi040 ceph-mon[33094]: pgmap v541: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.9 MiB/s wr, 736 op/s 2024-03-25T09:27:09.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:09 smithi019 ceph-mon[29386]: pgmap v541: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.9 MiB/s wr, 736 op/s 2024-03-25T09:27:09.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:09 smithi059 ceph-mon[32732]: pgmap v541: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.9 MiB/s wr, 736 op/s 2024-03-25T09:27:09.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:27:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 132.4k 124.8k 0.0k 1.3M 1.2M 0.0k nvme2n1 2024-03-25T09:27:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 119.6k 109.6k 0.0k 1.2M 1.1M 0.0k nvme2n10 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 105.6k 97.6k 0.0k 1.0M 976.0k 0.0k nvme2n11 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 114.0k 116.0k 0.0k 1.1M 1.1M 0.0k nvme2n12 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 115.6k 123.2k 0.0k 1.1M 1.2M 0.0k nvme2n13 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 88.0k 118.4k 0.0k 880.0k 1.2M 0.0k nvme2n14 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 139.6k 115.2k 0.0k 1.4M 1.1M 0.0k nvme2n15 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 120.0k 116.8k 0.0k 1.2M 1.1M 0.0k nvme2n16 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 134.0k 106.4k 0.0k 1.3M 1.0M 0.0k nvme2n17 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 125.2k 109.6k 0.0k 1.2M 1.1M 0.0k nvme2n18 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 125.6k 126.8k 0.0k 1.2M 1.2M 0.0k nvme2n19 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 133.2k 143.6k 0.0k 1.3M 1.4M 0.0k nvme2n2 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 159.6k 146.8k 0.0k 1.6M 1.4M 0.0k nvme2n20 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 142.0k 80.4k 0.0k 1.4M 804.0k 0.0k nvme2n3 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 121.6k 120.8k 0.0k 1.2M 1.2M 0.0k nvme2n4 2024-03-25T09:27:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 136.0k 137.2k 0.0k 1.3M 1.3M 0.0k nvme2n5 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 113.6k 112.4k 0.0k 1.1M 1.1M 0.0k nvme2n6 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 149.2k 112.8k 0.0k 1.5M 1.1M 0.0k nvme2n7 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 128.0k 128.0k 0.0k 1.2M 1.2M 0.0k nvme2n8 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 117.2k 121.6k 0.0k 1.1M 1.2M 0.0k nvme2n9 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 135.2k 116.0k 0.0k 1.3M 1.1M 0.0k nvme5n1 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 109.2k 127.2k 0.0k 1.1M 1.2M 0.0k nvme5n10 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 130.8k 96.8k 0.0k 1.3M 968.0k 0.0k nvme5n11 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 125.6k 112.4k 0.0k 1.2M 1.1M 0.0k nvme5n12 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 128.4k 117.2k 0.0k 1.3M 1.1M 0.0k nvme5n13 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 119.2k 119.6k 0.0k 1.2M 1.2M 0.0k nvme5n14 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 93.6k 121.6k 0.0k 936.0k 1.2M 0.0k nvme5n15 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 124.0k 99.6k 0.0k 1.2M 996.0k 0.0k nvme5n16 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 126.8k 138.0k 0.0k 1.2M 1.3M 0.0k nvme5n17 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 119.6k 97.6k 0.0k 1.2M 976.0k 0.0k nvme5n18 2024-03-25T09:27:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 96.8k 123.2k 0.0k 968.0k 1.2M 0.0k nvme5n19 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 127.6k 112.8k 0.0k 1.2M 1.1M 0.0k nvme5n2 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 118.8k 119.6k 0.0k 1.2M 1.2M 0.0k nvme5n20 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 117.2k 108.0k 0.0k 1.1M 1.1M 0.0k nvme5n3 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 124.4k 103.6k 0.0k 1.2M 1.0M 0.0k nvme5n4 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 137.2k 125.6k 0.0k 1.3M 1.2M 0.0k nvme5n5 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 106.8k 120.8k 0.0k 1.0M 1.2M 0.0k nvme5n6 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 175.2k 81.6k 0.0k 1.7M 816.0k 0.0k nvme5n7 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 116.0k 107.6k 0.0k 1.1M 1.1M 0.0k nvme5n8 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 157.6k 136.0k 0.0k 1.5M 1.3M 0.0k nvme5n9 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 128.4k 122.4k 0.0k 1.3M 1.2M 0.0k nvme8n1 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 135.6k 123.6k 0.0k 1.3M 1.2M 0.0k nvme8n10 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 162.0k 105.6k 0.0k 1.6M 1.0M 0.0k nvme8n11 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 116.8k 104.0k 0.0k 1.1M 1.0M 0.0k nvme8n12 2024-03-25T09:27:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 136.8k 103.6k 0.0k 1.3M 1.0M 0.0k nvme8n13 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.30 140.4k 136.0k 0.0k 1.4M 1.3M 0.0k nvme8n14 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 142.0k 91.6k 0.0k 1.4M 916.0k 0.0k nvme8n15 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 132.8k 148.8k 0.0k 1.3M 1.5M 0.0k nvme8n16 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 117.6k 113.6k 0.0k 1.1M 1.1M 0.0k nvme8n17 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 106.8k 128.0k 0.0k 1.0M 1.2M 0.0k nvme8n18 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 119.6k 120.4k 0.0k 1.2M 1.2M 0.0k nvme8n19 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 118.8k 96.8k 0.0k 1.2M 968.0k 0.0k nvme8n2 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 123.6k 138.4k 0.0k 1.2M 1.4M 0.0k nvme8n20 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 114.0k 102.0k 0.0k 1.1M 1020.0k 0.0k nvme8n3 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 126.8k 96.8k 0.0k 1.2M 968.0k 0.0k nvme8n4 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 123.6k 112.8k 0.0k 1.2M 1.1M 0.0k nvme8n5 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 112.4k 118.8k 0.0k 1.1M 1.2M 0.0k nvme8n6 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 104.4k 141.2k 0.0k 1.0M 1.4M 0.0k nvme8n7 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 161.6k 136.8k 0.0k 1.6M 1.3M 0.0k nvme8n8 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 12.40 117.6k 112.0k 0.0k 1.1M 1.1M 0.0k nvme8n9 2024-03-25T09:27:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:09.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:09.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:09.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:09.892 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:09.892 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 9/s 8/s 210 KiB/s 152 KiB/s 1.31 ms 276.84 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 8/s 8/s 166 KiB/s 137 KiB/s 1.41 ms 282.13 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 8/s 7/s 158 KiB/s 134 KiB/s 1.33 ms 256.83 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 8/s 4/s 140 KiB/s 76 KiB/s 1.33 ms 259.40 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 8/s 6/s 146 KiB/s 132 KiB/s 1.31 ms 319.29 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 7/s 5/s 148 KiB/s 117 KiB/s 1.43 ms 261.89 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 7/s 5/s 136 KiB/s 89 KiB/s 1.46 ms 242.75 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 7/s 6/s 147 KiB/s 104 KiB/s 1.44 ms 282.14 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 7/s 5/s 121 KiB/s 95 KiB/s 1.40 ms 344.30 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 7/s 8/s 138 KiB/s 162 KiB/s 1.47 ms 260.94 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 7/s 6/s 135 KiB/s 87 KiB/s 1.38 ms 354.72 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 7/s 8/s 147 KiB/s 132 KiB/s 1.42 ms 356.84 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 7/s 5/s 142 KiB/s 119 KiB/s 1.47 ms 348.72 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 5/s 153 KiB/s 127 KiB/s 1.34 ms 265.87 us 2024-03-25T09:27:09.893 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 6/s 106 KiB/s 125 KiB/s 1.32 ms 247.49 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 5/s 114 KiB/s 82 KiB/s 1.38 ms 258.23 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 6/s 124 KiB/s 142 KiB/s 1.53 ms 260.39 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 5/s 153 KiB/s 104 KiB/s 1.44 ms 258.98 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 5/s 143 KiB/s 97 KiB/s 1.32 ms 240.42 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 6/s 118 KiB/s 129 KiB/s 1.37 ms 282.26 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 5/s 106 KiB/s 104 KiB/s 1.53 ms 304.15 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 5/s 99 KiB/s 102 KiB/s 1.45 ms 313.80 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 5/s 154 KiB/s 98 KiB/s 1.29 ms 275.06 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 6/s 143 KiB/s 119 KiB/s 1.36 ms 279.19 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 6/s 131 KiB/s 125 KiB/s 1.47 ms 276.53 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 6/s 138 KiB/s 121 KiB/s 1.47 ms 268.72 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 6/s 102 KiB/s 123 KiB/s 1.38 ms 254.70 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 5/s 113 KiB/s 135 KiB/s 1.61 ms 318.91 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 6/s 7/s 140 KiB/s 134 KiB/s 1.34 ms 292.41 us 2024-03-25T09:27:09.894 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 6/s 6/s 125 KiB/s 117 KiB/s 1.35 ms 247.66 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 5/s 116 KiB/s 107 KiB/s 1.37 ms 271.45 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 6/s 121 KiB/s 125 KiB/s 1.32 ms 424.90 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 6/s 113 KiB/s 93 KiB/s 1.33 ms 295.67 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 7/s 105 KiB/s 138 KiB/s 1.34 ms 311.68 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 4/s 104 KiB/s 86 KiB/s 1.41 ms 292.34 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 8/s 91 KiB/s 180 KiB/s 1.42 ms 248.90 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 5/s 95 KiB/s 109 KiB/s 1.41 ms 317.87 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 5/s 100 KiB/s 114 KiB/s 1.39 ms 328.31 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 6/s 116 KiB/s 115 KiB/s 1.35 ms 269.05 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 6/s 117 KiB/s 118 KiB/s 1.44 ms 313.90 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 120 KiB/s 100 KiB/s 1.41 ms 283.63 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 6/s 110 KiB/s 114 KiB/s 1.42 ms 296.44 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 6/s 113 KiB/s 120 KiB/s 1.36 ms 297.33 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 7/s 90 KiB/s 108 KiB/s 1.47 ms 248.04 us 2024-03-25T09:27:09.895 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 6/s 110 KiB/s 91 KiB/s 1.35 ms 294.56 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 3/s 82 KiB/s 58 KiB/s 1.48 ms 284.91 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 6/s 75 KiB/s 133 KiB/s 1.43 ms 330.07 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 6/s 108 KiB/s 136 KiB/s 1.35 ms 273.62 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 6/s 102 KiB/s 107 KiB/s 1.44 ms 259.39 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 5/s 92 KiB/s 135 KiB/s 1.33 ms 259.49 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 103 KiB/s 93 KiB/s 1.41 ms 279.42 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 7/s 121 KiB/s 121 KiB/s 1.30 ms 373.86 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 5/s 118 KiB/s 130 KiB/s 1.34 ms 251.78 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 7/s 132 KiB/s 122 KiB/s 1.47 ms 294.12 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 7/s 94 KiB/s 135 KiB/s 1.44 ms 258.35 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 7/s 74 KiB/s 121 KiB/s 1.63 ms 299.75 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 5/s 62 KiB/s 106 KiB/s 1.50 ms 239.10 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 8/s 83 KiB/s 150 KiB/s 1.70 ms 250.01 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 7/s 62 KiB/s 113 KiB/s 1.69 ms 269.64 us 2024-03-25T09:27:09.896 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 7/s 66 KiB/s 129 KiB/s 1.50 ms 273.27 us 2024-03-25T09:27:09.897 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:10.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:10 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:10 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:10 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:10 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:10 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:10.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:10 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:10.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:10 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:10 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:10 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:10 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:10.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:10 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:10.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:10 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:10.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:10 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:10.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:10 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:10 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:10 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:10 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:10 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:10 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:10 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:10.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:10 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:10.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:10.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:10.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:11.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:11 smithi019 ceph-mon[29386]: pgmap v542: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.7 MiB/s wr, 729 op/s 2024-03-25T09:27:11.411 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:11 smithi040 ceph-mon[33094]: pgmap v542: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.7 MiB/s wr, 729 op/s 2024-03-25T09:27:11.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:11 smithi059 ceph-mon[32732]: pgmap v542: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.7 MiB/s wr, 729 op/s 2024-03-25T09:27:11.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:11.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:11.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:12.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:13.130 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:12.796+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:13.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:13 smithi019 ceph-mon[29386]: pgmap v543: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.6 MiB/s wr, 812 op/s 2024-03-25T09:27:13.424 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:13 smithi040 ceph-mon[33094]: pgmap v543: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.6 MiB/s wr, 812 op/s 2024-03-25T09:27:13.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:13 smithi059 ceph-mon[32732]: pgmap v543: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.6 MiB/s wr, 812 op/s 2024-03-25T09:27:13.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:13.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:13.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:14.897 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:14.897 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 7/s 6/s 149 KiB/s 121 KiB/s 1.36 ms 277.50 us 2024-03-25T09:27:14.897 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 6/s 102 KiB/s 102 KiB/s 1.61 ms 300.15 us 2024-03-25T09:27:14.897 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 7/s 5/s 113 KiB/s 96 KiB/s 1.47 ms 290.45 us 2024-03-25T09:27:14.897 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 7/s 5/s 128 KiB/s 102 KiB/s 1.50 ms 232.12 us 2024-03-25T09:27:14.897 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 7/s 7/s 153 KiB/s 128 KiB/s 1.56 ms 253.33 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 7/s 5/s 126 KiB/s 123 KiB/s 1.30 ms 241.85 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 7/s 8/s 130 KiB/s 179 KiB/s 1.47 ms 284.27 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 7/s 8/s 190 KiB/s 265 KiB/s 1.50 ms 312.96 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 7/s 6/s 202 KiB/s 177 KiB/s 1.48 ms 328.73 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 7/s 7/s 133 KiB/s 133 KiB/s 1.39 ms 287.89 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 6/s 93 KiB/s 104 KiB/s 1.39 ms 363.12 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 6/s 140 KiB/s 142 KiB/s 1.48 ms 308.93 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 6/s 170 KiB/s 129 KiB/s 1.46 ms 335.77 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 6/s 8/s 163 KiB/s 197 KiB/s 1.55 ms 309.35 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 7/s 178 KiB/s 183 KiB/s 1.40 ms 345.30 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 7/s 165 KiB/s 176 KiB/s 1.47 ms 279.10 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 5/s 110 KiB/s 108 KiB/s 1.48 ms 284.63 us 2024-03-25T09:27:14.898 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 8/s 170 KiB/s 174 KiB/s 1.43 ms 336.10 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 4/s 92 KiB/s 49 KiB/s 1.41 ms 318.59 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 7/s 119 KiB/s 158 KiB/s 1.46 ms 266.24 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 7/s 150 KiB/s 122 KiB/s 1.42 ms 412.23 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 6/s 108 KiB/s 128 KiB/s 1.42 ms 311.31 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 5/s 128 KiB/s 96 KiB/s 1.43 ms 269.19 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 5/s 206 KiB/s 172 KiB/s 1.42 ms 352.26 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 5/s 206 KiB/s 138 KiB/s 1.32 ms 290.14 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 5/s 90 KiB/s 86 KiB/s 1.37 ms 262.45 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 5/s 161 KiB/s 159 KiB/s 1.43 ms 404.58 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 6/s 112 KiB/s 116 KiB/s 1.42 ms 279.97 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 6/s 128 KiB/s 105 KiB/s 1.40 ms 332.02 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 5/s 155 KiB/s 145 KiB/s 1.53 ms 302.16 us 2024-03-25T09:27:14.899 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 5/s 109 KiB/s 93 KiB/s 1.37 ms 308.26 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 130 KiB/s 125 KiB/s 1.41 ms 311.46 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 5/s 144 KiB/s 158 KiB/s 1.44 ms 293.50 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 5/s 81 KiB/s 95 KiB/s 1.47 ms 272.41 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 4/s 182 KiB/s 125 KiB/s 1.51 ms 345.94 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 5/s 162 KiB/s 134 KiB/s 1.38 ms 240.28 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 4/s 74 KiB/s 79 KiB/s 1.42 ms 299.07 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 7/s 96 KiB/s 128 KiB/s 1.58 ms 276.97 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 5/s 158 KiB/s 140 KiB/s 1.46 ms 289.37 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 6/s 147 KiB/s 169 KiB/s 1.38 ms 295.06 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 7/s 163 KiB/s 211 KiB/s 1.59 ms 356.57 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 7/s 96 KiB/s 140 KiB/s 1.26 ms 317.81 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 8/s 138 KiB/s 140 KiB/s 1.43 ms 258.32 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 7/s 78 KiB/s 119 KiB/s 1.38 ms 287.14 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 6/s 82 KiB/s 99 KiB/s 1.32 ms 322.11 us 2024-03-25T09:27:14.900 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 5/s 100 KiB/s 108 KiB/s 1.45 ms 256.25 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 4/s 140 KiB/s 94 KiB/s 1.49 ms 227.55 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 3/s 147 KiB/s 89 KiB/s 1.43 ms 301.98 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 87 KiB/s 122 KiB/s 1.70 ms 301.68 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 97 KiB/s 68 KiB/s 1.37 ms 263.56 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 5/s 121 KiB/s 97 KiB/s 1.41 ms 278.53 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 6/s 133 KiB/s 208 KiB/s 1.44 ms 301.32 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 5/s 74 KiB/s 86 KiB/s 1.48 ms 277.57 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 5/s 79 KiB/s 98 KiB/s 1.35 ms 280.54 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 74 KiB/s 91 KiB/s 1.51 ms 380.18 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 8/s 115 KiB/s 250 KiB/s 1.48 ms 286.73 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 6/s 130 KiB/s 198 KiB/s 1.48 ms 342.77 us 2024-03-25T09:27:14.901 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 5/s 77 KiB/s 139 KiB/s 1.36 ms 305.80 us 2024-03-25T09:27:14.902 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 6/s 117 KiB/s 170 KiB/s 1.55 ms 329.13 us 2024-03-25T09:27:14.902 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 9/s 86 KiB/s 187 KiB/s 1.42 ms 296.99 us 2024-03-25T09:27:14.902 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:14.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:14.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:14.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:15.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:15 smithi019 ceph-mon[29386]: pgmap v544: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.6 MiB/s wr, 689 op/s 2024-03-25T09:27:15.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:15 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:15.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:15 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:15.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:15 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:15.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:15 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:15.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:15 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:15.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:15 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:15.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:15 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:15.436 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-mon[33094]: pgmap v544: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.6 MiB/s wr, 689 op/s 2024-03-25T09:27:15.436 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:15.436 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:15.437 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:15.437 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:15.437 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:15.437 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:15.437 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:15.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:15 smithi059 ceph-mon[32732]: pgmap v544: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.6 MiB/s wr, 689 op/s 2024-03-25T09:27:15.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:15 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:15.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:15 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:15 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:15 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:15 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:15 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:15.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:15 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:16.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:16 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 347 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:16.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:16 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 347 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:16.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:16 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 347 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:16.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:16.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:16.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:17 smithi019 ceph-mon[29386]: pgmap v545: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.1 MiB/s wr, 781 op/s 2024-03-25T09:27:17.448 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:17 smithi040 ceph-mon[33094]: pgmap v545: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.1 MiB/s wr, 781 op/s 2024-03-25T09:27:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:17 smithi059 ceph-mon[32732]: pgmap v545: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.1 MiB/s wr, 781 op/s 2024-03-25T09:27:17.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:17.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:17.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:18.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:17.795+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:18.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:18.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:18.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:19.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:19 smithi019 ceph-mon[29386]: pgmap v546: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 7.8 MiB/s wr, 704 op/s 2024-03-25T09:27:19.460 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:19 smithi040 ceph-mon[33094]: pgmap v546: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 7.8 MiB/s wr, 704 op/s 2024-03-25T09:27:19.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:19 smithi059 ceph-mon[32732]: pgmap v546: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 7.8 MiB/s wr, 704 op/s 2024-03-25T09:27:19.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:27:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 144.0k 215.6k 0.0k 1.4M 2.1M 0.0k nvme2n1 2024-03-25T09:27:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 208.8k 171.6k 0.0k 2.0M 1.7M 0.0k nvme2n10 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 169.2k 167.6k 0.0k 1.7M 1.6M 0.0k nvme2n11 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 170.0k 162.8k 0.0k 1.7M 1.6M 0.0k nvme2n12 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 179.6k 180.0k 0.0k 1.8M 1.8M 0.0k nvme2n13 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 157.2k 126.4k 0.0k 1.5M 1.2M 0.0k nvme2n14 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 146.8k 198.4k 0.0k 1.4M 1.9M 0.0k nvme2n15 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 146.0k 167.2k 0.0k 1.4M 1.6M 0.0k nvme2n16 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 148.0k 185.2k 0.0k 1.4M 1.8M 0.0k nvme2n17 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 167.6k 188.8k 0.0k 1.6M 1.8M 0.0k nvme2n18 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 162.4k 150.4k 0.0k 1.6M 1.5M 0.0k nvme2n19 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 182.4k 135.6k 0.0k 1.8M 1.3M 0.0k nvme2n2 2024-03-25T09:27:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 187.6k 178.8k 0.0k 1.8M 1.7M 0.0k nvme2n20 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 146.8k 165.6k 0.0k 1.4M 1.6M 0.0k nvme2n3 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 199.2k 148.4k 0.0k 1.9M 1.4M 0.0k nvme2n4 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 172.0k 151.6k 0.0k 1.7M 1.5M 0.0k nvme2n5 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 194.8k 180.0k 0.0k 1.9M 1.8M 0.0k nvme2n6 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 165.6k 182.8k 0.0k 1.6M 1.8M 0.0k nvme2n7 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 210.4k 175.6k 0.0k 2.1M 1.7M 0.0k nvme2n8 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 216.4k 146.0k 0.0k 2.1M 1.4M 0.0k nvme2n9 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 182.8k 164.8k 0.0k 1.8M 1.6M 0.0k nvme5n1 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 133.6k 185.2k 0.0k 1.3M 1.8M 0.0k nvme5n10 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 179.2k 196.0k 0.0k 1.8M 1.9M 0.0k nvme5n11 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 123.6k 168.4k 0.0k 1.2M 1.6M 0.0k nvme5n12 2024-03-25T09:27:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 166.4k 187.6k 0.0k 1.6M 1.8M 0.0k nvme5n13 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 126.0k 151.2k 0.0k 1.2M 1.5M 0.0k nvme5n14 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 146.8k 158.0k 0.0k 1.4M 1.5M 0.0k nvme5n15 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 181.6k 177.2k 0.0k 1.8M 1.7M 0.0k nvme5n16 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 186.0k 176.0k 0.0k 1.8M 1.7M 0.0k nvme5n17 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 152.0k 186.0k 0.0k 1.5M 1.8M 0.0k nvme5n18 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 147.2k 167.6k 0.0k 1.4M 1.6M 0.0k nvme5n19 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 236.8k 125.2k 0.0k 2.3M 1.2M 0.0k nvme5n2 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 188.0k 147.6k 0.0k 1.8M 1.4M 0.0k nvme5n20 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 149.6k 120.4k 0.0k 1.5M 1.2M 0.0k nvme5n3 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 144.4k 157.2k 0.0k 1.4M 1.5M 0.0k nvme5n4 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 211.2k 161.2k 0.0k 2.1M 1.6M 0.0k nvme5n5 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 166.8k 167.2k 0.0k 1.6M 1.6M 0.0k nvme5n6 2024-03-25T09:27:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 162.8k 186.0k 0.0k 1.6M 1.8M 0.0k nvme5n7 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 116.4k 195.6k 0.0k 1.1M 1.9M 0.0k nvme5n8 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 157.2k 170.0k 0.0k 1.5M 1.7M 0.0k nvme5n9 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 202.0k 140.4k 0.0k 2.0M 1.4M 0.0k nvme8n1 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 189.2k 205.6k 0.0k 1.8M 2.0M 0.0k nvme8n10 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 220.0k 147.6k 0.0k 2.1M 1.4M 0.0k nvme8n11 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 178.8k 159.6k 0.0k 1.7M 1.6M 0.0k nvme8n12 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 109.2k 197.6k 0.0k 1.1M 1.9M 0.0k nvme8n13 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 175.2k 180.0k 0.0k 1.7M 1.8M 0.0k nvme8n14 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 138.4k 187.6k 0.0k 1.4M 1.8M 0.0k nvme8n15 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 189.2k 209.2k 0.0k 1.8M 2.0M 0.0k nvme8n16 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 133.2k 154.0k 0.0k 1.3M 1.5M 0.0k nvme8n17 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 168.8k 177.6k 0.0k 1.6M 1.7M 0.0k nvme8n18 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.50 171.2k 171.2k 0.0k 1.7M 1.7M 0.0k nvme8n19 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 147.6k 205.2k 0.0k 1.4M 2.0M 0.0k nvme8n2 2024-03-25T09:27:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 216.0k 144.0k 0.0k 2.1M 1.4M 0.0k nvme8n20 2024-03-25T09:27:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 130.0k 174.4k 0.0k 1.3M 1.7M 0.0k nvme8n3 2024-03-25T09:27:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 173.6k 145.2k 0.0k 1.7M 1.4M 0.0k nvme8n4 2024-03-25T09:27:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 172.4k 158.0k 0.0k 1.7M 1.5M 0.0k nvme8n5 2024-03-25T09:27:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 168.8k 168.4k 0.0k 1.6M 1.6M 0.0k nvme8n6 2024-03-25T09:27:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 178.8k 159.6k 0.0k 1.7M 1.6M 0.0k nvme8n7 2024-03-25T09:27:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 149.2k 185.6k 0.0k 1.5M 1.8M 0.0k nvme8n8 2024-03-25T09:27:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 11.40 128.4k 128.0k 0.0k 1.3M 1.2M 0.0k nvme8n9 2024-03-25T09:27:19.694 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:19.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:19.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:19.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:19.903 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:19.903 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 7/s 4/s 234 KiB/s 90 KiB/s 1.47 ms 277.60 us 2024-03-25T09:27:19.903 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 6/s 187 KiB/s 175 KiB/s 1.56 ms 278.94 us 2024-03-25T09:27:19.903 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 7/s 5/s 206 KiB/s 155 KiB/s 1.61 ms 273.98 us 2024-03-25T09:27:19.903 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 7/s 4/s 195 KiB/s 116 KiB/s 1.44 ms 301.51 us 2024-03-25T09:27:19.903 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 7/s 230 KiB/s 189 KiB/s 1.41 ms 267.30 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 7/s 5/s 179 KiB/s 136 KiB/s 1.47 ms 284.15 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 7/s 5/s 169 KiB/s 109 KiB/s 1.37 ms 248.39 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 7/s 6/s 220 KiB/s 193 KiB/s 1.56 ms 415.98 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 6/s 209 KiB/s 179 KiB/s 1.41 ms 274.78 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 4/s 194 KiB/s 127 KiB/s 1.42 ms 308.22 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 5/s 193 KiB/s 170 KiB/s 1.46 ms 324.68 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 5/s 206 KiB/s 149 KiB/s 1.39 ms 289.08 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 6/s 211 KiB/s 206 KiB/s 1.50 ms 341.01 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 7/s 197 KiB/s 154 KiB/s 1.54 ms 241.27 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 5/s 213 KiB/s 181 KiB/s 1.41 ms 315.40 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 7/s 147 KiB/s 185 KiB/s 1.41 ms 287.48 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 6/s 210 KiB/s 190 KiB/s 1.38 ms 301.33 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 4/s 208 KiB/s 133 KiB/s 1.38 ms 320.05 us 2024-03-25T09:27:19.904 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 5/s 182 KiB/s 158 KiB/s 1.56 ms 297.61 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 5/s 195 KiB/s 162 KiB/s 1.45 ms 276.38 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 6/s 206 KiB/s 170 KiB/s 1.41 ms 305.39 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 5/s 179 KiB/s 156 KiB/s 1.48 ms 313.44 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 5/s 176 KiB/s 154 KiB/s 1.65 ms 282.91 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 5/s 177 KiB/s 121 KiB/s 1.49 ms 446.83 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 5/s 198 KiB/s 181 KiB/s 1.45 ms 331.53 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 6/s 182 KiB/s 172 KiB/s 1.53 ms 304.93 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 7/s 188 KiB/s 196 KiB/s 1.42 ms 318.10 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 4/s 214 KiB/s 130 KiB/s 1.43 ms 253.14 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 6/s 111 KiB/s 105 KiB/s 1.47 ms 298.40 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 4/s 198 KiB/s 170 KiB/s 1.50 ms 403.59 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 5/s 146 KiB/s 183 KiB/s 1.44 ms 371.39 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 5/s 118 KiB/s 158 KiB/s 1.62 ms 273.17 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 6/s 184 KiB/s 154 KiB/s 1.49 ms 297.21 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 5/s 165 KiB/s 163 KiB/s 1.40 ms 358.77 us 2024-03-25T09:27:19.905 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 5/s 175 KiB/s 161 KiB/s 1.49 ms 305.61 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 5/s 207 KiB/s 178 KiB/s 1.49 ms 298.51 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 6/s 156 KiB/s 193 KiB/s 1.45 ms 373.77 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 6/s 122 KiB/s 153 KiB/s 1.35 ms 392.97 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 158 KiB/s 146 KiB/s 1.61 ms 297.93 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 5/s 168 KiB/s 164 KiB/s 1.47 ms 281.48 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 5/s 203 KiB/s 194 KiB/s 1.59 ms 335.04 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 7/s 169 KiB/s 225 KiB/s 1.50 ms 280.90 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 6/s 154 KiB/s 197 KiB/s 1.52 ms 308.75 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 6/s 138 KiB/s 223 KiB/s 1.48 ms 374.83 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 6/s 128 KiB/s 196 KiB/s 1.38 ms 323.82 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 6/s 167 KiB/s 218 KiB/s 1.58 ms 303.53 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 6/s 176 KiB/s 196 KiB/s 1.69 ms 284.49 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 4/s 174 KiB/s 128 KiB/s 1.46 ms 337.03 us 2024-03-25T09:27:19.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 6/s 151 KiB/s 166 KiB/s 1.42 ms 360.50 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 5/s 165 KiB/s 168 KiB/s 1.44 ms 407.71 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 7/s 138 KiB/s 194 KiB/s 1.34 ms 343.59 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 7/s 153 KiB/s 229 KiB/s 1.44 ms 332.45 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 4/s 107 KiB/s 86 KiB/s 1.43 ms 282.44 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 5/s 146 KiB/s 189 KiB/s 1.56 ms 418.73 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 6/s 144 KiB/s 230 KiB/s 1.48 ms 297.86 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 6/s 145 KiB/s 190 KiB/s 1.52 ms 350.69 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 5/s 100 KiB/s 108 KiB/s 1.56 ms 259.59 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 98 KiB/s 116 KiB/s 1.55 ms 286.87 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 5/s 123 KiB/s 162 KiB/s 1.54 ms 313.78 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 8/s 138 KiB/s 243 KiB/s 1.50 ms 286.80 us 2024-03-25T09:27:19.907 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:20.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:20 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:20 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:20 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:20 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:20 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:20.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:20 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:20.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:20 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:20 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:20 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:20 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:20 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:20.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:20 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:20.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:20 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:20.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:20 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:20 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:20 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:20 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:20 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:20 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:20 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:20.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:20 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:20.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:20.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:20.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:21.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:21 smithi019 ceph-mon[29386]: pgmap v547: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.3 MiB/s wr, 689 op/s 2024-03-25T09:27:21.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:21 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 357 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:21.472 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:21 smithi040 ceph-mon[33094]: pgmap v547: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.3 MiB/s wr, 689 op/s 2024-03-25T09:27:21.473 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:21 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 357 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:21 smithi059 ceph-mon[32732]: pgmap v547: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.3 MiB/s wr, 689 op/s 2024-03-25T09:27:21.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:21 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 357 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:21.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:21.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:21.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:22.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:22.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:22.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:23.148 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:22.796+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:23.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:23 smithi019 ceph-mon[29386]: pgmap v548: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.9 MiB/s rd, 9.9 MiB/s wr, 757 op/s 2024-03-25T09:27:23.485 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:23 smithi040 ceph-mon[33094]: pgmap v548: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.9 MiB/s rd, 9.9 MiB/s wr, 757 op/s 2024-03-25T09:27:23.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:23 smithi059 ceph-mon[32732]: pgmap v548: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.9 MiB/s rd, 9.9 MiB/s wr, 757 op/s 2024-03-25T09:27:23.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:23.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:23.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:24.906 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:24.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 7/s 6/s 259 KiB/s 215 KiB/s 1.64 ms 325.23 us 2024-03-25T09:27:24.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 7/s 5/s 229 KiB/s 146 KiB/s 1.62 ms 275.05 us 2024-03-25T09:27:24.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 7/s 5/s 224 KiB/s 163 KiB/s 1.41 ms 334.51 us 2024-03-25T09:27:24.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 7/s 4/s 196 KiB/s 147 KiB/s 1.46 ms 296.88 us 2024-03-25T09:27:24.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 5/s 213 KiB/s 174 KiB/s 1.47 ms 259.13 us 2024-03-25T09:27:24.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 4/s 232 KiB/s 147 KiB/s 1.37 ms 238.83 us 2024-03-25T09:27:24.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 5/s 213 KiB/s 134 KiB/s 1.49 ms 276.69 us 2024-03-25T09:27:24.906 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 5/s 203 KiB/s 174 KiB/s 1.44 ms 270.15 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 5/s 205 KiB/s 154 KiB/s 1.48 ms 302.12 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 5/s 181 KiB/s 155 KiB/s 1.53 ms 263.36 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 5/s 186 KiB/s 183 KiB/s 1.44 ms 299.33 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 6/s 233 KiB/s 185 KiB/s 1.58 ms 338.23 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 6/s 170 KiB/s 174 KiB/s 1.48 ms 350.43 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 6/s 200 KiB/s 152 KiB/s 1.68 ms 262.87 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 6/s 186 KiB/s 202 KiB/s 1.49 ms 319.94 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 5/s 190 KiB/s 187 KiB/s 1.41 ms 342.30 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 5/s 162 KiB/s 154 KiB/s 1.50 ms 268.24 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 5/s 177 KiB/s 182 KiB/s 1.44 ms 324.69 us 2024-03-25T09:27:24.907 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 5/s 219 KiB/s 128 KiB/s 1.50 ms 372.66 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 5/s 191 KiB/s 157 KiB/s 1.42 ms 361.69 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 4/s 178 KiB/s 142 KiB/s 1.48 ms 360.63 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 4/s 181 KiB/s 119 KiB/s 1.59 ms 341.47 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 7/s 154 KiB/s 210 KiB/s 1.49 ms 313.85 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 6/s 174 KiB/s 183 KiB/s 1.40 ms 302.99 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 5/s 190 KiB/s 159 KiB/s 1.59 ms 333.17 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 7/s 166 KiB/s 233 KiB/s 1.49 ms 361.59 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 5/s 178 KiB/s 178 KiB/s 1.57 ms 377.34 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 5/s 175 KiB/s 152 KiB/s 1.56 ms 357.49 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 5/s 158 KiB/s 184 KiB/s 1.46 ms 438.71 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 5/s 157 KiB/s 170 KiB/s 1.46 ms 370.74 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 6/s 178 KiB/s 190 KiB/s 1.51 ms 315.88 us 2024-03-25T09:27:24.908 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 6/s 177 KiB/s 157 KiB/s 1.42 ms 269.37 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 178 KiB/s 134 KiB/s 1.47 ms 275.84 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 5/s 162 KiB/s 168 KiB/s 1.45 ms 379.78 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 6/s 153 KiB/s 196 KiB/s 1.44 ms 340.87 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 169 KiB/s 143 KiB/s 1.59 ms 326.71 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 5/s 134 KiB/s 151 KiB/s 1.44 ms 301.26 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 6/s 183 KiB/s 191 KiB/s 1.42 ms 292.63 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 4/s 153 KiB/s 126 KiB/s 1.43 ms 272.30 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 4/s 181 KiB/s 140 KiB/s 1.54 ms 307.58 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 5/s 187 KiB/s 167 KiB/s 1.54 ms 281.82 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 7/s 154 KiB/s 262 KiB/s 1.37 ms 340.35 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 5/s 180 KiB/s 163 KiB/s 1.58 ms 284.06 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 6/s 150 KiB/s 166 KiB/s 1.49 ms 290.59 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 6/s 155 KiB/s 150 KiB/s 1.48 ms 269.27 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 6/s 120 KiB/s 201 KiB/s 1.50 ms 291.19 us 2024-03-25T09:27:24.909 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 5/s 173 KiB/s 166 KiB/s 1.54 ms 376.00 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 6/s 160 KiB/s 197 KiB/s 1.49 ms 379.52 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 6/s 182 KiB/s 161 KiB/s 1.74 ms 332.82 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 6/s 188 KiB/s 217 KiB/s 1.55 ms 390.43 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 6/s 142 KiB/s 222 KiB/s 1.60 ms 313.42 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 6/s 130 KiB/s 200 KiB/s 1.51 ms 272.02 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 6/s 149 KiB/s 171 KiB/s 1.51 ms 309.94 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 6/s 157 KiB/s 146 KiB/s 1.50 ms 329.39 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 6/s 142 KiB/s 174 KiB/s 1.45 ms 281.05 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 7/s 133 KiB/s 216 KiB/s 1.55 ms 301.93 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 7/s 141 KiB/s 206 KiB/s 1.37 ms 333.10 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 6/s 105 KiB/s 202 KiB/s 1.47 ms 351.85 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 6/s 136 KiB/s 209 KiB/s 1.67 ms 318.34 us 2024-03-25T09:27:24.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 6/s 130 KiB/s 172 KiB/s 1.48 ms 277.49 us 2024-03-25T09:27:24.911 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:24.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:24.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:24.912 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:25.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:25 smithi019 ceph-mon[29386]: pgmap v549: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.1 MiB/s wr, 640 op/s 2024-03-25T09:27:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:25 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:25 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:25 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:25 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:25 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:25 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:25.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:25 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:25.497 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-mon[33094]: pgmap v549: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.1 MiB/s wr, 640 op/s 2024-03-25T09:27:25.497 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:25.497 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:25.497 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:25.497 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:25.498 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:25.498 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:25.498 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:25.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:25 smithi059 ceph-mon[32732]: pgmap v549: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.1 MiB/s wr, 640 op/s 2024-03-25T09:27:25.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:25 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:25.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:25 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:25.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:25 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:25.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:25 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:25.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:25 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:25.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:25 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:25.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:25 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:25.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:25.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:25.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:26 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 362 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:26.561 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:26 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 362 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:26.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:26 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 362 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:26.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:26.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:26.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:27.509 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:27 smithi040 ceph-mon[33094]: pgmap v550: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 738 op/s 2024-03-25T09:27:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:27 smithi059 ceph-mon[32732]: pgmap v550: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 738 op/s 2024-03-25T09:27:27.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:27 smithi019 ceph-mon[29386]: pgmap v550: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 738 op/s 2024-03-25T09:27:27.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:27.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:27.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:28.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:27.797+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:28.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:28.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:28.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:29.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:29 smithi059 ceph-mon[32732]: pgmap v551: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.9 MiB/s wr, 672 op/s 2024-03-25T09:27:29.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:29 smithi040 ceph-mon[33094]: pgmap v551: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.9 MiB/s wr, 672 op/s 2024-03-25T09:27:29.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:29 smithi019 ceph-mon[29386]: pgmap v551: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.9 MiB/s wr, 672 op/s 2024-03-25T09:27:29.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:27:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 212.4k 95.6k 0.0k 2.1M 956.0k 0.0k nvme2n1 2024-03-25T09:27:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 188.8k 138.8k 0.0k 1.8M 1.4M 0.0k nvme2n10 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 144.0k 152.4k 0.0k 1.4M 1.5M 0.0k nvme2n11 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 160.0k 147.6k 0.0k 1.6M 1.4M 0.0k nvme2n12 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 151.2k 192.8k 0.0k 1.5M 1.9M 0.0k nvme2n13 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 140.4k 165.6k 0.0k 1.4M 1.6M 0.0k nvme2n14 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 166.0k 174.0k 0.0k 1.6M 1.7M 0.0k nvme2n15 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 176.4k 138.8k 0.0k 1.7M 1.4M 0.0k nvme2n16 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 136.4k 191.6k 0.0k 1.3M 1.9M 0.0k nvme2n17 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 159.2k 143.6k 0.0k 1.6M 1.4M 0.0k nvme2n18 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 154.0k 186.4k 0.0k 1.5M 1.8M 0.0k nvme2n19 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 137.2k 164.0k 0.0k 1.3M 1.6M 0.0k nvme2n2 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 137.6k 153.6k 0.0k 1.3M 1.5M 0.0k nvme2n20 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 176.4k 170.4k 0.0k 1.7M 1.7M 0.0k nvme2n3 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 149.6k 184.4k 0.0k 1.5M 1.8M 0.0k nvme2n4 2024-03-25T09:27:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 153.2k 165.2k 0.0k 1.5M 1.6M 0.0k nvme2n5 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 170.8k 188.4k 0.0k 1.7M 1.8M 0.0k nvme2n6 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 140.8k 204.8k 0.0k 1.4M 2.0M 0.0k nvme2n7 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 179.2k 161.6k 0.0k 1.8M 1.6M 0.0k nvme2n8 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 169.6k 157.6k 0.0k 1.7M 1.5M 0.0k nvme2n9 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 171.6k 156.8k 0.0k 1.7M 1.5M 0.0k nvme5n1 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 182.8k 167.2k 0.0k 1.8M 1.6M 0.0k nvme5n10 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 173.2k 162.0k 0.0k 1.7M 1.6M 0.0k nvme5n11 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 143.2k 196.8k 0.0k 1.4M 1.9M 0.0k nvme5n12 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 160.0k 140.0k 0.0k 1.6M 1.4M 0.0k nvme5n13 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 195.2k 124.0k 0.0k 1.9M 1.2M 0.0k nvme5n14 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 156.0k 141.2k 0.0k 1.5M 1.4M 0.0k nvme5n15 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 156.0k 177.2k 0.0k 1.5M 1.7M 0.0k nvme5n16 2024-03-25T09:27:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 135.6k 191.6k 0.0k 1.3M 1.9M 0.0k nvme5n17 2024-03-25T09:27:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 188.8k 154.8k 0.0k 1.8M 1.5M 0.0k nvme5n18 2024-03-25T09:27:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 156.8k 180.4k 0.0k 1.5M 1.8M 0.0k nvme5n19 2024-03-25T09:27:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 162.4k 144.4k 0.0k 1.6M 1.4M 0.0k nvme5n2 2024-03-25T09:27:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 147.2k 196.8k 0.0k 1.4M 1.9M 0.0k nvme5n20 2024-03-25T09:27:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 171.2k 152.4k 0.0k 1.7M 1.5M 0.0k nvme5n3 2024-03-25T09:27:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 141.6k 178.8k 0.0k 1.4M 1.7M 0.0k nvme5n4 2024-03-25T09:27:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 166.0k 140.8k 0.0k 1.6M 1.4M 0.0k nvme5n5 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 163.6k 125.6k 0.0k 1.6M 1.2M 0.0k nvme5n6 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 168.4k 162.8k 0.0k 1.6M 1.6M 0.0k nvme5n7 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 148.8k 156.8k 0.0k 1.5M 1.5M 0.0k nvme5n8 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 176.8k 164.4k 0.0k 1.7M 1.6M 0.0k nvme5n9 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 178.0k 160.8k 0.0k 1.7M 1.6M 0.0k nvme8n1 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 143.2k 168.4k 0.0k 1.4M 1.6M 0.0k nvme8n10 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 134.4k 169.6k 0.0k 1.3M 1.7M 0.0k nvme8n11 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 191.2k 156.4k 0.0k 1.9M 1.5M 0.0k nvme8n12 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 160.4k 177.6k 0.0k 1.6M 1.7M 0.0k nvme8n13 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 180.4k 147.6k 0.0k 1.8M 1.4M 0.0k nvme8n14 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 161.2k 152.0k 0.0k 1.6M 1.5M 0.0k nvme8n15 2024-03-25T09:27:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 165.2k 120.0k 0.0k 1.6M 1.2M 0.0k nvme8n16 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 194.0k 152.0k 0.0k 1.9M 1.5M 0.0k nvme8n17 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 132.0k 170.0k 0.0k 1.3M 1.7M 0.0k nvme8n18 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 155.2k 154.8k 0.0k 1.5M 1.5M 0.0k nvme8n19 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 127.6k 180.0k 0.0k 1.2M 1.8M 0.0k nvme8n2 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 186.8k 136.8k 0.0k 1.8M 1.3M 0.0k nvme8n20 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 185.6k 141.6k 0.0k 1.8M 1.4M 0.0k nvme8n3 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 170.4k 180.8k 0.0k 1.7M 1.8M 0.0k nvme8n4 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 166.8k 169.6k 0.0k 1.6M 1.7M 0.0k nvme8n5 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 173.2k 165.2k 0.0k 1.7M 1.6M 0.0k nvme8n6 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 144.4k 175.2k 0.0k 1.4M 1.7M 0.0k nvme8n7 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 192.0k 137.6k 0.0k 1.9M 1.3M 0.0k nvme8n8 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 183.6k 172.4k 0.0k 1.8M 1.7M 0.0k nvme8n9 2024-03-25T09:27:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:29.909 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 7/s 4/s 233 KiB/s 124 KiB/s 1.52 ms 309.74 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 7/s 4/s 226 KiB/s 130 KiB/s 1.55 ms 287.30 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 7/s 4/s 240 KiB/s 144 KiB/s 1.71 ms 311.46 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 7/s 4/s 214 KiB/s 146 KiB/s 1.51 ms 402.40 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 7/s 5/s 178 KiB/s 144 KiB/s 1.56 ms 502.26 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 7/s 4/s 182 KiB/s 161 KiB/s 1.46 ms 310.58 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 5/s 212 KiB/s 178 KiB/s 1.49 ms 321.63 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 5/s 200 KiB/s 139 KiB/s 1.60 ms 296.35 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 5/s 216 KiB/s 141 KiB/s 1.62 ms 334.22 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 6/s 6/s 178 KiB/s 164 KiB/s 1.47 ms 326.16 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 4/s 190 KiB/s 137 KiB/s 1.68 ms 331.04 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 6/s 3/s 158 KiB/s 82 KiB/s 1.51 ms 373.12 us 2024-03-25T09:27:29.910 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 6/s 170 KiB/s 167 KiB/s 1.52 ms 301.58 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 6/s 214 KiB/s 152 KiB/s 1.64 ms 287.13 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 4/s 182 KiB/s 125 KiB/s 1.58 ms 308.53 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 5/s 149 KiB/s 135 KiB/s 1.45 ms 396.52 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 5/s 146 KiB/s 178 KiB/s 1.59 ms 306.74 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 6/s 149 KiB/s 163 KiB/s 1.51 ms 308.49 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 5/s 182 KiB/s 154 KiB/s 1.43 ms 305.88 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 6/s 151 KiB/s 182 KiB/s 1.51 ms 389.68 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 5/s 192 KiB/s 168 KiB/s 1.46 ms 298.42 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 5/s 183 KiB/s 151 KiB/s 1.36 ms 292.38 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 4/s 169 KiB/s 137 KiB/s 1.48 ms 290.79 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 5/s 162 KiB/s 136 KiB/s 1.54 ms 276.18 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 5/s 166 KiB/s 157 KiB/s 1.59 ms 465.63 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 5/s 178 KiB/s 158 KiB/s 1.48 ms 318.02 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 163 KiB/s 194 KiB/s 1.56 ms 309.54 us 2024-03-25T09:27:29.911 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 4/s 182 KiB/s 154 KiB/s 1.56 ms 317.30 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 5/s 149 KiB/s 153 KiB/s 1.40 ms 292.94 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 6/s 134 KiB/s 179 KiB/s 1.54 ms 331.02 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 6/s 144 KiB/s 206 KiB/s 1.55 ms 322.67 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 4/s 184 KiB/s 174 KiB/s 1.49 ms 375.74 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 5/s 166 KiB/s 130 KiB/s 1.55 ms 345.97 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 181 KiB/s 129 KiB/s 1.51 ms 305.18 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 5/s 138 KiB/s 183 KiB/s 1.42 ms 318.39 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 5/s 187 KiB/s 174 KiB/s 1.50 ms 335.74 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 6/s 139 KiB/s 166 KiB/s 1.61 ms 361.47 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 5/s 140 KiB/s 141 KiB/s 1.49 ms 319.25 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 4/s 140 KiB/s 129 KiB/s 1.42 ms 286.23 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 155 KiB/s 103 KiB/s 1.45 ms 360.19 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 156 KiB/s 142 KiB/s 1.42 ms 370.90 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 5/s 132 KiB/s 163 KiB/s 1.48 ms 356.22 us 2024-03-25T09:27:29.912 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 7/s 173 KiB/s 165 KiB/s 1.65 ms 335.74 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 5/s 140 KiB/s 146 KiB/s 1.58 ms 291.32 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 6/s 178 KiB/s 157 KiB/s 1.51 ms 357.61 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 5/s 137 KiB/s 162 KiB/s 1.47 ms 281.23 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 5/s 102 KiB/s 154 KiB/s 1.57 ms 342.53 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 6/s 148 KiB/s 196 KiB/s 1.80 ms 379.52 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 5/s 134 KiB/s 143 KiB/s 1.45 ms 291.65 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 7/s 126 KiB/s 186 KiB/s 1.63 ms 326.49 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 7/s 130 KiB/s 212 KiB/s 1.49 ms 290.68 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 7/s 135 KiB/s 170 KiB/s 1.49 ms 306.00 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 7/s 119 KiB/s 216 KiB/s 1.35 ms 285.12 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 6/s 176 KiB/s 206 KiB/s 1.58 ms 308.37 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 6/s 154 KiB/s 170 KiB/s 1.37 ms 341.42 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 5/s 110 KiB/s 158 KiB/s 1.60 ms 307.49 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 6/s 127 KiB/s 187 KiB/s 1.52 ms 268.60 us 2024-03-25T09:27:29.913 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 7/s 130 KiB/s 191 KiB/s 1.59 ms 274.01 us 2024-03-25T09:27:29.914 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 7/s 100 KiB/s 248 KiB/s 1.41 ms 365.38 us 2024-03-25T09:27:29.914 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 2/s 7/s 94 KiB/s 176 KiB/s 1.43 ms 275.39 us 2024-03-25T09:27:29.914 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:30 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:30 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:30 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:30.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:30 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:30 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:30 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:30.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:30 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:30 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:30.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:30 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:30.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:30 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:30.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:30 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:30.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:30 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:30.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:30 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:30.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:30 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:30.589 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:30 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:30.589 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:30 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:30.589 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:30 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:30.589 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:30 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:30.589 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:30 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:30.590 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:30 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:30.590 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:30 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:30.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:30.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:30.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:31 smithi059 ceph-mon[32732]: pgmap v552: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.4 MiB/s rd, 9.5 MiB/s wr, 653 op/s 2024-03-25T09:27:31.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:31 smithi040 ceph-mon[33094]: pgmap v552: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.4 MiB/s rd, 9.5 MiB/s wr, 653 op/s 2024-03-25T09:27:31.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:31 smithi019 ceph-mon[29386]: pgmap v552: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.4 MiB/s rd, 9.5 MiB/s wr, 653 op/s 2024-03-25T09:27:32.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:32.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:32.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:32.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:32 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:27:32.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:32 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:27:32.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:32 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:27:32.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:33.216 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:32.797+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:33.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:33 smithi059 ceph-mon[32732]: pgmap v553: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 10 MiB/s wr, 734 op/s 2024-03-25T09:27:33.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:33 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:27:33.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:33 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:27:33.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:33 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:27:33.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:33 smithi040 ceph-mon[33094]: pgmap v553: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 10 MiB/s wr, 734 op/s 2024-03-25T09:27:33.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:33 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:27:33.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:33 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:27:33.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:33 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:27:33.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:33 smithi019 ceph-mon[29386]: pgmap v553: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 10 MiB/s wr, 734 op/s 2024-03-25T09:27:33.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:33 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:27:33.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:33 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:27:33.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:33 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:27:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:34.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:34.913 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:34.914 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 7/s 4/s 204 KiB/s 94 KiB/s 1.59 ms 350.38 us 2024-03-25T09:27:34.914 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 7/s 5/s 182 KiB/s 143 KiB/s 1.49 ms 312.29 us 2024-03-25T09:27:34.914 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 7/s 5/s 201 KiB/s 154 KiB/s 1.54 ms 293.23 us 2024-03-25T09:27:34.914 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 7/s 5/s 200 KiB/s 133 KiB/s 1.50 ms 281.97 us 2024-03-25T09:27:34.914 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 7/s 4/s 174 KiB/s 120 KiB/s 1.52 ms 341.46 us 2024-03-25T09:27:34.914 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 6/s 6/s 195 KiB/s 110 KiB/s 1.48 ms 276.09 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 5/s 167 KiB/s 133 KiB/s 1.49 ms 297.84 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 5/s 168 KiB/s 104 KiB/s 1.66 ms 285.42 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 3/s 192 KiB/s 101 KiB/s 1.80 ms 335.54 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 4/s 150 KiB/s 127 KiB/s 1.49 ms 363.89 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 4/s 176 KiB/s 104 KiB/s 1.57 ms 368.40 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 5/s 155 KiB/s 162 KiB/s 1.52 ms 285.85 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 4/s 185 KiB/s 131 KiB/s 1.44 ms 331.69 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 4/s 169 KiB/s 85 KiB/s 1.47 ms 364.81 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 5/s 154 KiB/s 139 KiB/s 1.48 ms 287.84 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 6/s 6/s 181 KiB/s 174 KiB/s 1.53 ms 260.93 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 4/s 173 KiB/s 92 KiB/s 1.60 ms 255.09 us 2024-03-25T09:27:34.915 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 6/s 5/s 217 KiB/s 162 KiB/s 1.64 ms 340.01 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 4/s 176 KiB/s 114 KiB/s 1.57 ms 266.07 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 4/s 149 KiB/s 131 KiB/s 1.64 ms 316.60 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 5/s 150 KiB/s 113 KiB/s 1.49 ms 283.91 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 5/s 164 KiB/s 142 KiB/s 1.53 ms 261.88 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 5/s 199 KiB/s 194 KiB/s 1.50 ms 320.25 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 5/s 152 KiB/s 144 KiB/s 1.68 ms 314.05 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 5/s 146 KiB/s 182 KiB/s 1.64 ms 276.78 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 4/s 123 KiB/s 93 KiB/s 1.59 ms 282.26 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 5/s 144 KiB/s 134 KiB/s 1.53 ms 320.72 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 6/s 154 KiB/s 178 KiB/s 1.43 ms 305.25 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 5/s 176 KiB/s 152 KiB/s 1.68 ms 289.89 us 2024-03-25T09:27:34.916 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 5/s 165 KiB/s 122 KiB/s 1.49 ms 276.05 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 4/s 166 KiB/s 110 KiB/s 1.52 ms 278.41 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 5/s 152 KiB/s 160 KiB/s 1.58 ms 422.08 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 6/s 156 KiB/s 202 KiB/s 1.44 ms 298.33 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 4/s 150 KiB/s 112 KiB/s 1.56 ms 298.13 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 5/s 181 KiB/s 142 KiB/s 1.40 ms 378.23 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 6/s 150 KiB/s 173 KiB/s 1.50 ms 312.25 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 152 KiB/s 130 KiB/s 1.64 ms 305.52 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 5/s 146 KiB/s 162 KiB/s 1.43 ms 303.83 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 6/s 121 KiB/s 146 KiB/s 1.76 ms 340.12 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 5/s 137 KiB/s 125 KiB/s 1.48 ms 322.78 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 160 KiB/s 90 KiB/s 1.46 ms 303.38 us 2024-03-25T09:27:34.917 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 6/s 123 KiB/s 171 KiB/s 1.49 ms 275.90 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 6/s 133 KiB/s 172 KiB/s 1.63 ms 367.05 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 7/s 131 KiB/s 189 KiB/s 1.59 ms 335.50 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 4/s 158 KiB/s 135 KiB/s 1.72 ms 370.00 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 5/s 128 KiB/s 174 KiB/s 1.61 ms 349.44 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 5/s 127 KiB/s 188 KiB/s 1.50 ms 321.61 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 5/s 109 KiB/s 125 KiB/s 1.59 ms 335.24 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 5/s 122 KiB/s 130 KiB/s 1.48 ms 366.62 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 7/s 144 KiB/s 154 KiB/s 1.48 ms 288.02 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 6/s 138 KiB/s 197 KiB/s 1.70 ms 332.03 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 6/s 107 KiB/s 135 KiB/s 1.67 ms 295.35 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 6/s 97 KiB/s 175 KiB/s 1.73 ms 292.60 us 2024-03-25T09:27:34.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 7/s 113 KiB/s 171 KiB/s 1.61 ms 289.04 us 2024-03-25T09:27:34.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 6/s 99 KiB/s 132 KiB/s 1.54 ms 348.14 us 2024-03-25T09:27:34.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 6/s 114 KiB/s 154 KiB/s 1.56 ms 285.85 us 2024-03-25T09:27:34.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 6/s 95 KiB/s 169 KiB/s 1.45 ms 380.47 us 2024-03-25T09:27:34.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 6/s 100 KiB/s 175 KiB/s 1.40 ms 247.01 us 2024-03-25T09:27:34.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 6/s 107 KiB/s 202 KiB/s 1.78 ms 303.74 us 2024-03-25T09:27:34.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 6/s 102 KiB/s 172 KiB/s 1.58 ms 306.80 us 2024-03-25T09:27:34.919 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:35.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:35 smithi059 ceph-mon[32732]: pgmap v554: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.6 MiB/s wr, 624 op/s 2024-03-25T09:27:35.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:35 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:35.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:35 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:35.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:35 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:35.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:35 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:35.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:35 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:35.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:35 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:35.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:35 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:35.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-mon[33094]: pgmap v554: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.6 MiB/s wr, 624 op/s 2024-03-25T09:27:35.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:35.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:35.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:35.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:35.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:35.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:35.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:35.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:35 smithi019 ceph-mon[29386]: pgmap v554: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.6 MiB/s wr, 624 op/s 2024-03-25T09:27:35.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:35 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:35.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:35 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:35.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:35 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:35.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:35 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:35.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:35 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:35.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:35 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:35.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:35 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:36.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:36.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:36.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:36.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:36 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 367 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:36.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:36 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 367 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:36.630 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:36 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 367 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:36.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:37.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:37 smithi059 ceph-mon[32732]: pgmap v555: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.6 MiB/s rd, 9.7 MiB/s wr, 725 op/s 2024-03-25T09:27:37.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:37 smithi040 ceph-mon[33094]: pgmap v555: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.6 MiB/s rd, 9.7 MiB/s wr, 725 op/s 2024-03-25T09:27:37.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:37 smithi019 ceph-mon[29386]: pgmap v555: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.6 MiB/s rd, 9.7 MiB/s wr, 725 op/s 2024-03-25T09:27:38.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:38.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:38.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:37.797+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:38.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:38.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:38.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:39.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:39 smithi059 ceph-mon[32732]: pgmap v556: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.3 MiB/s rd, 8.8 MiB/s wr, 660 op/s 2024-03-25T09:27:39.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:39 smithi040 ceph-mon[33094]: pgmap v556: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.3 MiB/s rd, 8.8 MiB/s wr, 660 op/s 2024-03-25T09:27:39.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:39 smithi019 ceph-mon[29386]: pgmap v556: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.3 MiB/s rd, 8.8 MiB/s wr, 660 op/s 2024-03-25T09:27:39.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:27:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 131.2k 134.8k 0.0k 1.3M 1.3M 0.0k nvme2n1 2024-03-25T09:27:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 146.4k 128.4k 0.0k 1.4M 1.3M 0.0k nvme2n10 2024-03-25T09:27:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 126.4k 154.0k 0.0k 1.2M 1.5M 0.0k nvme2n11 2024-03-25T09:27:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 153.2k 144.4k 0.0k 1.5M 1.4M 0.0k nvme2n12 2024-03-25T09:27:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 147.6k 144.4k 0.0k 1.4M 1.4M 0.0k nvme2n13 2024-03-25T09:27:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 129.2k 169.2k 0.0k 1.3M 1.7M 0.0k nvme2n14 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 142.8k 120.8k 0.0k 1.4M 1.2M 0.0k nvme2n15 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 165.2k 142.8k 0.0k 1.6M 1.4M 0.0k nvme2n16 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 103.2k 170.4k 0.0k 1.0M 1.7M 0.0k nvme2n17 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 109.2k 161.6k 0.0k 1.1M 1.6M 0.0k nvme2n18 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 182.0k 146.8k 0.0k 1.8M 1.4M 0.0k nvme2n19 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 135.2k 155.2k 0.0k 1.3M 1.5M 0.0k nvme2n2 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 145.2k 122.4k 0.0k 1.4M 1.2M 0.0k nvme2n20 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 142.0k 137.2k 0.0k 1.4M 1.3M 0.0k nvme2n3 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 140.8k 167.6k 0.0k 1.4M 1.6M 0.0k nvme2n4 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 120.0k 143.6k 0.0k 1.2M 1.4M 0.0k nvme2n5 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 133.6k 151.6k 0.0k 1.3M 1.5M 0.0k nvme2n6 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 140.4k 127.2k 0.0k 1.4M 1.2M 0.0k nvme2n7 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 108.4k 150.4k 0.0k 1.1M 1.5M 0.0k nvme2n8 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 166.4k 130.8k 0.0k 1.6M 1.3M 0.0k nvme2n9 2024-03-25T09:27:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 168.8k 140.8k 0.0k 1.6M 1.4M 0.0k nvme5n1 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 111.6k 159.6k 0.0k 1.1M 1.6M 0.0k nvme5n10 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 136.0k 121.2k 0.0k 1.3M 1.2M 0.0k nvme5n11 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 176.4k 139.2k 0.0k 1.7M 1.4M 0.0k nvme5n12 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 168.8k 127.2k 0.0k 1.6M 1.2M 0.0k nvme5n13 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 174.8k 132.8k 0.0k 1.7M 1.3M 0.0k nvme5n14 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 131.2k 143.6k 0.0k 1.3M 1.4M 0.0k nvme5n15 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 116.4k 180.8k 0.0k 1.1M 1.8M 0.0k nvme5n16 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 125.6k 142.4k 0.0k 1.2M 1.4M 0.0k nvme5n17 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 143.2k 150.8k 0.0k 1.4M 1.5M 0.0k nvme5n18 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 147.2k 169.2k 0.0k 1.4M 1.7M 0.0k nvme5n19 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 124.4k 143.6k 0.0k 1.2M 1.4M 0.0k nvme5n2 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 111.6k 179.6k 0.0k 1.1M 1.8M 0.0k nvme5n20 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 127.2k 172.0k 0.0k 1.2M 1.7M 0.0k nvme5n3 2024-03-25T09:27:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 114.0k 170.0k 0.0k 1.1M 1.7M 0.0k nvme5n4 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 122.4k 134.4k 0.0k 1.2M 1.3M 0.0k nvme5n5 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 154.8k 110.4k 0.0k 1.5M 1.1M 0.0k nvme5n6 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 127.6k 176.8k 0.0k 1.2M 1.7M 0.0k nvme5n7 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 142.8k 138.4k 0.0k 1.4M 1.4M 0.0k nvme5n8 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 134.8k 124.0k 0.0k 1.3M 1.2M 0.0k nvme5n9 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 133.6k 135.6k 0.0k 1.3M 1.3M 0.0k nvme8n1 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 150.4k 102.0k 0.0k 1.5M 1020.0k 0.0k nvme8n10 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 140.0k 126.8k 0.0k 1.4M 1.2M 0.0k nvme8n11 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 158.0k 156.4k 0.0k 1.5M 1.5M 0.0k nvme8n12 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 149.2k 144.0k 0.0k 1.5M 1.4M 0.0k nvme8n13 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 166.8k 112.8k 0.0k 1.6M 1.1M 0.0k nvme8n14 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 134.0k 139.6k 0.0k 1.3M 1.4M 0.0k nvme8n15 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 112.8k 186.0k 0.0k 1.1M 1.8M 0.0k nvme8n16 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 105.6k 184.0k 0.0k 1.0M 1.8M 0.0k nvme8n17 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 157.2k 122.0k 0.0k 1.5M 1.2M 0.0k nvme8n18 2024-03-25T09:27:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 131.2k 154.8k 0.0k 1.3M 1.5M 0.0k nvme8n19 2024-03-25T09:27:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 120.4k 175.6k 0.0k 1.2M 1.7M 0.0k nvme8n2 2024-03-25T09:27:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 138.4k 152.8k 0.0k 1.4M 1.5M 0.0k nvme8n20 2024-03-25T09:27:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 160.8k 138.0k 0.0k 1.6M 1.3M 0.0k nvme8n3 2024-03-25T09:27:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 142.0k 142.8k 0.0k 1.4M 1.4M 0.0k nvme8n4 2024-03-25T09:27:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 144.8k 160.8k 0.0k 1.4M 1.6M 0.0k nvme8n5 2024-03-25T09:27:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 135.6k 140.0k 0.0k 1.3M 1.4M 0.0k nvme8n6 2024-03-25T09:27:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 143.6k 147.6k 0.0k 1.4M 1.4M 0.0k nvme8n7 2024-03-25T09:27:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 155.2k 138.0k 0.0k 1.5M 1.3M 0.0k nvme8n8 2024-03-25T09:27:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 118.0k 171.2k 0.0k 1.2M 1.7M 0.0k nvme8n9 2024-03-25T09:27:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:39.918 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:39.918 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 7/s 4/s 238 KiB/s 92 KiB/s 1.76 ms 295.70 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 7/s 4/s 212 KiB/s 99 KiB/s 1.49 ms 282.32 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 7/s 4/s 188 KiB/s 106 KiB/s 1.52 ms 288.91 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 7/s 4/s 186 KiB/s 110 KiB/s 1.57 ms 259.76 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 7/s 5/s 181 KiB/s 139 KiB/s 1.57 ms 339.89 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 3/s 176 KiB/s 111 KiB/s 1.64 ms 326.34 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 6/s 144 KiB/s 166 KiB/s 1.66 ms 292.55 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 6/s 145 KiB/s 177 KiB/s 1.51 ms 302.55 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 6/s 5/s 191 KiB/s 115 KiB/s 1.50 ms 297.71 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 4/s 172 KiB/s 109 KiB/s 1.53 ms 275.48 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 6/s 5/s 168 KiB/s 124 KiB/s 1.56 ms 291.41 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 4/s 162 KiB/s 118 KiB/s 1.44 ms 288.84 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 5/s 139 KiB/s 118 KiB/s 1.60 ms 276.65 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 5/s 142 KiB/s 113 KiB/s 1.57 ms 339.30 us 2024-03-25T09:27:39.919 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 5/s 173 KiB/s 158 KiB/s 1.44 ms 310.17 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 6/s 158 KiB/s 156 KiB/s 1.56 ms 294.68 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 3/s 151 KiB/s 106 KiB/s 1.46 ms 394.56 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 6/s 134 KiB/s 154 KiB/s 1.75 ms 277.15 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 5/s 152 KiB/s 146 KiB/s 1.53 ms 363.44 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 6/s 7/s 136 KiB/s 178 KiB/s 1.57 ms 339.92 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 5/s 146 KiB/s 102 KiB/s 1.54 ms 359.75 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 5/s 197 KiB/s 117 KiB/s 1.67 ms 389.44 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 5/s 185 KiB/s 134 KiB/s 1.56 ms 285.95 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 4/s 190 KiB/s 123 KiB/s 1.69 ms 352.02 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 5/s 170 KiB/s 131 KiB/s 1.62 ms 349.72 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 4/s 147 KiB/s 96 KiB/s 1.72 ms 289.78 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 6/s 129 KiB/s 142 KiB/s 1.55 ms 268.08 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 169 KiB/s 134 KiB/s 1.57 ms 347.15 us 2024-03-25T09:27:39.920 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 5/s 126 KiB/s 108 KiB/s 1.56 ms 266.19 us 2024-03-25T09:27:39.921 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 6/s 166 KiB/s 141 KiB/s 1.84 ms 300.26 us 2024-03-25T09:27:39.921 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 5/s 170 KiB/s 130 KiB/s 1.56 ms 323.99 us 2024-03-25T09:27:39.921 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 6/s 163 KiB/s 128 KiB/s 1.54 ms 379.66 us 2024-03-25T09:27:39.921 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 6/s 135 KiB/s 149 KiB/s 1.49 ms 279.18 us 2024-03-25T09:27:39.921 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 4/s 127 KiB/s 134 KiB/s 1.59 ms 294.77 us 2024-03-25T09:27:39.921 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 6/s 168 KiB/s 150 KiB/s 1.56 ms 347.71 us 2024-03-25T09:27:39.921 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 7/s 154 KiB/s 146 KiB/s 1.44 ms 268.74 us 2024-03-25T09:27:39.921 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 6/s 159 KiB/s 133 KiB/s 1.74 ms 325.01 us 2024-03-25T09:27:39.921 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 6/s 161 KiB/s 144 KiB/s 1.69 ms 302.71 us 2024-03-25T09:27:39.921 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 5/s 125 KiB/s 134 KiB/s 1.58 ms 288.37 us 2024-03-25T09:27:39.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 5/s 133 KiB/s 125 KiB/s 1.46 ms 298.07 us 2024-03-25T09:27:39.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 5/s 128 KiB/s 172 KiB/s 1.43 ms 297.81 us 2024-03-25T09:27:39.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 6/s 144 KiB/s 193 KiB/s 1.47 ms 356.46 us 2024-03-25T09:27:39.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 6/s 146 KiB/s 123 KiB/s 1.64 ms 315.22 us 2024-03-25T09:27:39.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 5/s 134 KiB/s 150 KiB/s 1.68 ms 296.05 us 2024-03-25T09:27:39.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 114 KiB/s 134 KiB/s 1.64 ms 274.57 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 5/s 134 KiB/s 152 KiB/s 1.61 ms 317.52 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 6/s 115 KiB/s 143 KiB/s 1.48 ms 304.95 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 5/s 128 KiB/s 119 KiB/s 1.58 ms 276.16 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 6/s 134 KiB/s 166 KiB/s 1.46 ms 312.67 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 6/s 130 KiB/s 130 KiB/s 1.65 ms 270.93 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 6/s 137 KiB/s 156 KiB/s 1.87 ms 325.90 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 5/s 131 KiB/s 163 KiB/s 1.51 ms 320.22 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 137 KiB/s 119 KiB/s 1.58 ms 274.68 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 5/s 132 KiB/s 155 KiB/s 1.70 ms 290.94 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 6/s 139 KiB/s 153 KiB/s 1.80 ms 358.97 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 6/s 95 KiB/s 149 KiB/s 1.60 ms 283.55 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 6/s 122 KiB/s 163 KiB/s 1.56 ms 279.55 us 2024-03-25T09:27:39.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 6/s 94 KiB/s 132 KiB/s 1.67 ms 284.45 us 2024-03-25T09:27:39.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 6/s 74 KiB/s 146 KiB/s 1.43 ms 341.65 us 2024-03-25T09:27:39.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 5/s 103 KiB/s 154 KiB/s 1.56 ms 336.41 us 2024-03-25T09:27:39.924 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:40.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:40.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:40.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:40 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:40 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:40 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:40 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:40.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:40 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:40.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:40 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:40.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:40 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:40 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:40 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:40 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:40.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:40 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:40.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:40 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:40.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:40 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:40.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:40 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:40.654 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:40 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:40.654 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:40 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:40.654 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:40 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:40.655 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:40 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:40.655 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:40 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:40.655 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:40 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:40.655 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:40 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:40.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:40.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:40.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:41.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:41 smithi059 ceph-mon[32732]: pgmap v557: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 8.4 MiB/s wr, 648 op/s 2024-03-25T09:27:41.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:41 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 377 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:41.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:41 smithi040 ceph-mon[33094]: pgmap v557: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 8.4 MiB/s wr, 648 op/s 2024-03-25T09:27:41.514 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:41 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 377 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:41.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:41 smithi019 ceph-mon[29386]: pgmap v557: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 8.4 MiB/s wr, 648 op/s 2024-03-25T09:27:41.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:41 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 377 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:42.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:42.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:42.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:43.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:43.241 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:42.798+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:43.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:43 smithi059 ceph-mon[32732]: pgmap v558: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.4 MiB/s wr, 733 op/s 2024-03-25T09:27:43.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:43 smithi040 ceph-mon[33094]: pgmap v558: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.4 MiB/s wr, 733 op/s 2024-03-25T09:27:43.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:43 smithi019 ceph-mon[29386]: pgmap v558: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.4 MiB/s wr, 733 op/s 2024-03-25T09:27:44.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:44.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:44.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:44.922 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:44.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 7/s 4/s 218 KiB/s 126 KiB/s 1.54 ms 296.36 us 2024-03-25T09:27:44.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 7/s 5/s 167 KiB/s 122 KiB/s 1.57 ms 282.27 us 2024-03-25T09:27:44.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 5/s 214 KiB/s 125 KiB/s 1.71 ms 284.04 us 2024-03-25T09:27:44.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 7/s 4/s 184 KiB/s 114 KiB/s 1.55 ms 320.87 us 2024-03-25T09:27:44.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 7/s 5/s 191 KiB/s 122 KiB/s 1.69 ms 316.38 us 2024-03-25T09:27:44.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 4/s 187 KiB/s 101 KiB/s 1.67 ms 361.63 us 2024-03-25T09:27:44.922 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 4/s 158 KiB/s 94 KiB/s 1.42 ms 276.57 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 4/s 174 KiB/s 123 KiB/s 1.53 ms 263.89 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 4/s 167 KiB/s 118 KiB/s 1.55 ms 301.03 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 6/s 162 KiB/s 134 KiB/s 1.59 ms 457.59 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 5/s 134 KiB/s 166 KiB/s 1.67 ms 351.17 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 4/s 200 KiB/s 117 KiB/s 1.64 ms 339.80 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 6/s 168 KiB/s 111 KiB/s 1.59 ms 281.86 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 4/s 176 KiB/s 121 KiB/s 1.69 ms 382.47 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 6/s 164 KiB/s 134 KiB/s 1.51 ms 416.17 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 5/s 153 KiB/s 129 KiB/s 1.57 ms 365.09 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 4/s 150 KiB/s 150 KiB/s 1.63 ms 369.36 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 4/s 184 KiB/s 79 KiB/s 1.73 ms 288.49 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 6/s 110 KiB/s 134 KiB/s 1.58 ms 289.43 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 5/s 116 KiB/s 110 KiB/s 1.89 ms 291.47 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 5/s 133 KiB/s 114 KiB/s 1.71 ms 298.99 us 2024-03-25T09:27:44.923 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 4/s 150 KiB/s 106 KiB/s 1.44 ms 231.72 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 7/s 146 KiB/s 190 KiB/s 1.43 ms 368.09 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 5/s 129 KiB/s 133 KiB/s 1.60 ms 289.38 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 5/s 176 KiB/s 130 KiB/s 1.56 ms 300.38 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 6/s 136 KiB/s 152 KiB/s 1.52 ms 262.89 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 5/s 202 KiB/s 132 KiB/s 1.47 ms 256.50 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 5/s 156 KiB/s 129 KiB/s 1.52 ms 310.01 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 5/s 114 KiB/s 134 KiB/s 1.75 ms 408.55 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 6/s 120 KiB/s 151 KiB/s 1.48 ms 364.62 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 5/s 144 KiB/s 133 KiB/s 1.55 ms 284.47 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 6/s 94 KiB/s 143 KiB/s 1.65 ms 317.74 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 6/s 109 KiB/s 130 KiB/s 1.51 ms 330.47 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 5/s 114 KiB/s 127 KiB/s 1.56 ms 373.19 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 5/s 119 KiB/s 126 KiB/s 1.52 ms 246.51 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 6/s 136 KiB/s 158 KiB/s 1.65 ms 332.27 us 2024-03-25T09:27:44.924 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 6/s 139 KiB/s 134 KiB/s 1.63 ms 258.73 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 6/s 175 KiB/s 144 KiB/s 1.42 ms 303.91 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 6/s 100 KiB/s 131 KiB/s 1.53 ms 282.83 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 7/s 118 KiB/s 176 KiB/s 1.62 ms 270.82 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 4/s 121 KiB/s 98 KiB/s 1.48 ms 260.06 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 6/s 111 KiB/s 157 KiB/s 1.45 ms 257.63 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 3/s 118 KiB/s 95 KiB/s 1.57 ms 383.20 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 6/s 150 KiB/s 154 KiB/s 1.52 ms 323.83 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 7/s 106 KiB/s 148 KiB/s 1.54 ms 278.71 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 5/s 102 KiB/s 122 KiB/s 1.54 ms 314.33 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 5/s 125 KiB/s 106 KiB/s 1.48 ms 280.60 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 6/s 98 KiB/s 162 KiB/s 1.53 ms 294.05 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 6/s 118 KiB/s 146 KiB/s 1.66 ms 367.19 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 6/s 119 KiB/s 143 KiB/s 1.54 ms 339.14 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 6/s 110 KiB/s 168 KiB/s 1.51 ms 312.70 us 2024-03-25T09:27:44.925 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 5/s 120 KiB/s 151 KiB/s 1.61 ms 374.75 us 2024-03-25T09:27:44.926 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 7/s 95 KiB/s 182 KiB/s 1.82 ms 358.32 us 2024-03-25T09:27:44.926 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 6/s 94 KiB/s 139 KiB/s 1.60 ms 321.74 us 2024-03-25T09:27:44.926 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 7/s 84 KiB/s 184 KiB/s 1.64 ms 344.12 us 2024-03-25T09:27:44.926 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 6/s 104 KiB/s 158 KiB/s 1.50 ms 363.11 us 2024-03-25T09:27:44.926 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 5/s 94 KiB/s 127 KiB/s 1.53 ms 285.10 us 2024-03-25T09:27:44.926 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 6/s 99 KiB/s 176 KiB/s 1.64 ms 265.82 us 2024-03-25T09:27:44.926 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 6/s 65 KiB/s 158 KiB/s 1.60 ms 381.29 us 2024-03-25T09:27:44.926 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 6/s 62 KiB/s 128 KiB/s 1.43 ms 333.53 us 2024-03-25T09:27:44.926 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:45.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:45.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:45.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:45.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:45 smithi059 ceph-mon[32732]: pgmap v559: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 8.0 MiB/s wr, 631 op/s 2024-03-25T09:27:45.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:45 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:45.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:45 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:45.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:45 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:45.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:45 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:45.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:45 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:45.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:45 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:45.512 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:45 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-mon[33094]: pgmap v559: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 8.0 MiB/s wr, 631 op/s 2024-03-25T09:27:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:45.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:45.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:45 smithi019 ceph-mon[29386]: pgmap v559: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 8.0 MiB/s wr, 631 op/s 2024-03-25T09:27:45.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:45 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:45.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:45 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:45.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:45 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:45.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:45 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:45.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:45 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:45.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:45 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:45.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:45 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:46.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:46.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:46.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:46.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:46 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 382 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:46 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 382 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:46 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 382 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:47.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:47.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:47.161 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:47.631 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:47 smithi040 ceph-mon[33094]: pgmap v560: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.9 MiB/s wr, 729 op/s 2024-03-25T09:27:47.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:47 smithi019 ceph-mon[29386]: pgmap v560: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.9 MiB/s wr, 729 op/s 2024-03-25T09:27:47.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:47 smithi059 ceph-mon[32732]: pgmap v560: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.9 MiB/s wr, 729 op/s 2024-03-25T09:27:48.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:48.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:48.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:47.798+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:49.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:49.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:49.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:49.643 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:49 smithi040 ceph-mon[33094]: pgmap v561: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.0 MiB/s wr, 668 op/s 2024-03-25T09:27:49.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:49 smithi019 ceph-mon[29386]: pgmap v561: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.0 MiB/s wr, 668 op/s 2024-03-25T09:27:49.670 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:27:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 150.0k 109.2k 0.0k 1.5M 1.1M 0.0k nvme2n1 2024-03-25T09:27:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 137.6k 107.6k 0.0k 1.3M 1.1M 0.0k nvme2n10 2024-03-25T09:27:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 119.6k 126.4k 0.0k 1.2M 1.2M 0.0k nvme2n11 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 124.4k 121.2k 0.0k 1.2M 1.2M 0.0k nvme2n12 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 157.2k 82.4k 0.0k 1.5M 824.0k 0.0k nvme2n13 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 145.2k 122.0k 0.0k 1.4M 1.2M 0.0k nvme2n14 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 132.8k 142.8k 0.0k 1.3M 1.4M 0.0k nvme2n15 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 137.2k 136.8k 0.0k 1.3M 1.3M 0.0k nvme2n16 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 114.8k 153.2k 0.0k 1.1M 1.5M 0.0k nvme2n17 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 154.0k 130.0k 0.0k 1.5M 1.3M 0.0k nvme2n18 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 91.6k 140.8k 0.0k 916.0k 1.4M 0.0k nvme2n19 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 126.4k 137.6k 0.0k 1.2M 1.3M 0.0k nvme2n2 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 147.6k 101.2k 0.0k 1.4M 1012.0k 0.0k nvme2n20 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 104.4k 164.8k 0.0k 1.0M 1.6M 0.0k nvme2n3 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 134.8k 136.0k 0.0k 1.3M 1.3M 0.0k nvme2n4 2024-03-25T09:27:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 124.4k 129.6k 0.0k 1.2M 1.3M 0.0k nvme2n5 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 121.2k 153.2k 0.0k 1.2M 1.5M 0.0k nvme2n6 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 127.2k 137.6k 0.0k 1.2M 1.3M 0.0k nvme2n7 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 131.6k 107.6k 0.0k 1.3M 1.1M 0.0k nvme2n8 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 126.0k 128.4k 0.0k 1.2M 1.3M 0.0k nvme2n9 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 121.2k 110.4k 0.0k 1.2M 1.1M 0.0k nvme5n1 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 148.4k 134.8k 0.0k 1.4M 1.3M 0.0k nvme5n10 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 123.2k 108.0k 0.0k 1.2M 1.1M 0.0k nvme5n11 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 134.4k 135.2k 0.0k 1.3M 1.3M 0.0k nvme5n12 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 148.0k 98.0k 0.0k 1.4M 980.0k 0.0k nvme5n13 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 146.8k 112.8k 0.0k 1.4M 1.1M 0.0k nvme5n14 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 127.6k 135.6k 0.0k 1.2M 1.3M 0.0k nvme5n15 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 122.4k 138.0k 0.0k 1.2M 1.3M 0.0k nvme5n16 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 122.8k 124.8k 0.0k 1.2M 1.2M 0.0k nvme5n17 2024-03-25T09:27:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 137.2k 120.8k 0.0k 1.3M 1.2M 0.0k nvme5n18 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 125.6k 140.4k 0.0k 1.2M 1.4M 0.0k nvme5n19 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 144.0k 103.2k 0.0k 1.4M 1.0M 0.0k nvme5n2 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 124.4k 147.2k 0.0k 1.2M 1.4M 0.0k nvme5n20 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 144.0k 123.6k 0.0k 1.4M 1.2M 0.0k nvme5n3 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 171.6k 95.6k 0.0k 1.7M 956.0k 0.0k nvme5n4 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 126.0k 122.4k 0.0k 1.2M 1.2M 0.0k nvme5n5 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 130.8k 160.4k 0.0k 1.3M 1.6M 0.0k nvme5n6 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 115.2k 128.0k 0.0k 1.1M 1.2M 0.0k nvme5n7 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 135.6k 149.2k 0.0k 1.3M 1.5M 0.0k nvme5n8 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 108.8k 122.4k 0.0k 1.1M 1.2M 0.0k nvme5n9 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 93.2k 166.8k 0.0k 932.0k 1.6M 0.0k nvme8n1 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 121.2k 113.6k 0.0k 1.2M 1.1M 0.0k nvme8n10 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 133.6k 115.6k 0.0k 1.3M 1.1M 0.0k nvme8n11 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 126.0k 138.0k 0.0k 1.2M 1.3M 0.0k nvme8n12 2024-03-25T09:27:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 118.0k 144.0k 0.0k 1.2M 1.4M 0.0k nvme8n13 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 153.6k 110.0k 0.0k 1.5M 1.1M 0.0k nvme8n14 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 125.6k 146.8k 0.0k 1.2M 1.4M 0.0k nvme8n15 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 142.4k 111.2k 0.0k 1.4M 1.1M 0.0k nvme8n16 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 161.2k 124.4k 0.0k 1.6M 1.2M 0.0k nvme8n17 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.30 132.4k 97.2k 0.0k 1.3M 972.0k 0.0k nvme8n18 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 152.8k 105.2k 0.0k 1.5M 1.0M 0.0k nvme8n19 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 162.8k 111.2k 0.0k 1.6M 1.1M 0.0k nvme8n2 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 116.4k 137.2k 0.0k 1.1M 1.3M 0.0k nvme8n20 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 122.0k 144.0k 0.0k 1.2M 1.4M 0.0k nvme8n3 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 132.0k 115.6k 0.0k 1.3M 1.1M 0.0k nvme8n4 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 138.0k 139.6k 0.0k 1.3M 1.4M 0.0k nvme8n5 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 132.8k 126.4k 0.0k 1.3M 1.2M 0.0k nvme8n6 2024-03-25T09:27:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 127.6k 116.8k 0.0k 1.2M 1.1M 0.0k nvme8n7 2024-03-25T09:27:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 103.2k 141.6k 0.0k 1.0M 1.4M 0.0k nvme8n8 2024-03-25T09:27:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 149.6k 129.2k 0.0k 1.5M 1.3M 0.0k nvme8n9 2024-03-25T09:27:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:49.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:49 smithi059 ceph-mon[32732]: pgmap v561: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.0 MiB/s wr, 668 op/s 2024-03-25T09:27:49.928 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:49.928 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 4/s 177 KiB/s 101 KiB/s 1.64 ms 328.05 us 2024-03-25T09:27:49.928 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 7/s 5/s 179 KiB/s 137 KiB/s 1.63 ms 289.82 us 2024-03-25T09:27:49.928 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 6/s 5/s 197 KiB/s 106 KiB/s 1.57 ms 266.25 us 2024-03-25T09:27:49.928 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 5/s 139 KiB/s 136 KiB/s 1.69 ms 306.53 us 2024-03-25T09:27:49.928 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 5/s 177 KiB/s 121 KiB/s 1.53 ms 306.85 us 2024-03-25T09:27:49.928 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 5/s 136 KiB/s 120 KiB/s 1.60 ms 283.64 us 2024-03-25T09:27:49.928 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 4/s 169 KiB/s 81 KiB/s 1.73 ms 311.01 us 2024-03-25T09:27:49.928 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 4/s 155 KiB/s 112 KiB/s 1.60 ms 274.72 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 6/s 170 KiB/s 127 KiB/s 1.55 ms 257.78 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 5/s 122 KiB/s 103 KiB/s 1.57 ms 294.95 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 5/s 174 KiB/s 131 KiB/s 1.98 ms 274.93 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 6/s 5/s 174 KiB/s 138 KiB/s 1.56 ms 451.72 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 5/s 176 KiB/s 151 KiB/s 1.56 ms 460.81 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 4/s 138 KiB/s 79 KiB/s 1.49 ms 282.97 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 6/s 135 KiB/s 164 KiB/s 1.65 ms 278.10 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 6/s 6/s 124 KiB/s 124 KiB/s 1.73 ms 285.76 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 4/s 132 KiB/s 96 KiB/s 1.81 ms 372.75 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 5/s 162 KiB/s 116 KiB/s 1.70 ms 309.89 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 5/s 159 KiB/s 106 KiB/s 1.58 ms 279.94 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 4/s 133 KiB/s 131 KiB/s 1.64 ms 296.99 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 5/s 106 KiB/s 131 KiB/s 1.71 ms 314.12 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 7/s 117 KiB/s 186 KiB/s 1.59 ms 370.34 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 6/s 103 KiB/s 147 KiB/s 1.64 ms 285.87 us 2024-03-25T09:27:49.929 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 5/s 116 KiB/s 118 KiB/s 1.61 ms 308.19 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 5/s 130 KiB/s 130 KiB/s 1.65 ms 328.17 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 6/s 122 KiB/s 148 KiB/s 1.58 ms 332.19 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 6/s 128 KiB/s 124 KiB/s 1.53 ms 312.69 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 6/s 134 KiB/s 129 KiB/s 1.61 ms 341.68 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 4/s 139 KiB/s 104 KiB/s 1.54 ms 267.72 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 4/s 136 KiB/s 84 KiB/s 1.65 ms 278.76 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 5/s 87 KiB/s 136 KiB/s 1.67 ms 295.03 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 7/s 137 KiB/s 138 KiB/s 1.48 ms 323.87 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 6/s 139 KiB/s 158 KiB/s 1.61 ms 279.60 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 5/s 86 KiB/s 102 KiB/s 1.49 ms 270.47 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 5/s 124 KiB/s 87 KiB/s 1.54 ms 282.62 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 6/s 142 KiB/s 156 KiB/s 1.50 ms 321.96 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 5/s 116 KiB/s 148 KiB/s 1.68 ms 309.40 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 5/s 130 KiB/s 133 KiB/s 1.47 ms 281.35 us 2024-03-25T09:27:49.930 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 6/s 110 KiB/s 174 KiB/s 1.83 ms 310.76 us 2024-03-25T09:27:49.931 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 122 KiB/s 108 KiB/s 1.49 ms 337.00 us 2024-03-25T09:27:49.931 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 6/s 117 KiB/s 160 KiB/s 1.55 ms 274.10 us 2024-03-25T09:27:49.931 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 5/s 142 KiB/s 149 KiB/s 1.63 ms 295.75 us 2024-03-25T09:27:49.931 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 6/s 165 KiB/s 125 KiB/s 1.50 ms 288.49 us 2024-03-25T09:27:49.931 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 6/s 129 KiB/s 141 KiB/s 1.41 ms 331.88 us 2024-03-25T09:27:49.931 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 6/s 123 KiB/s 118 KiB/s 1.56 ms 328.31 us 2024-03-25T09:27:49.931 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 5/s 118 KiB/s 112 KiB/s 1.65 ms 278.87 us 2024-03-25T09:27:49.931 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 6/s 106 KiB/s 184 KiB/s 1.57 ms 316.79 us 2024-03-25T09:27:49.931 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 6/s 154 KiB/s 120 KiB/s 1.70 ms 293.88 us 2024-03-25T09:27:49.931 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 6/s 94 KiB/s 142 KiB/s 1.54 ms 422.15 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 7/s 112 KiB/s 160 KiB/s 1.56 ms 307.73 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 7/s 108 KiB/s 178 KiB/s 1.49 ms 299.44 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 6/s 106 KiB/s 128 KiB/s 1.73 ms 278.40 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 5/s 94 KiB/s 138 KiB/s 1.59 ms 314.83 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 6/s 93 KiB/s 145 KiB/s 1.50 ms 374.79 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 7/s 95 KiB/s 143 KiB/s 1.65 ms 302.49 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 6/s 98 KiB/s 138 KiB/s 1.56 ms 266.92 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 7/s 75 KiB/s 155 KiB/s 1.42 ms 284.64 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 7/s 84 KiB/s 183 KiB/s 1.53 ms 294.23 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 5/s 81 KiB/s 99 KiB/s 1.61 ms 248.22 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 8/s 94 KiB/s 205 KiB/s 1.66 ms 319.34 us 2024-03-25T09:27:49.932 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:50.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:50.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:50.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:50.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:50 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:50.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:50 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:50.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:50 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:50.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:50 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:50.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:50 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:50.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:50 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:50.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:50 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:50.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:50 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:50.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:50 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:50.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:50 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:50.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:50 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:50.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:50 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:50.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:50 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:50.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:50 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:50.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:50 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:50.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:50 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:50.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:50 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:50.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:50 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:50.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:50 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:50.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:50 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:50.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:50 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:51.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:51.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:51.655 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:51 smithi040 ceph-mon[33094]: pgmap v562: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.5 MiB/s wr, 653 op/s 2024-03-25T09:27:51.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:51 smithi019 ceph-mon[29386]: pgmap v562: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.5 MiB/s wr, 653 op/s 2024-03-25T09:27:51.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:51 smithi059 ceph-mon[32732]: pgmap v562: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.5 MiB/s wr, 653 op/s 2024-03-25T09:27:52.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:52.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:52.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:52.798+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:53.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:53 smithi019 ceph-mon[29386]: pgmap v563: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.3 MiB/s rd, 8.2 MiB/s wr, 732 op/s 2024-03-25T09:27:53.667 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:53 smithi040 ceph-mon[33094]: pgmap v563: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.3 MiB/s rd, 8.2 MiB/s wr, 732 op/s 2024-03-25T09:27:53.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:53 smithi059 ceph-mon[32732]: pgmap v563: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.3 MiB/s rd, 8.2 MiB/s wr, 732 op/s 2024-03-25T09:27:54.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:54.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:54.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:54.932 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:54.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 8/s 4/s 152 KiB/s 90 KiB/s 1.49 ms 335.27 us 2024-03-25T09:27:54.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 8/s 3/s 189 KiB/s 79 KiB/s 1.81 ms 500.01 us 2024-03-25T09:27:54.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 7/s 4/s 162 KiB/s 103 KiB/s 1.68 ms 305.84 us 2024-03-25T09:27:54.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 7/s 3/s 152 KiB/s 60 KiB/s 1.44 ms 391.80 us 2024-03-25T09:27:54.932 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 4/s 153 KiB/s 123 KiB/s 1.69 ms 301.40 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 7/s 5/s 164 KiB/s 140 KiB/s 1.68 ms 465.34 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 7/s 5/s 174 KiB/s 108 KiB/s 1.60 ms 290.36 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 5/s 178 KiB/s 132 KiB/s 1.60 ms 293.27 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 4/s 117 KiB/s 135 KiB/s 1.55 ms 294.17 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 6/s 136 KiB/s 130 KiB/s 1.61 ms 277.81 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 4/s 120 KiB/s 80 KiB/s 1.47 ms 391.71 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 5/s 114 KiB/s 130 KiB/s 1.57 ms 295.71 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 4/s 120 KiB/s 134 KiB/s 1.61 ms 314.56 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 5/s 127 KiB/s 110 KiB/s 1.76 ms 320.94 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 4/s 132 KiB/s 65 KiB/s 1.91 ms 274.99 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 5/s 108 KiB/s 139 KiB/s 1.54 ms 351.91 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 4/s 94 KiB/s 90 KiB/s 1.65 ms 296.09 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 3/s 95 KiB/s 70 KiB/s 1.57 ms 284.62 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 5/s 130 KiB/s 106 KiB/s 1.59 ms 313.17 us 2024-03-25T09:27:54.933 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 6/s 138 KiB/s 158 KiB/s 1.72 ms 311.54 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 5/s 146 KiB/s 81 KiB/s 1.61 ms 277.34 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 5/s 122 KiB/s 142 KiB/s 1.56 ms 289.92 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 6/s 138 KiB/s 114 KiB/s 1.56 ms 287.86 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 6/s 138 KiB/s 129 KiB/s 1.54 ms 374.32 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 138 KiB/s 94 KiB/s 1.74 ms 343.01 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 110 KiB/s 122 KiB/s 1.54 ms 323.71 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 5/s 109 KiB/s 118 KiB/s 1.66 ms 371.26 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 6/s 109 KiB/s 114 KiB/s 1.57 ms 280.48 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 5/s 87 KiB/s 146 KiB/s 1.50 ms 429.46 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 6/s 131 KiB/s 139 KiB/s 1.72 ms 287.80 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 5/s 98 KiB/s 94 KiB/s 1.63 ms 277.34 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 5/s 126 KiB/s 98 KiB/s 1.51 ms 284.05 us 2024-03-25T09:27:54.934 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 4/s 113 KiB/s 91 KiB/s 1.77 ms 284.00 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 5/s 114 KiB/s 139 KiB/s 1.55 ms 381.42 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 4/s 142 KiB/s 109 KiB/s 1.54 ms 357.28 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 5/s 122 KiB/s 105 KiB/s 1.86 ms 352.17 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 5/s 128 KiB/s 100 KiB/s 1.56 ms 276.71 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 5/s 115 KiB/s 114 KiB/s 1.72 ms 277.14 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 4/s 133 KiB/s 122 KiB/s 1.48 ms 323.38 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 6/s 110 KiB/s 152 KiB/s 1.58 ms 321.05 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 5/s 129 KiB/s 133 KiB/s 1.55 ms 335.52 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 5/s 129 KiB/s 139 KiB/s 1.73 ms 331.22 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 5/s 110 KiB/s 86 KiB/s 1.76 ms 329.62 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 7/s 110 KiB/s 169 KiB/s 1.61 ms 363.89 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 7/s 102 KiB/s 194 KiB/s 1.52 ms 289.24 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 5/s 131 KiB/s 111 KiB/s 1.62 ms 383.43 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 6/s 92 KiB/s 153 KiB/s 1.52 ms 316.38 us 2024-03-25T09:27:54.935 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 121 KiB/s 141 KiB/s 1.71 ms 358.03 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 5/s 115 KiB/s 85 KiB/s 1.64 ms 256.92 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 7/s 87 KiB/s 154 KiB/s 1.57 ms 358.28 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 6/s 124 KiB/s 140 KiB/s 1.72 ms 362.98 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 6/s 110 KiB/s 122 KiB/s 1.69 ms 261.89 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 5/s 88 KiB/s 97 KiB/s 1.61 ms 325.92 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 6/s 97 KiB/s 121 KiB/s 1.72 ms 251.11 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 5/s 106 KiB/s 117 KiB/s 1.59 ms 292.25 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 7/s 98 KiB/s 155 KiB/s 1.53 ms 317.89 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 6/s 105 KiB/s 118 KiB/s 1.61 ms 369.99 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 6/s 71 KiB/s 157 KiB/s 1.78 ms 278.93 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 6/s 84 KiB/s 154 KiB/s 1.46 ms 297.58 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 6/s 99 KiB/s 150 KiB/s 1.60 ms 330.97 us 2024-03-25T09:27:54.936 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:55.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:55.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:55.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:55.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:55 smithi019 ceph-mon[29386]: pgmap v564: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 627 op/s 2024-03-25T09:27:55.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:55 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:55.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:55 smithi019 ceph-mon[29386]: { 2024-03-25T09:27:55.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:55 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:27:55.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:55 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:27:55.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:55 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:27:55.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:55 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:27:55.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:55 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:27:55.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:55 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 387 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:55.681 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-mon[33094]: pgmap v564: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 627 op/s 2024-03-25T09:27:55.681 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:55.681 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-mon[33094]: { 2024-03-25T09:27:55.681 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:27:55.681 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:27:55.681 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:27:55.681 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:27:55.681 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:27:55.681 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 387 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:55.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:55 smithi059 ceph-mon[32732]: pgmap v564: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 627 op/s 2024-03-25T09:27:55.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:55 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:27:55.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:55 smithi059 ceph-mon[32732]: { 2024-03-25T09:27:55.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:55 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:27:55.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:55 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:27:55.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:55 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:27:55.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:55 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:27:55.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:55 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:27:55.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:55 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 387 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:27:56.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:56.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:56.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:57.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:57.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:57.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:57.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:57 smithi019 ceph-mon[29386]: pgmap v565: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 724 op/s 2024-03-25T09:27:57.692 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:57 smithi040 ceph-mon[33094]: pgmap v565: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 724 op/s 2024-03-25T09:27:57.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:57 smithi059 ceph-mon[32732]: pgmap v565: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 724 op/s 2024-03-25T09:27:58.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:58.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:58.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:27:57.799+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:27:59.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:27:59.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:27:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:27:59.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:27:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:27:59.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:27:59 smithi019 ceph-mon[29386]: pgmap v566: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 6.9 MiB/s wr, 655 op/s 2024-03-25T09:27:59.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 105.6k 150.4k 0.0k 1.0M 1.5M 0.0k nvme2n1 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 104.8k 122.4k 0.0k 1.0M 1.2M 0.0k nvme2n10 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 107.6k 101.6k 0.0k 1.1M 1016.0k 0.0k nvme2n11 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 132.8k 109.2k 0.0k 1.3M 1.1M 0.0k nvme2n12 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 114.0k 123.2k 0.0k 1.1M 1.2M 0.0k nvme2n13 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 152.0k 114.0k 0.0k 1.5M 1.1M 0.0k nvme2n14 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 93.2k 118.8k 0.0k 932.0k 1.2M 0.0k nvme2n15 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 94.4k 155.6k 0.0k 944.0k 1.5M 0.0k nvme2n16 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 134.0k 103.2k 0.0k 1.3M 1.0M 0.0k nvme2n17 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 118.0k 97.2k 0.0k 1.2M 972.0k 0.0k nvme2n18 2024-03-25T09:27:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 152.4k 106.8k 0.0k 1.5M 1.0M 0.0k nvme2n19 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 80.4k 122.0k 0.0k 804.0k 1.2M 0.0k nvme2n2 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 84.8k 130.4k 0.0k 848.0k 1.3M 0.0k nvme2n20 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 144.4k 114.8k 0.0k 1.4M 1.1M 0.0k nvme2n3 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 108.8k 124.0k 0.0k 1.1M 1.2M 0.0k nvme2n4 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 110.8k 96.8k 0.0k 1.1M 968.0k 0.0k nvme2n5 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 97.6k 108.4k 0.0k 976.0k 1.1M 0.0k nvme2n6 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 98.4k 102.0k 0.0k 984.0k 1020.0k 0.0k nvme2n7 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 92.0k 121.6k 0.0k 920.0k 1.2M 0.0k nvme2n8 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 118.8k 121.6k 0.0k 1.2M 1.2M 0.0k nvme2n9 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 110.8k 111.6k 0.0k 1.1M 1.1M 0.0k nvme5n1 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 96.8k 128.4k 0.0k 968.0k 1.3M 0.0k nvme5n10 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 138.0k 121.6k 0.0k 1.3M 1.2M 0.0k nvme5n11 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 140.4k 108.4k 0.0k 1.4M 1.1M 0.0k nvme5n12 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 118.4k 95.2k 0.0k 1.2M 952.0k 0.0k nvme5n13 2024-03-25T09:27:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 110.8k 95.2k 0.0k 1.1M 952.0k 0.0k nvme5n14 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 109.2k 130.0k 0.0k 1.1M 1.3M 0.0k nvme5n15 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 116.4k 114.8k 0.0k 1.1M 1.1M 0.0k nvme5n16 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 100.8k 111.6k 0.0k 1008.0k 1.1M 0.0k nvme5n17 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 114.8k 136.0k 0.0k 1.1M 1.3M 0.0k nvme5n18 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 128.8k 110.4k 0.0k 1.3M 1.1M 0.0k nvme5n19 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 130.4k 121.2k 0.0k 1.3M 1.2M 0.0k nvme5n2 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 115.2k 110.4k 0.0k 1.1M 1.1M 0.0k nvme5n20 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 112.8k 134.0k 0.0k 1.1M 1.3M 0.0k nvme5n3 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 166.4k 87.2k 0.0k 1.6M 872.0k 0.0k nvme5n4 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 93.2k 131.6k 0.0k 932.0k 1.3M 0.0k nvme5n5 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 111.2k 133.6k 0.0k 1.1M 1.3M 0.0k nvme5n6 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 85.2k 144.0k 0.0k 852.0k 1.4M 0.0k nvme5n7 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 148.4k 104.4k 0.0k 1.4M 1.0M 0.0k nvme5n8 2024-03-25T09:27:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 120.4k 108.0k 0.0k 1.2M 1.1M 0.0k nvme5n9 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 112.0k 133.6k 0.0k 1.1M 1.3M 0.0k nvme8n1 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 104.0k 113.6k 0.0k 1.0M 1.1M 0.0k nvme8n10 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 97.6k 123.6k 0.0k 976.0k 1.2M 0.0k nvme8n11 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 94.0k 143.2k 0.0k 940.0k 1.4M 0.0k nvme8n12 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 103.6k 125.2k 0.0k 1.0M 1.2M 0.0k nvme8n13 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 101.2k 121.6k 0.0k 1012.0k 1.2M 0.0k nvme8n14 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 84.0k 158.0k 0.0k 840.0k 1.5M 0.0k nvme8n15 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 123.2k 120.8k 0.0k 1.2M 1.2M 0.0k nvme8n16 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 132.4k 110.0k 0.0k 1.3M 1.1M 0.0k nvme8n17 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 122.4k 124.0k 0.0k 1.2M 1.2M 0.0k nvme8n18 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 110.4k 129.2k 0.0k 1.1M 1.3M 0.0k nvme8n19 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 105.2k 103.2k 0.0k 1.0M 1.0M 0.0k nvme8n2 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 101.2k 125.6k 0.0k 1012.0k 1.2M 0.0k nvme8n20 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 106.0k 108.4k 0.0k 1.0M 1.1M 0.0k nvme8n3 2024-03-25T09:27:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 11.00 115.2k 144.8k 0.0k 1.1M 1.4M 0.0k nvme8n4 2024-03-25T09:27:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 112.4k 88.4k 0.0k 1.1M 884.0k 0.0k nvme8n5 2024-03-25T09:27:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 125.6k 97.6k 0.0k 1.2M 976.0k 0.0k nvme8n6 2024-03-25T09:27:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 127.6k 94.4k 0.0k 1.2M 944.0k 0.0k nvme8n7 2024-03-25T09:27:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 127.6k 96.4k 0.0k 1.2M 964.0k 0.0k nvme8n8 2024-03-25T09:27:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.90 116.4k 128.0k 0.0k 1.1M 1.2M 0.0k nvme8n9 2024-03-25T09:27:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:27:59.704 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:27:59 smithi040 ceph-mon[33094]: pgmap v566: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 6.9 MiB/s wr, 655 op/s 2024-03-25T09:27:59.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:27:59 smithi059 ceph-mon[32732]: pgmap v566: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 6.9 MiB/s wr, 655 op/s 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 7/s 4/s 155 KiB/s 98 KiB/s 1.89 ms 288.05 us 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 7/s 5/s 134 KiB/s 114 KiB/s 1.62 ms 394.05 us 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 4/s 176 KiB/s 89 KiB/s 1.63 ms 412.00 us 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 4/s 130 KiB/s 131 KiB/s 1.50 ms 326.30 us 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 4/s 118 KiB/s 81 KiB/s 1.61 ms 391.53 us 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 4/s 176 KiB/s 105 KiB/s 1.87 ms 287.50 us 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 5/s 165 KiB/s 110 KiB/s 1.66 ms 284.24 us 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 5/s 139 KiB/s 106 KiB/s 1.52 ms 300.64 us 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 5/s 150 KiB/s 106 KiB/s 1.59 ms 297.82 us 2024-03-25T09:27:59.937 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 5/s 123 KiB/s 107 KiB/s 1.54 ms 273.02 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 5/s 130 KiB/s 130 KiB/s 1.69 ms 354.27 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 4/s 141 KiB/s 89 KiB/s 1.54 ms 274.34 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 5/s 118 KiB/s 99 KiB/s 1.49 ms 307.02 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 5/s 136 KiB/s 120 KiB/s 1.55 ms 372.54 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 4/s 110 KiB/s 96 KiB/s 1.68 ms 306.76 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 5/s 115 KiB/s 112 KiB/s 1.66 ms 323.40 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 114 KiB/s 82 KiB/s 1.52 ms 289.59 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 4/s 126 KiB/s 88 KiB/s 1.60 ms 300.05 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 4/s 99 KiB/s 110 KiB/s 1.60 ms 381.26 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 130 KiB/s 109 KiB/s 1.73 ms 284.24 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 5/s 147 KiB/s 130 KiB/s 1.63 ms 294.76 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 5/s 109 KiB/s 121 KiB/s 1.71 ms 335.09 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 5/s 93 KiB/s 110 KiB/s 1.77 ms 288.46 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 5/s 113 KiB/s 95 KiB/s 1.67 ms 277.13 us 2024-03-25T09:27:59.938 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 6/s 134 KiB/s 166 KiB/s 1.66 ms 335.22 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 6/s 139 KiB/s 159 KiB/s 1.62 ms 399.96 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 118 KiB/s 102 KiB/s 1.54 ms 284.85 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 6/s 79 KiB/s 139 KiB/s 1.62 ms 283.01 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 5/s 117 KiB/s 116 KiB/s 1.53 ms 306.92 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 5/s 134 KiB/s 88 KiB/s 1.56 ms 282.30 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 5/s 86 KiB/s 111 KiB/s 1.66 ms 282.00 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 4/s 113 KiB/s 84 KiB/s 1.55 ms 316.56 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 4/s 122 KiB/s 86 KiB/s 1.76 ms 316.02 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 95 KiB/s 126 KiB/s 1.56 ms 385.69 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 5/s 105 KiB/s 123 KiB/s 1.71 ms 304.36 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 111 KiB/s 96 KiB/s 1.67 ms 333.28 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 6/s 103 KiB/s 125 KiB/s 1.76 ms 300.91 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 5/s 107 KiB/s 121 KiB/s 1.63 ms 321.46 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 5/s 115 KiB/s 133 KiB/s 1.50 ms 352.09 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 5/s 92 KiB/s 134 KiB/s 1.87 ms 327.09 us 2024-03-25T09:27:59.939 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 5/s 102 KiB/s 143 KiB/s 1.54 ms 332.73 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 5/s 107 KiB/s 122 KiB/s 1.72 ms 378.20 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 5/s 117 KiB/s 112 KiB/s 1.59 ms 266.56 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 6/s 109 KiB/s 97 KiB/s 1.46 ms 304.20 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 5/s 123 KiB/s 103 KiB/s 1.85 ms 286.29 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 5/s 104 KiB/s 111 KiB/s 1.59 ms 306.49 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 7/s 95 KiB/s 154 KiB/s 1.52 ms 276.06 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 119 KiB/s 105 KiB/s 1.70 ms 330.82 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 5/s 95 KiB/s 101 KiB/s 1.85 ms 266.11 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 6/s 94 KiB/s 123 KiB/s 1.56 ms 343.18 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 79 KiB/s 66 KiB/s 1.55 ms 271.17 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 6/s 78 KiB/s 103 KiB/s 1.65 ms 297.64 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 6/s 98 KiB/s 99 KiB/s 1.62 ms 291.29 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 7/s 105 KiB/s 179 KiB/s 1.80 ms 312.80 us 2024-03-25T09:27:59.940 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 6/s 90 KiB/s 134 KiB/s 1.52 ms 278.70 us 2024-03-25T09:27:59.941 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 6/s 107 KiB/s 135 KiB/s 1.65 ms 294.60 us 2024-03-25T09:27:59.941 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 6/s 98 KiB/s 156 KiB/s 1.77 ms 304.08 us 2024-03-25T09:27:59.941 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 6/s 110 KiB/s 147 KiB/s 1.60 ms 273.39 us 2024-03-25T09:27:59.941 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 6/s 78 KiB/s 144 KiB/s 1.57 ms 291.99 us 2024-03-25T09:27:59.941 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 6/s 74 KiB/s 112 KiB/s 1.69 ms 265.14 us 2024-03-25T09:27:59.941 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:00.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:00.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:27:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:00.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:27:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:00.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:00.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:00.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:00.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:00.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:00.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:00.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:00.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 392 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:00.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:00 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:00.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:00 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:00.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:00 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:00.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:00 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:00.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:00 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:00.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:00 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:00.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:00 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:00.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:00 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 392 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:00.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:00 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:00.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:00 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:00.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:00 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:00.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:00 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:00.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:00 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:00.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:00 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:00.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:00 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:00.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:00 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 392 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:01.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:01.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:01.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:01.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:01 smithi059 ceph-mon[32732]: pgmap v567: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.6 MiB/s wr, 641 op/s 2024-03-25T09:28:01.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:01 smithi019 ceph-mon[29386]: pgmap v567: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.6 MiB/s wr, 641 op/s 2024-03-25T09:28:01.716 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:01 smithi040 ceph-mon[33094]: pgmap v567: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.6 MiB/s wr, 641 op/s 2024-03-25T09:28:02.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:02.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:02.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:03.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:03.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:03.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:02.799+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:03.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:03 smithi019 ceph-mon[29386]: pgmap v568: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.4 MiB/s wr, 724 op/s 2024-03-25T09:28:03.729 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:03 smithi040 ceph-mon[33094]: pgmap v568: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.4 MiB/s wr, 724 op/s 2024-03-25T09:28:03.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:03 smithi059 ceph-mon[32732]: pgmap v568: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.4 MiB/s wr, 724 op/s 2024-03-25T09:28:04.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:04.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:04.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:04.942 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:04.942 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 8/s 4/s 150 KiB/s 105 KiB/s 1.50 ms 245.61 us 2024-03-25T09:28:04.942 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 5/s 147 KiB/s 125 KiB/s 1.70 ms 361.82 us 2024-03-25T09:28:04.942 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 5/s 137 KiB/s 103 KiB/s 1.66 ms 323.57 us 2024-03-25T09:28:04.942 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 4/s 151 KiB/s 101 KiB/s 1.64 ms 293.01 us 2024-03-25T09:28:04.942 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 5/s 138 KiB/s 101 KiB/s 1.76 ms 284.89 us 2024-03-25T09:28:04.942 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 6/s 118 KiB/s 114 KiB/s 1.54 ms 258.36 us 2024-03-25T09:28:04.942 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 6/s 158 KiB/s 120 KiB/s 1.63 ms 311.37 us 2024-03-25T09:28:04.942 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 6/s 5/s 126 KiB/s 86 KiB/s 1.83 ms 277.93 us 2024-03-25T09:28:04.942 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 4/s 135 KiB/s 66 KiB/s 1.69 ms 318.80 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 5/s 132 KiB/s 126 KiB/s 1.60 ms 395.26 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 4/s 122 KiB/s 78 KiB/s 1.65 ms 279.31 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 5/s 138 KiB/s 112 KiB/s 1.63 ms 345.58 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 4/s 134 KiB/s 90 KiB/s 1.69 ms 332.90 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 6/s 5/s 115 KiB/s 90 KiB/s 1.58 ms 319.42 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 4/s 100 KiB/s 100 KiB/s 1.67 ms 348.68 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 5/s 122 KiB/s 96 KiB/s 2.05 ms 326.89 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 4/s 102 KiB/s 86 KiB/s 1.58 ms 320.48 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 4/s 110 KiB/s 75 KiB/s 1.69 ms 271.09 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 4/s 164 KiB/s 90 KiB/s 1.73 ms 315.11 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 4/s 132 KiB/s 99 KiB/s 1.68 ms 406.75 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 5/s 149 KiB/s 115 KiB/s 1.89 ms 298.13 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 5/s 118 KiB/s 129 KiB/s 1.57 ms 318.96 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 4/s 120 KiB/s 93 KiB/s 1.70 ms 302.56 us 2024-03-25T09:28:04.943 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 3/s 129 KiB/s 43 KiB/s 1.58 ms 268.94 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 4/s 132 KiB/s 90 KiB/s 1.68 ms 298.91 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 107 KiB/s 77 KiB/s 1.68 ms 254.24 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 4/s 127 KiB/s 90 KiB/s 1.45 ms 263.74 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 5/s 114 KiB/s 88 KiB/s 1.50 ms 289.52 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 129 KiB/s 101 KiB/s 1.68 ms 285.01 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 5/s 138 KiB/s 98 KiB/s 1.81 ms 280.16 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 6/s 111 KiB/s 161 KiB/s 1.52 ms 363.33 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 6/s 104 KiB/s 115 KiB/s 1.70 ms 372.57 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 6/s 112 KiB/s 159 KiB/s 1.59 ms 343.05 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 4/s 130 KiB/s 106 KiB/s 1.63 ms 290.91 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 5/s 124 KiB/s 93 KiB/s 1.86 ms 287.35 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 6/s 92 KiB/s 122 KiB/s 1.50 ms 294.80 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 5/s 86 KiB/s 126 KiB/s 1.54 ms 313.98 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 5/s 81 KiB/s 128 KiB/s 1.57 ms 312.21 us 2024-03-25T09:28:04.944 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 6/s 86 KiB/s 134 KiB/s 1.58 ms 282.50 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 138 KiB/s 126 KiB/s 1.71 ms 306.08 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 5/s 107 KiB/s 94 KiB/s 1.65 ms 285.86 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 102 KiB/s 116 KiB/s 1.55 ms 314.88 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 4/s 126 KiB/s 82 KiB/s 1.76 ms 411.09 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 5/s 94 KiB/s 115 KiB/s 1.68 ms 268.32 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 5/s 97 KiB/s 129 KiB/s 1.70 ms 314.14 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 5/s 122 KiB/s 93 KiB/s 1.70 ms 314.31 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 6/s 79 KiB/s 127 KiB/s 1.68 ms 324.47 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 5/s 124 KiB/s 105 KiB/s 1.59 ms 288.04 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 6/s 112 KiB/s 122 KiB/s 1.58 ms 295.90 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 5/s 102 KiB/s 94 KiB/s 1.93 ms 284.08 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 5/s 78 KiB/s 109 KiB/s 1.72 ms 298.15 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 6/s 106 KiB/s 147 KiB/s 1.71 ms 300.46 us 2024-03-25T09:28:04.945 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 5/s 102 KiB/s 98 KiB/s 1.50 ms 275.77 us 2024-03-25T09:28:04.946 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 5/s 114 KiB/s 101 KiB/s 1.80 ms 330.27 us 2024-03-25T09:28:04.946 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 7/s 86 KiB/s 143 KiB/s 1.60 ms 343.90 us 2024-03-25T09:28:04.946 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 6/s 90 KiB/s 146 KiB/s 1.62 ms 355.17 us 2024-03-25T09:28:04.946 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 5/s 116 KiB/s 112 KiB/s 1.67 ms 361.05 us 2024-03-25T09:28:04.946 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 7/s 74 KiB/s 162 KiB/s 1.60 ms 308.60 us 2024-03-25T09:28:04.946 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 5/s 91 KiB/s 80 KiB/s 1.65 ms 302.19 us 2024-03-25T09:28:04.946 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 5/s 76 KiB/s 130 KiB/s 1.55 ms 268.62 us 2024-03-25T09:28:04.946 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:05.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:05.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:05.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:05.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:05 smithi019 ceph-mon[29386]: pgmap v569: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.4 MiB/s wr, 622 op/s 2024-03-25T09:28:05.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:05 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:05.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:05 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:05.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:05 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:05.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:05 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:05.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:05 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:05.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:05 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:05.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:05 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:05.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:05 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 397 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:05.741 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-mon[33094]: pgmap v569: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.4 MiB/s wr, 622 op/s 2024-03-25T09:28:05.741 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:05.741 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:05.742 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:05.742 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:05.742 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:05.742 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:05.742 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:05.742 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 397 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:05 smithi059 ceph-mon[32732]: pgmap v569: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.4 MiB/s wr, 622 op/s 2024-03-25T09:28:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:05 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:05 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:05 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:05 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:05.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:05 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:05.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:05 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:05.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:05 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:05.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:05 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 397 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:06.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:07.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:07.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:07.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:07.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:07 smithi019 ceph-mon[29386]: pgmap v570: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.2 MiB/s wr, 714 op/s 2024-03-25T09:28:07.754 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:07 smithi040 ceph-mon[33094]: pgmap v570: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.2 MiB/s wr, 714 op/s 2024-03-25T09:28:07.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:07 smithi059 ceph-mon[32732]: pgmap v570: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.2 MiB/s wr, 714 op/s 2024-03-25T09:28:08.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:08.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:08.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:08.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:07.799+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:09.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:09.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:09.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:09.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:09 smithi019 ceph-mon[29386]: pgmap v571: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 659 op/s 2024-03-25T09:28:09.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 121.2k 88.8k 0.0k 1.2M 888.0k 0.0k nvme2n1 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 87.6k 126.0k 0.0k 876.0k 1.2M 0.0k nvme2n10 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 121.6k 101.2k 0.0k 1.2M 1012.0k 0.0k nvme2n11 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 134.4k 83.6k 0.0k 1.3M 836.0k 0.0k nvme2n12 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 116.4k 107.2k 0.0k 1.1M 1.0M 0.0k nvme2n13 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 81.2k 130.0k 0.0k 812.0k 1.3M 0.0k nvme2n14 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 116.4k 101.6k 0.0k 1.1M 1016.0k 0.0k nvme2n15 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 125.2k 95.6k 0.0k 1.2M 956.0k 0.0k nvme2n16 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 107.2k 96.8k 0.0k 1.0M 968.0k 0.0k nvme2n17 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 128.0k 86.4k 0.0k 1.2M 864.0k 0.0k nvme2n18 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 121.2k 79.6k 0.0k 1.2M 796.0k 0.0k nvme2n19 2024-03-25T09:28:09.687 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 118.8k 89.2k 0.0k 1.2M 892.0k 0.0k nvme2n2 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 85.2k 99.2k 0.0k 852.0k 992.0k 0.0k nvme2n20 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 109.6k 99.2k 0.0k 1.1M 992.0k 0.0k nvme2n3 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 106.8k 94.4k 0.0k 1.0M 944.0k 0.0k nvme2n4 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 128.8k 86.8k 0.0k 1.3M 868.0k 0.0k nvme2n5 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 106.8k 100.8k 0.0k 1.0M 1008.0k 0.0k nvme2n6 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 100.0k 121.2k 0.0k 1000.0k 1.2M 0.0k nvme2n7 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 118.8k 108.0k 0.0k 1.2M 1.1M 0.0k nvme2n8 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 106.0k 117.2k 0.0k 1.0M 1.1M 0.0k nvme2n9 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 89.6k 106.8k 0.0k 896.0k 1.0M 0.0k nvme5n1 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 96.8k 95.6k 0.0k 968.0k 956.0k 0.0k nvme5n10 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 104.8k 105.2k 0.0k 1.0M 1.0M 0.0k nvme5n11 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 144.0k 75.6k 0.0k 1.4M 756.0k 0.0k nvme5n12 2024-03-25T09:28:09.688 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 102.0k 115.2k 0.0k 1020.0k 1.1M 0.0k nvme5n13 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 113.2k 106.4k 0.0k 1.1M 1.0M 0.0k nvme5n14 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 84.8k 109.6k 0.0k 848.0k 1.1M 0.0k nvme5n15 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 106.8k 83.2k 0.0k 1.0M 832.0k 0.0k nvme5n16 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 119.2k 134.4k 0.0k 1.2M 1.3M 0.0k nvme5n17 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 120.4k 81.2k 0.0k 1.2M 812.0k 0.0k nvme5n18 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 97.6k 97.6k 0.0k 976.0k 976.0k 0.0k nvme5n19 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 120.0k 110.8k 0.0k 1.2M 1.1M 0.0k nvme5n2 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 104.0k 98.0k 0.0k 1.0M 980.0k 0.0k nvme5n20 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 120.0k 98.0k 0.0k 1.2M 980.0k 0.0k nvme5n3 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 98.0k 112.0k 0.0k 980.0k 1.1M 0.0k nvme5n4 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 126.4k 93.6k 0.0k 1.2M 936.0k 0.0k nvme5n5 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 100.0k 108.8k 0.0k 1000.0k 1.1M 0.0k nvme5n6 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 120.4k 95.2k 0.0k 1.2M 952.0k 0.0k nvme5n7 2024-03-25T09:28:09.689 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 101.6k 116.0k 0.0k 1016.0k 1.1M 0.0k nvme5n8 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 99.2k 106.4k 0.0k 992.0k 1.0M 0.0k nvme5n9 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 100.0k 112.0k 0.0k 1000.0k 1.1M 0.0k nvme8n1 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 102.8k 118.4k 0.0k 1.0M 1.2M 0.0k nvme8n10 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 64.0k 117.2k 0.0k 640.0k 1.1M 0.0k nvme8n11 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 98.4k 115.2k 0.0k 984.0k 1.1M 0.0k nvme8n12 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 125.6k 88.8k 0.0k 1.2M 888.0k 0.0k nvme8n13 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 132.4k 72.0k 0.0k 1.3M 720.0k 0.0k nvme8n14 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 105.6k 94.8k 0.0k 1.0M 948.0k 0.0k nvme8n15 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 139.6k 130.4k 0.0k 1.4M 1.3M 0.0k nvme8n16 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 105.2k 118.8k 0.0k 1.0M 1.2M 0.0k nvme8n17 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 78.4k 131.2k 0.0k 784.0k 1.3M 0.0k nvme8n18 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 112.0k 112.8k 0.0k 1.1M 1.1M 0.0k nvme8n19 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 135.6k 99.2k 0.0k 1.3M 992.0k 0.0k nvme8n2 2024-03-25T09:28:09.690 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 136.4k 68.4k 0.0k 1.3M 684.0k 0.0k nvme8n20 2024-03-25T09:28:09.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 116.0k 129.2k 0.0k 1.1M 1.3M 0.0k nvme8n3 2024-03-25T09:28:09.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.10 91.2k 141.2k 0.0k 912.0k 1.4M 0.0k nvme8n4 2024-03-25T09:28:09.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 106.4k 96.8k 0.0k 1.0M 968.0k 0.0k nvme8n5 2024-03-25T09:28:09.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 146.8k 82.0k 0.0k 1.4M 820.0k 0.0k nvme8n6 2024-03-25T09:28:09.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 78.4k 117.6k 0.0k 784.0k 1.1M 0.0k nvme8n7 2024-03-25T09:28:09.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 90.8k 104.0k 0.0k 908.0k 1.0M 0.0k nvme8n8 2024-03-25T09:28:09.691 INFO:tasks.workunit.client.3.smithi129.stdout: 11.20 109.2k 106.0k 0.0k 1.1M 1.0M 0.0k nvme8n9 2024-03-25T09:28:09.691 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:09.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:09 smithi059 ceph-mon[32732]: pgmap v571: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 659 op/s 2024-03-25T09:28:09.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:09 smithi040 ceph-mon[33094]: pgmap v571: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 659 op/s 2024-03-25T09:28:09.947 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:09.947 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 7/s 4/s 148 KiB/s 82 KiB/s 1.72 ms 333.30 us 2024-03-25T09:28:09.947 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 7/s 4/s 135 KiB/s 96 KiB/s 1.57 ms 330.95 us 2024-03-25T09:28:09.947 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 7/s 4/s 139 KiB/s 90 KiB/s 1.70 ms 336.45 us 2024-03-25T09:28:09.947 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 4/s 125 KiB/s 97 KiB/s 1.88 ms 309.24 us 2024-03-25T09:28:09.948 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 6/s 135 KiB/s 114 KiB/s 1.68 ms 288.63 us 2024-03-25T09:28:09.948 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 5/s 118 KiB/s 59 KiB/s 1.50 ms 260.58 us 2024-03-25T09:28:09.948 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 5/s 126 KiB/s 102 KiB/s 1.65 ms 346.58 us 2024-03-25T09:28:09.948 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 4/s 129 KiB/s 92 KiB/s 1.96 ms 316.71 us 2024-03-25T09:28:09.948 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 4/s 111 KiB/s 93 KiB/s 1.53 ms 318.00 us 2024-03-25T09:28:09.948 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 6/s 115 KiB/s 137 KiB/s 1.75 ms 269.40 us 2024-03-25T09:28:09.948 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 4/s 115 KiB/s 71 KiB/s 1.61 ms 270.00 us 2024-03-25T09:28:09.948 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 4/s 129 KiB/s 81 KiB/s 1.71 ms 321.99 us 2024-03-25T09:28:09.948 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 5/s 107 KiB/s 94 KiB/s 1.73 ms 308.94 us 2024-03-25T09:28:09.948 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 4/s 88 KiB/s 93 KiB/s 1.81 ms 344.94 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 6/s 108 KiB/s 106 KiB/s 1.80 ms 348.70 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 6/s 130 KiB/s 122 KiB/s 1.65 ms 329.66 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 8/s 114 KiB/s 123 KiB/s 1.57 ms 309.16 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 5/s 127 KiB/s 107 KiB/s 1.84 ms 291.55 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 4/s 118 KiB/s 74 KiB/s 1.68 ms 275.69 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 6/s 106 KiB/s 109 KiB/s 1.54 ms 358.69 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 5/s 98 KiB/s 96 KiB/s 1.52 ms 288.22 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 8/s 87 KiB/s 162 KiB/s 1.48 ms 268.23 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 5/s 117 KiB/s 90 KiB/s 1.65 ms 293.90 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 6/s 134 KiB/s 134 KiB/s 1.65 ms 364.74 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 6/s 119 KiB/s 126 KiB/s 1.64 ms 357.96 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 6/s 110 KiB/s 114 KiB/s 1.79 ms 351.11 us 2024-03-25T09:28:09.949 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 96 KiB/s 77 KiB/s 1.62 ms 275.48 us 2024-03-25T09:28:09.950 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 6/s 108 KiB/s 109 KiB/s 1.63 ms 365.24 us 2024-03-25T09:28:09.950 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 4/s 94 KiB/s 82 KiB/s 1.57 ms 289.67 us 2024-03-25T09:28:09.950 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 6/s 99 KiB/s 140 KiB/s 1.63 ms 322.70 us 2024-03-25T09:28:09.950 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 5/s 94 KiB/s 104 KiB/s 1.71 ms 281.53 us 2024-03-25T09:28:09.950 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 7/s 93 KiB/s 115 KiB/s 1.83 ms 293.89 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 6/s 96 KiB/s 115 KiB/s 1.69 ms 299.27 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 7/s 82 KiB/s 134 KiB/s 1.73 ms 283.67 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 5/s 143 KiB/s 98 KiB/s 1.66 ms 299.98 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 6/s 89 KiB/s 134 KiB/s 2.07 ms 372.04 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 7/s 115 KiB/s 114 KiB/s 1.54 ms 260.35 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 6/s 102 KiB/s 110 KiB/s 1.79 ms 326.68 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 6/s 100 KiB/s 138 KiB/s 1.58 ms 296.30 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 6/s 102 KiB/s 97 KiB/s 1.62 ms 287.58 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 5/s 84 KiB/s 125 KiB/s 1.60 ms 349.50 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 6/s 109 KiB/s 126 KiB/s 1.58 ms 253.62 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 7/s 95 KiB/s 128 KiB/s 1.64 ms 276.82 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 4/s 96 KiB/s 82 KiB/s 1.80 ms 341.22 us 2024-03-25T09:28:09.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 6/s 72 KiB/s 126 KiB/s 1.56 ms 314.51 us 2024-03-25T09:28:09.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 7/s 86 KiB/s 158 KiB/s 1.72 ms 289.47 us 2024-03-25T09:28:09.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 6/s 111 KiB/s 126 KiB/s 1.57 ms 270.21 us 2024-03-25T09:28:09.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 7/s 97 KiB/s 136 KiB/s 1.70 ms 274.26 us 2024-03-25T09:28:09.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 5/s 126 KiB/s 106 KiB/s 1.73 ms 364.40 us 2024-03-25T09:28:09.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 7/s 94 KiB/s 138 KiB/s 1.48 ms 342.96 us 2024-03-25T09:28:09.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 88 KiB/s 68 KiB/s 1.65 ms 300.87 us 2024-03-25T09:28:09.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 6/s 91 KiB/s 116 KiB/s 1.68 ms 291.78 us 2024-03-25T09:28:09.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 5/s 99 KiB/s 117 KiB/s 1.59 ms 259.24 us 2024-03-25T09:28:09.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 6/s 86 KiB/s 117 KiB/s 1.67 ms 307.13 us 2024-03-25T09:28:09.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 9/s 86 KiB/s 167 KiB/s 1.70 ms 322.60 us 2024-03-25T09:28:09.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 5/s 76 KiB/s 90 KiB/s 1.47 ms 254.44 us 2024-03-25T09:28:09.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 7/s 82 KiB/s 140 KiB/s 1.65 ms 345.21 us 2024-03-25T09:28:09.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 7/s 69 KiB/s 126 KiB/s 1.66 ms 308.29 us 2024-03-25T09:28:09.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 7/s 72 KiB/s 147 KiB/s 1.87 ms 323.25 us 2024-03-25T09:28:09.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 6/s 72 KiB/s 144 KiB/s 1.61 ms 344.34 us 2024-03-25T09:28:09.954 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:10.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:10.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:10.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:10.661 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:10.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:10.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:10.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:10.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:10.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:10.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:10.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 402 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:10.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:10 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:10.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:10 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:10.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:10 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:10 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:10 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:10 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:10 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:10.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:10 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 402 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:10 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:10 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:10 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:10 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:10 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:10 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:10 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:10 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 402 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:11.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:11.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:11 smithi019 ceph-mon[29386]: pgmap v572: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.2 MiB/s wr, 657 op/s 2024-03-25T09:28:11.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:11 smithi059 ceph-mon[32732]: pgmap v572: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.2 MiB/s wr, 657 op/s 2024-03-25T09:28:11.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:11 smithi040 ceph-mon[33094]: pgmap v572: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.2 MiB/s wr, 657 op/s 2024-03-25T09:28:12.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:12.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:12.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:13.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:13.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:13.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:12.799+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:13.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:13 smithi019 ceph-mon[29386]: pgmap v573: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 726 op/s 2024-03-25T09:28:13.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:13 smithi059 ceph-mon[32732]: pgmap v573: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 726 op/s 2024-03-25T09:28:13.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:13 smithi040 ceph-mon[33094]: pgmap v573: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 726 op/s 2024-03-25T09:28:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:14.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:14.951 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:14.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 7/s 6/s 160 KiB/s 153 KiB/s 2.01 ms 362.66 us 2024-03-25T09:28:14.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 7/s 3/s 131 KiB/s 76 KiB/s 1.76 ms 277.66 us 2024-03-25T09:28:14.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 6/s 110 KiB/s 150 KiB/s 1.79 ms 307.02 us 2024-03-25T09:28:14.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 5/s 134 KiB/s 82 KiB/s 1.67 ms 294.81 us 2024-03-25T09:28:14.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 6/s 6/s 118 KiB/s 113 KiB/s 1.95 ms 333.09 us 2024-03-25T09:28:14.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 4/s 159 KiB/s 111 KiB/s 1.74 ms 307.93 us 2024-03-25T09:28:14.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 6/s 106 KiB/s 142 KiB/s 1.73 ms 281.52 us 2024-03-25T09:28:14.951 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 6/s 6/s 159 KiB/s 140 KiB/s 1.59 ms 279.17 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 7/s 142 KiB/s 128 KiB/s 1.70 ms 297.68 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 6/s 103 KiB/s 115 KiB/s 1.79 ms 314.52 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 5/s 151 KiB/s 111 KiB/s 1.75 ms 403.94 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 5/s 108 KiB/s 90 KiB/s 1.62 ms 438.88 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 3/s 82 KiB/s 51 KiB/s 1.74 ms 386.27 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 4/s 107 KiB/s 66 KiB/s 1.69 ms 275.50 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 4/s 111 KiB/s 99 KiB/s 1.71 ms 300.56 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 4/s 96 KiB/s 76 KiB/s 1.72 ms 358.88 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 113 KiB/s 62 KiB/s 1.62 ms 256.49 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 5/s 125 KiB/s 93 KiB/s 1.56 ms 269.33 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 4/s 79 KiB/s 91 KiB/s 1.66 ms 280.19 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 4/s 138 KiB/s 86 KiB/s 1.67 ms 368.31 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 110 KiB/s 64 KiB/s 1.68 ms 316.03 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 6/s 171 KiB/s 130 KiB/s 1.70 ms 340.63 us 2024-03-25T09:28:14.952 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 4/s 71 KiB/s 108 KiB/s 1.59 ms 285.44 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 107 KiB/s 96 KiB/s 1.58 ms 300.48 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 5/s 122 KiB/s 135 KiB/s 1.67 ms 327.82 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 5/s 87 KiB/s 112 KiB/s 1.65 ms 318.39 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 6/s 114 KiB/s 138 KiB/s 1.67 ms 315.04 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 5/s 104 KiB/s 80 KiB/s 1.96 ms 296.46 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 5/s 92 KiB/s 81 KiB/s 1.71 ms 281.73 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 5/s 132 KiB/s 80 KiB/s 1.63 ms 310.53 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 5/s 119 KiB/s 98 KiB/s 2.07 ms 294.66 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 5/s 110 KiB/s 124 KiB/s 1.76 ms 298.14 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 5/s 79 KiB/s 97 KiB/s 1.55 ms 276.65 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 7/s 87 KiB/s 168 KiB/s 1.66 ms 274.14 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 4/s 142 KiB/s 129 KiB/s 1.77 ms 389.22 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 5/s 147 KiB/s 112 KiB/s 1.62 ms 271.21 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 5/s 88 KiB/s 75 KiB/s 1.94 ms 296.12 us 2024-03-25T09:28:14.953 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 6/s 106 KiB/s 110 KiB/s 1.55 ms 301.49 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 6/s 89 KiB/s 106 KiB/s 1.58 ms 286.60 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 8/s 161 KiB/s 231 KiB/s 1.83 ms 361.49 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 6/s 100 KiB/s 102 KiB/s 1.77 ms 273.93 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 92 KiB/s 75 KiB/s 1.82 ms 292.06 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 6/s 92 KiB/s 118 KiB/s 1.82 ms 257.07 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 7/s 58 KiB/s 163 KiB/s 1.68 ms 342.50 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 5/s 121 KiB/s 131 KiB/s 1.63 ms 266.03 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 6/s 87 KiB/s 128 KiB/s 1.61 ms 418.02 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 5/s 80 KiB/s 79 KiB/s 1.76 ms 309.22 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 7/s 71 KiB/s 165 KiB/s 1.85 ms 307.08 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 5/s 108 KiB/s 133 KiB/s 1.53 ms 276.53 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 5/s 90 KiB/s 88 KiB/s 1.72 ms 352.14 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 7/s 66 KiB/s 93 KiB/s 1.56 ms 272.75 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 3/s 65 KiB/s 64 KiB/s 1.54 ms 257.22 us 2024-03-25T09:28:14.954 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 6/s 94 KiB/s 125 KiB/s 1.57 ms 336.16 us 2024-03-25T09:28:14.955 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 5/s 75 KiB/s 90 KiB/s 1.90 ms 439.41 us 2024-03-25T09:28:14.955 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 5/s 72 KiB/s 110 KiB/s 1.80 ms 375.59 us 2024-03-25T09:28:14.955 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 5/s 117 KiB/s 173 KiB/s 1.77 ms 328.93 us 2024-03-25T09:28:14.955 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 5/s 43 KiB/s 90 KiB/s 1.58 ms 299.75 us 2024-03-25T09:28:14.955 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 61 KiB/s 67 KiB/s 1.65 ms 306.24 us 2024-03-25T09:28:14.955 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 5/s 58 KiB/s 113 KiB/s 1.57 ms 293.70 us 2024-03-25T09:28:14.955 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 5/s 52 KiB/s 103 KiB/s 1.77 ms 297.48 us 2024-03-25T09:28:14.955 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:15.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:15.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:15.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:15.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:15 smithi019 ceph-mon[29386]: pgmap v574: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 628 op/s 2024-03-25T09:28:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:15 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:15 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:15 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:15 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:15 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:15 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:15 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:15.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:15 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 407 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:15.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:15 smithi059 ceph-mon[32732]: pgmap v574: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 628 op/s 2024-03-25T09:28:15.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:15 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:15 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:15 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:15 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:15 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:15 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:15 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:15.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:15 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 407 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-mon[33094]: pgmap v574: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 628 op/s 2024-03-25T09:28:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:15.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:15.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:15.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 407 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:16.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:16.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:16.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:17.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:17.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:17 smithi019 ceph-mon[29386]: pgmap v575: 33 pgs: 33 active+clean; 1.0 GiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 6.8 MiB/s wr, 722 op/s 2024-03-25T09:28:17.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:17 smithi059 ceph-mon[32732]: pgmap v575: 33 pgs: 33 active+clean; 1.0 GiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 6.8 MiB/s wr, 722 op/s 2024-03-25T09:28:17.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:17 smithi040 ceph-mon[33094]: pgmap v575: 33 pgs: 33 active+clean; 1.0 GiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 6.8 MiB/s wr, 722 op/s 2024-03-25T09:28:18.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:17.800+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:18.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:18.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:18.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:19.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:19.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:19.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:19.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:19 smithi019 ceph-mon[29386]: pgmap v576: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.2 MiB/s wr, 650 op/s 2024-03-25T09:28:19.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:28:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 183.6k 137.2k 0.0k 1.8M 1.3M 0.0k nvme2n1 2024-03-25T09:28:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 168.0k 172.4k 0.0k 1.6M 1.7M 0.0k nvme2n10 2024-03-25T09:28:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 85.2k 95.6k 0.0k 852.0k 956.0k 0.0k nvme2n11 2024-03-25T09:28:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 97.6k 112.0k 0.0k 976.0k 1.1M 0.0k nvme2n12 2024-03-25T09:28:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 123.2k 160.4k 0.0k 1.2M 1.6M 0.0k nvme2n13 2024-03-25T09:28:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 82.0k 139.6k 0.0k 820.0k 1.4M 0.0k nvme2n14 2024-03-25T09:28:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 116.0k 142.0k 0.0k 1.1M 1.4M 0.0k nvme2n15 2024-03-25T09:28:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 111.6k 107.2k 0.0k 1.1M 1.0M 0.0k nvme2n16 2024-03-25T09:28:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 90.0k 103.6k 0.0k 900.0k 1.0M 0.0k nvme2n17 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 143.2k 140.0k 0.0k 1.4M 1.4M 0.0k nvme2n18 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 94.4k 106.0k 0.0k 944.0k 1.0M 0.0k nvme2n19 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 134.0k 122.8k 0.0k 1.3M 1.2M 0.0k nvme2n2 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 203.2k 163.2k 0.0k 2.0M 1.6M 0.0k nvme2n20 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 150.8k 116.8k 0.0k 1.5M 1.1M 0.0k nvme2n3 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 171.2k 128.0k 0.0k 1.7M 1.2M 0.0k nvme2n4 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 138.4k 135.2k 0.0k 1.4M 1.3M 0.0k nvme2n5 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 166.8k 201.2k 0.0k 1.6M 2.0M 0.0k nvme2n6 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 158.4k 180.4k 0.0k 1.5M 1.8M 0.0k nvme2n7 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 132.8k 187.2k 0.0k 1.3M 1.8M 0.0k nvme2n8 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 124.8k 148.0k 0.0k 1.2M 1.4M 0.0k nvme2n9 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 184.0k 150.4k 0.0k 1.8M 1.5M 0.0k nvme5n1 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 99.6k 83.2k 0.0k 996.0k 832.0k 0.0k nvme5n10 2024-03-25T09:28:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 156.0k 118.4k 0.0k 1.5M 1.2M 0.0k nvme5n11 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 101.6k 120.4k 0.0k 1016.0k 1.2M 0.0k nvme5n12 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 130.8k 110.4k 0.0k 1.3M 1.1M 0.0k nvme5n13 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 82.4k 118.0k 0.0k 824.0k 1.2M 0.0k nvme5n14 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 113.6k 114.8k 0.0k 1.1M 1.1M 0.0k nvme5n15 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 152.4k 170.8k 0.0k 1.5M 1.7M 0.0k nvme5n16 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 164.8k 155.2k 0.0k 1.6M 1.5M 0.0k nvme5n17 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 161.6k 111.6k 0.0k 1.6M 1.1M 0.0k nvme5n18 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 73.2k 131.2k 0.0k 732.0k 1.3M 0.0k nvme5n19 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 164.8k 140.8k 0.0k 1.6M 1.4M 0.0k nvme5n2 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 129.6k 100.8k 0.0k 1.3M 1008.0k 0.0k nvme5n20 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 100.8k 90.4k 0.0k 1008.0k 904.0k 0.0k nvme5n3 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 92.4k 106.4k 0.0k 924.0k 1.0M 0.0k nvme5n4 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 165.2k 136.4k 0.0k 1.6M 1.3M 0.0k nvme5n5 2024-03-25T09:28:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 118.8k 114.8k 0.0k 1.2M 1.1M 0.0k nvme5n6 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 171.6k 166.4k 0.0k 1.7M 1.6M 0.0k nvme5n7 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 127.6k 83.6k 0.0k 1.2M 836.0k 0.0k nvme5n8 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 148.4k 187.2k 0.0k 1.4M 1.8M 0.0k nvme5n9 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 130.0k 115.2k 0.0k 1.3M 1.1M 0.0k nvme8n1 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 180.0k 148.4k 0.0k 1.8M 1.4M 0.0k nvme8n10 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 147.6k 143.2k 0.0k 1.4M 1.4M 0.0k nvme8n11 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 102.4k 111.2k 0.0k 1.0M 1.1M 0.0k nvme8n12 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 153.2k 103.2k 0.0k 1.5M 1.0M 0.0k nvme8n13 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 158.0k 182.0k 0.0k 1.5M 1.8M 0.0k nvme8n14 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 76.4k 108.0k 0.0k 764.0k 1.1M 0.0k nvme8n15 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 152.0k 180.4k 0.0k 1.5M 1.8M 0.0k nvme8n16 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 119.2k 107.6k 0.0k 1.2M 1.1M 0.0k nvme8n17 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 97.2k 128.8k 0.0k 972.0k 1.3M 0.0k nvme8n18 2024-03-25T09:28:19.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 124.4k 131.6k 0.0k 1.2M 1.3M 0.0k nvme8n19 2024-03-25T09:28:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 149.6k 112.8k 0.0k 1.5M 1.1M 0.0k nvme8n2 2024-03-25T09:28:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 148.8k 152.4k 0.0k 1.5M 1.5M 0.0k nvme8n20 2024-03-25T09:28:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 122.0k 131.6k 0.0k 1.2M 1.3M 0.0k nvme8n3 2024-03-25T09:28:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 120.4k 114.0k 0.0k 1.2M 1.1M 0.0k nvme8n4 2024-03-25T09:28:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 127.6k 126.0k 0.0k 1.2M 1.2M 0.0k nvme8n5 2024-03-25T09:28:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.80 126.0k 116.8k 0.0k 1.2M 1.1M 0.0k nvme8n6 2024-03-25T09:28:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 119.2k 95.6k 0.0k 1.2M 956.0k 0.0k nvme8n7 2024-03-25T09:28:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 166.4k 138.0k 0.0k 1.6M 1.3M 0.0k nvme8n8 2024-03-25T09:28:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.70 101.6k 98.0k 0.0k 1016.0k 980.0k 0.0k nvme8n9 2024-03-25T09:28:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:19.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:19 smithi059 ceph-mon[32732]: pgmap v576: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.2 MiB/s wr, 650 op/s 2024-03-25T09:28:19.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:19 smithi040 ceph-mon[33094]: pgmap v576: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.2 MiB/s wr, 650 op/s 2024-03-25T09:28:19.956 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:19.956 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 8/s 3/s 150 KiB/s 82 KiB/s 1.86 ms 293.89 us 2024-03-25T09:28:19.956 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 7/s 4/s 200 KiB/s 167 KiB/s 1.93 ms 377.49 us 2024-03-25T09:28:19.957 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 4/s 190 KiB/s 102 KiB/s 1.76 ms 238.36 us 2024-03-25T09:28:19.957 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 4/s 138 KiB/s 74 KiB/s 1.70 ms 254.39 us 2024-03-25T09:28:19.957 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 5/s 198 KiB/s 142 KiB/s 1.79 ms 416.12 us 2024-03-25T09:28:19.957 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 4/s 130 KiB/s 113 KiB/s 1.63 ms 381.52 us 2024-03-25T09:28:19.957 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 5/s 233 KiB/s 176 KiB/s 1.63 ms 369.66 us 2024-03-25T09:28:19.957 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 8/s 145 KiB/s 178 KiB/s 1.55 ms 308.30 us 2024-03-25T09:28:19.957 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 6/s 5/s 155 KiB/s 153 KiB/s 1.78 ms 330.36 us 2024-03-25T09:28:19.957 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 5/s 166 KiB/s 181 KiB/s 1.85 ms 293.41 us 2024-03-25T09:28:19.957 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 8/s 113 KiB/s 138 KiB/s 1.78 ms 322.08 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 5/s 108 KiB/s 109 KiB/s 1.71 ms 286.92 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 6/s 114 KiB/s 154 KiB/s 1.78 ms 297.11 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 6/s 176 KiB/s 159 KiB/s 1.77 ms 350.55 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 6/s 170 KiB/s 164 KiB/s 1.76 ms 297.72 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 7/s 117 KiB/s 188 KiB/s 1.69 ms 323.52 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 4/s 129 KiB/s 83 KiB/s 1.57 ms 259.51 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 6/s 104 KiB/s 98 KiB/s 1.59 ms 334.57 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 5/s 116 KiB/s 97 KiB/s 1.54 ms 276.00 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 90 KiB/s 71 KiB/s 1.62 ms 297.08 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 5/s 162 KiB/s 174 KiB/s 1.87 ms 317.16 us 2024-03-25T09:28:19.958 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 7/s 102 KiB/s 125 KiB/s 1.50 ms 285.73 us 2024-03-25T09:28:19.959 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 7/s 136 KiB/s 146 KiB/s 1.65 ms 285.38 us 2024-03-25T09:28:19.959 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 5/s 129 KiB/s 116 KiB/s 1.69 ms 304.98 us 2024-03-25T09:28:19.959 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 5/s 103 KiB/s 105 KiB/s 1.62 ms 250.30 us 2024-03-25T09:28:19.959 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 7/s 98 KiB/s 122 KiB/s 1.61 ms 369.86 us 2024-03-25T09:28:19.959 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 162 KiB/s 136 KiB/s 1.84 ms 352.74 us 2024-03-25T09:28:19.959 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 5/s 114 KiB/s 111 KiB/s 2.06 ms 277.24 us 2024-03-25T09:28:19.959 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 5/s 84 KiB/s 112 KiB/s 1.67 ms 363.89 us 2024-03-25T09:28:19.960 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 3/s 169 KiB/s 125 KiB/s 1.58 ms 400.40 us 2024-03-25T09:28:19.960 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 6/s 92 KiB/s 114 KiB/s 1.82 ms 359.06 us 2024-03-25T09:28:19.960 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 5/s 204 KiB/s 201 KiB/s 2.21 ms 320.01 us 2024-03-25T09:28:19.960 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 5/s 149 KiB/s 160 KiB/s 1.79 ms 318.92 us 2024-03-25T09:28:19.960 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 5/s 84 KiB/s 102 KiB/s 1.70 ms 332.45 us 2024-03-25T09:28:19.960 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 5/s 105 KiB/s 106 KiB/s 1.68 ms 324.07 us 2024-03-25T09:28:19.960 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 4/s 94 KiB/s 104 KiB/s 1.66 ms 288.67 us 2024-03-25T09:28:19.960 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 3/s 139 KiB/s 104 KiB/s 1.54 ms 349.64 us 2024-03-25T09:28:19.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 99 KiB/s 118 KiB/s 1.60 ms 279.42 us 2024-03-25T09:28:19.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 82 KiB/s 82 KiB/s 1.76 ms 283.10 us 2024-03-25T09:28:19.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 113 KiB/s 94 KiB/s 1.46 ms 252.72 us 2024-03-25T09:28:19.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 6/s 133 KiB/s 226 KiB/s 1.61 ms 309.00 us 2024-03-25T09:28:19.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 6/s 127 KiB/s 183 KiB/s 1.66 ms 398.24 us 2024-03-25T09:28:19.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 157 KiB/s 154 KiB/s 1.87 ms 332.18 us 2024-03-25T09:28:19.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 5/s 110 KiB/s 127 KiB/s 1.64 ms 287.09 us 2024-03-25T09:28:19.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 5/s 85 KiB/s 134 KiB/s 1.63 ms 416.88 us 2024-03-25T09:28:19.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 87 KiB/s 86 KiB/s 1.66 ms 293.11 us 2024-03-25T09:28:19.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 78 KiB/s 103 KiB/s 1.74 ms 296.80 us 2024-03-25T09:28:19.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 5/s 88 KiB/s 99 KiB/s 1.80 ms 322.69 us 2024-03-25T09:28:19.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 5/s 114 KiB/s 159 KiB/s 1.72 ms 343.35 us 2024-03-25T09:28:19.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 146 KiB/s 166 KiB/s 1.88 ms 441.68 us 2024-03-25T09:28:19.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 6/s 94 KiB/s 188 KiB/s 1.87 ms 338.59 us 2024-03-25T09:28:19.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 6/s 76 KiB/s 129 KiB/s 1.69 ms 262.25 us 2024-03-25T09:28:19.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 5/s 70 KiB/s 81 KiB/s 1.67 ms 322.71 us 2024-03-25T09:28:19.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 5/s 86 KiB/s 150 KiB/s 1.63 ms 295.57 us 2024-03-25T09:28:19.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 6/s 104 KiB/s 120 KiB/s 1.73 ms 406.54 us 2024-03-25T09:28:19.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 93 KiB/s 149 KiB/s 1.68 ms 321.33 us 2024-03-25T09:28:19.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 5/s 79 KiB/s 126 KiB/s 1.68 ms 326.43 us 2024-03-25T09:28:19.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 5/s 134 KiB/s 167 KiB/s 1.81 ms 351.33 us 2024-03-25T09:28:19.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 4/s 80 KiB/s 81 KiB/s 1.81 ms 271.26 us 2024-03-25T09:28:19.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 7/s 137 KiB/s 240 KiB/s 1.73 ms 358.09 us 2024-03-25T09:28:19.964 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:20.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:20.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:20.265 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:20.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:20.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:20.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:20.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:20.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:20.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:20.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:20.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 412 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:20 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:20 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:20 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:20 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:20 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:20 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:20.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:20 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:20.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:20 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 412 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:20 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:20 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:20 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:20 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:20 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:20 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:20 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:20 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 412 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:21.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:21.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:21.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:21.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:21 smithi019 ceph-mon[29386]: pgmap v577: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.4 MiB/s wr, 629 op/s 2024-03-25T09:28:21.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:21 smithi059 ceph-mon[32732]: pgmap v577: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.4 MiB/s wr, 629 op/s 2024-03-25T09:28:21.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:21 smithi040 ceph-mon[33094]: pgmap v577: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.4 MiB/s wr, 629 op/s 2024-03-25T09:28:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:22.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:22.800+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:23.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:23.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:23.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:23.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:23 smithi019 ceph-mon[29386]: pgmap v578: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 698 op/s 2024-03-25T09:28:23.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:23 smithi059 ceph-mon[32732]: pgmap v578: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 698 op/s 2024-03-25T09:28:23.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:23 smithi040 ceph-mon[33094]: pgmap v578: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 698 op/s 2024-03-25T09:28:24.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:24.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:24.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:24.960 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:24.960 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 7/s 5/s 207 KiB/s 146 KiB/s 1.78 ms 420.04 us 2024-03-25T09:28:24.960 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 7/s 4/s 219 KiB/s 117 KiB/s 1.95 ms 340.94 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 7/s 5/s 182 KiB/s 120 KiB/s 1.74 ms 309.33 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 7/s 4/s 194 KiB/s 143 KiB/s 1.70 ms 285.03 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 7/s 4/s 166 KiB/s 66 KiB/s 1.65 ms 245.77 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 6/s 229 KiB/s 194 KiB/s 1.71 ms 307.97 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 6/s 155 KiB/s 154 KiB/s 1.65 ms 343.65 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 4/s 210 KiB/s 144 KiB/s 1.78 ms 284.73 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 4/s 178 KiB/s 131 KiB/s 1.67 ms 303.51 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 4/s 152 KiB/s 88 KiB/s 1.48 ms 248.19 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 5/s 190 KiB/s 154 KiB/s 1.73 ms 327.41 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 3/s 222 KiB/s 140 KiB/s 1.75 ms 340.01 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 5/s 188 KiB/s 169 KiB/s 1.79 ms 403.70 us 2024-03-25T09:28:24.961 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 4/s 168 KiB/s 133 KiB/s 1.77 ms 434.17 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 5/s 166 KiB/s 99 KiB/s 1.68 ms 339.24 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 4/s 183 KiB/s 162 KiB/s 1.58 ms 314.20 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 6/s 5/s 171 KiB/s 130 KiB/s 1.81 ms 308.84 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 5/s 150 KiB/s 129 KiB/s 1.71 ms 299.26 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 6/s 147 KiB/s 203 KiB/s 1.65 ms 382.32 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 5/s 200 KiB/s 130 KiB/s 1.72 ms 289.10 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 5/s 182 KiB/s 142 KiB/s 1.60 ms 322.51 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 5/s 189 KiB/s 166 KiB/s 1.71 ms 270.93 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 5/s 170 KiB/s 154 KiB/s 1.63 ms 375.57 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 4/s 182 KiB/s 110 KiB/s 1.88 ms 314.81 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 5/s 175 KiB/s 135 KiB/s 1.78 ms 271.75 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 5/s 177 KiB/s 162 KiB/s 1.84 ms 278.33 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 4/s 206 KiB/s 126 KiB/s 1.84 ms 311.96 us 2024-03-25T09:28:24.962 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 4/s 205 KiB/s 111 KiB/s 1.66 ms 283.73 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 5/s 126 KiB/s 130 KiB/s 2.05 ms 342.12 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 5/s 229 KiB/s 183 KiB/s 1.59 ms 325.55 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 6/s 142 KiB/s 175 KiB/s 1.60 ms 430.24 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 6/s 161 KiB/s 186 KiB/s 1.78 ms 303.41 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 4/s 163 KiB/s 136 KiB/s 2.23 ms 327.75 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 5/s 162 KiB/s 158 KiB/s 1.63 ms 290.34 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 6/s 177 KiB/s 206 KiB/s 1.72 ms 302.09 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 5/s 150 KiB/s 156 KiB/s 1.69 ms 336.75 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 6/s 158 KiB/s 202 KiB/s 1.89 ms 342.14 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 6/s 183 KiB/s 186 KiB/s 1.66 ms 309.38 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 6/s 159 KiB/s 188 KiB/s 1.65 ms 382.81 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 5/s 163 KiB/s 154 KiB/s 1.75 ms 368.44 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 165 KiB/s 161 KiB/s 1.84 ms 372.38 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 5/s 136 KiB/s 164 KiB/s 1.71 ms 371.62 us 2024-03-25T09:28:24.963 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 158 KiB/s 174 KiB/s 1.85 ms 418.88 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 5/s 119 KiB/s 137 KiB/s 1.67 ms 374.66 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 6/s 139 KiB/s 160 KiB/s 1.83 ms 359.29 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 99 KiB/s 99 KiB/s 1.74 ms 361.44 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 6/s 137 KiB/s 183 KiB/s 2.03 ms 318.46 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 5/s 152 KiB/s 153 KiB/s 1.68 ms 334.07 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 6/s 102 KiB/s 105 KiB/s 1.74 ms 329.09 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 5/s 106 KiB/s 165 KiB/s 1.82 ms 331.41 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 5/s 141 KiB/s 180 KiB/s 1.54 ms 269.75 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 138 KiB/s 126 KiB/s 1.75 ms 321.31 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 6/s 110 KiB/s 164 KiB/s 1.67 ms 283.19 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 5/s 138 KiB/s 154 KiB/s 1.75 ms 298.83 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 5/s 91 KiB/s 148 KiB/s 1.79 ms 287.77 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 5/s 79 KiB/s 99 KiB/s 1.58 ms 241.20 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 108 KiB/s 101 KiB/s 1.64 ms 271.57 us 2024-03-25T09:28:24.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 5/s 117 KiB/s 194 KiB/s 2.01 ms 370.43 us 2024-03-25T09:28:24.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 5/s 61 KiB/s 125 KiB/s 1.59 ms 310.50 us 2024-03-25T09:28:24.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 121 KiB/s 156 KiB/s 2.34 ms 298.25 us 2024-03-25T09:28:24.965 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:25.344 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:25.344 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:25.344 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:25.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:25 smithi019 ceph-mon[29386]: pgmap v579: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.4 MiB/s wr, 604 op/s 2024-03-25T09:28:25.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:25 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:25.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:25 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:25 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:25 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:25 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:25 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:25 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:25.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:25 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 417 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:25 smithi059 ceph-mon[32732]: pgmap v579: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.4 MiB/s wr, 604 op/s 2024-03-25T09:28:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:25 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:25 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:25 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:25 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:25 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:25.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:25 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:25.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:25 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:25.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:25 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 417 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:25.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-mon[33094]: pgmap v579: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.4 MiB/s wr, 604 op/s 2024-03-25T09:28:25.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:25.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:25.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:25.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:25.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:25.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:25.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:25.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 417 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:26.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:26.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:26.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:27.346 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:27.346 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:27.346 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:27.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:27 smithi019 ceph-mon[29386]: pgmap v580: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.8 MiB/s wr, 682 op/s 2024-03-25T09:28:27.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:27 smithi059 ceph-mon[32732]: pgmap v580: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.8 MiB/s wr, 682 op/s 2024-03-25T09:28:27.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:27 smithi040 ceph-mon[33094]: pgmap v580: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.8 MiB/s wr, 682 op/s 2024-03-25T09:28:28.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:27.800+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:28.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:28.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:28.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:29.348 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:29.348 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:29.348 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:29.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:29 smithi019 ceph-mon[29386]: pgmap v581: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.5 MiB/s wr, 619 op/s 2024-03-25T09:28:29.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:28:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 104.8k 181.2k 0.0k 1.0M 1.8M 0.0k nvme2n1 2024-03-25T09:28:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 145.6k 168.0k 0.0k 1.4M 1.6M 0.0k nvme2n10 2024-03-25T09:28:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 168.0k 164.0k 0.0k 1.6M 1.6M 0.0k nvme2n11 2024-03-25T09:28:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 152.4k 161.6k 0.0k 1.5M 1.6M 0.0k nvme2n12 2024-03-25T09:28:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 160.8k 118.8k 0.0k 1.6M 1.2M 0.0k nvme2n13 2024-03-25T09:28:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 205.6k 130.8k 0.0k 2.0M 1.3M 0.0k nvme2n14 2024-03-25T09:28:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 146.8k 200.4k 0.0k 1.4M 2.0M 0.0k nvme2n15 2024-03-25T09:28:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 160.8k 145.6k 0.0k 1.6M 1.4M 0.0k nvme2n16 2024-03-25T09:28:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 169.6k 163.2k 0.0k 1.7M 1.6M 0.0k nvme2n17 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 152.0k 166.4k 0.0k 1.5M 1.6M 0.0k nvme2n18 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 179.2k 143.2k 0.0k 1.8M 1.4M 0.0k nvme2n19 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 156.0k 152.4k 0.0k 1.5M 1.5M 0.0k nvme2n2 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 151.6k 172.8k 0.0k 1.5M 1.7M 0.0k nvme2n20 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 203.6k 126.0k 0.0k 2.0M 1.2M 0.0k nvme2n3 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 162.4k 164.0k 0.0k 1.6M 1.6M 0.0k nvme2n4 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 136.4k 162.4k 0.0k 1.3M 1.6M 0.0k nvme2n5 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 174.0k 151.6k 0.0k 1.7M 1.5M 0.0k nvme2n6 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 162.0k 127.2k 0.0k 1.6M 1.2M 0.0k nvme2n7 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 150.8k 153.6k 0.0k 1.5M 1.5M 0.0k nvme2n8 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 139.6k 168.0k 0.0k 1.4M 1.6M 0.0k nvme2n9 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 125.6k 171.2k 0.0k 1.2M 1.7M 0.0k nvme5n1 2024-03-25T09:28:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 184.0k 139.6k 0.0k 1.8M 1.4M 0.0k nvme5n10 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 155.6k 146.0k 0.0k 1.5M 1.4M 0.0k nvme5n11 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 201.2k 132.8k 0.0k 2.0M 1.3M 0.0k nvme5n12 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 126.8k 142.4k 0.0k 1.2M 1.4M 0.0k nvme5n13 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 156.4k 143.2k 0.0k 1.5M 1.4M 0.0k nvme5n14 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 171.2k 142.8k 0.0k 1.7M 1.4M 0.0k nvme5n15 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 173.2k 162.4k 0.0k 1.7M 1.6M 0.0k nvme5n16 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 146.4k 143.6k 0.0k 1.4M 1.4M 0.0k nvme5n17 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 170.0k 144.8k 0.0k 1.7M 1.4M 0.0k nvme5n18 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 170.4k 164.8k 0.0k 1.7M 1.6M 0.0k nvme5n19 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 166.8k 176.4k 0.0k 1.6M 1.7M 0.0k nvme5n2 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 138.4k 190.8k 0.0k 1.4M 1.9M 0.0k nvme5n20 2024-03-25T09:28:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 148.4k 157.2k 0.0k 1.4M 1.5M 0.0k nvme5n3 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 132.4k 182.0k 0.0k 1.3M 1.8M 0.0k nvme5n4 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 167.6k 160.4k 0.0k 1.6M 1.6M 0.0k nvme5n5 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 140.8k 198.0k 0.0k 1.4M 1.9M 0.0k nvme5n6 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 157.6k 174.0k 0.0k 1.5M 1.7M 0.0k nvme5n7 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 194.8k 153.6k 0.0k 1.9M 1.5M 0.0k nvme5n8 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 158.8k 160.0k 0.0k 1.6M 1.6M 0.0k nvme5n9 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 172.4k 153.2k 0.0k 1.7M 1.5M 0.0k nvme8n1 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 143.6k 133.6k 0.0k 1.4M 1.3M 0.0k nvme8n10 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 145.6k 142.8k 0.0k 1.4M 1.4M 0.0k nvme8n11 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 165.2k 181.6k 0.0k 1.6M 1.8M 0.0k nvme8n12 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 130.0k 194.4k 0.0k 1.3M 1.9M 0.0k nvme8n13 2024-03-25T09:28:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 185.2k 138.4k 0.0k 1.8M 1.4M 0.0k nvme8n14 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 184.4k 115.6k 0.0k 1.8M 1.1M 0.0k nvme8n15 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 157.6k 138.8k 0.0k 1.5M 1.4M 0.0k nvme8n16 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 160.0k 182.4k 0.0k 1.6M 1.8M 0.0k nvme8n17 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 185.2k 156.8k 0.0k 1.8M 1.5M 0.0k nvme8n18 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 139.2k 205.2k 0.0k 1.4M 2.0M 0.0k nvme8n19 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 151.2k 157.2k 0.0k 1.5M 1.5M 0.0k nvme8n2 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 152.4k 171.6k 0.0k 1.5M 1.7M 0.0k nvme8n20 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 161.2k 146.4k 0.0k 1.6M 1.4M 0.0k nvme8n3 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 154.0k 147.2k 0.0k 1.5M 1.4M 0.0k nvme8n4 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 130.4k 151.2k 0.0k 1.3M 1.5M 0.0k nvme8n5 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 168.8k 165.2k 0.0k 1.6M 1.6M 0.0k nvme8n6 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 194.4k 155.2k 0.0k 1.9M 1.5M 0.0k nvme8n7 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 150.8k 120.4k 0.0k 1.5M 1.2M 0.0k nvme8n8 2024-03-25T09:28:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 162.0k 162.8k 0.0k 1.6M 1.6M 0.0k nvme8n9 2024-03-25T09:28:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:29.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:29 smithi059 ceph-mon[32732]: pgmap v581: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.5 MiB/s wr, 619 op/s 2024-03-25T09:28:29.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:29 smithi040 ceph-mon[33094]: pgmap v581: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.5 MiB/s wr, 619 op/s 2024-03-25T09:28:29.964 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:29.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 7/s 5/s 186 KiB/s 118 KiB/s 1.84 ms 326.72 us 2024-03-25T09:28:29.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 4/s 202 KiB/s 113 KiB/s 1.68 ms 285.58 us 2024-03-25T09:28:29.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 5/s 202 KiB/s 159 KiB/s 1.82 ms 319.91 us 2024-03-25T09:28:29.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 6/s 198 KiB/s 194 KiB/s 1.84 ms 332.22 us 2024-03-25T09:28:29.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 5/s 160 KiB/s 169 KiB/s 2.05 ms 416.24 us 2024-03-25T09:28:29.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 5/s 182 KiB/s 139 KiB/s 1.73 ms 322.25 us 2024-03-25T09:28:29.964 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 5/s 188 KiB/s 130 KiB/s 1.85 ms 293.36 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 4/s 222 KiB/s 127 KiB/s 1.62 ms 375.05 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 3/s 204 KiB/s 144 KiB/s 1.79 ms 544.70 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 6/s 5/s 166 KiB/s 168 KiB/s 2.01 ms 355.93 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 4/s 206 KiB/s 133 KiB/s 1.73 ms 359.86 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 164 KiB/s 138 KiB/s 1.74 ms 290.80 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 5/s 175 KiB/s 161 KiB/s 1.64 ms 305.68 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 5/s 188 KiB/s 177 KiB/s 1.66 ms 314.01 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 6/s 158 KiB/s 162 KiB/s 1.95 ms 330.02 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 5/s 130 KiB/s 169 KiB/s 1.75 ms 391.32 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 168 KiB/s 115 KiB/s 1.74 ms 289.30 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 4/s 188 KiB/s 181 KiB/s 1.87 ms 350.85 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 3/s 165 KiB/s 130 KiB/s 1.69 ms 283.09 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 5/s 140 KiB/s 136 KiB/s 1.76 ms 365.59 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 6/s 171 KiB/s 154 KiB/s 1.78 ms 333.40 us 2024-03-25T09:28:29.965 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 3/s 162 KiB/s 124 KiB/s 1.66 ms 307.28 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 4/s 123 KiB/s 110 KiB/s 1.64 ms 289.04 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 5/s 156 KiB/s 164 KiB/s 1.65 ms 317.90 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 5/s 181 KiB/s 175 KiB/s 1.82 ms 345.07 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 5/s 132 KiB/s 190 KiB/s 1.94 ms 378.52 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 5/s 158 KiB/s 202 KiB/s 2.05 ms 474.41 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 3/s 167 KiB/s 109 KiB/s 1.68 ms 288.80 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 6/s 193 KiB/s 166 KiB/s 1.72 ms 384.05 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 5/s 155 KiB/s 168 KiB/s 1.64 ms 398.76 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 5/s 143 KiB/s 149 KiB/s 1.69 ms 337.11 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 5/s 189 KiB/s 143 KiB/s 1.74 ms 336.28 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 5/s 151 KiB/s 175 KiB/s 1.73 ms 316.59 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 6/s 173 KiB/s 163 KiB/s 1.61 ms 308.68 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 5/s 150 KiB/s 155 KiB/s 1.82 ms 312.45 us 2024-03-25T09:28:29.966 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 4/s 174 KiB/s 125 KiB/s 1.79 ms 363.87 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 4/s 140 KiB/s 154 KiB/s 1.73 ms 307.81 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 140 KiB/s 162 KiB/s 1.78 ms 303.11 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 5/s 161 KiB/s 153 KiB/s 1.65 ms 497.95 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 5/s 175 KiB/s 140 KiB/s 1.75 ms 356.22 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 6/s 178 KiB/s 250 KiB/s 1.80 ms 383.34 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 6/s 161 KiB/s 180 KiB/s 2.23 ms 319.47 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 5/s 143 KiB/s 134 KiB/s 1.77 ms 264.73 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 141 KiB/s 175 KiB/s 1.86 ms 425.86 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 5/s 171 KiB/s 157 KiB/s 1.69 ms 329.97 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 6/s 130 KiB/s 216 KiB/s 1.66 ms 360.55 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 6/s 150 KiB/s 222 KiB/s 1.70 ms 301.89 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 156 KiB/s 153 KiB/s 1.66 ms 340.59 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 5/s 128 KiB/s 164 KiB/s 1.73 ms 310.76 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 149 KiB/s 128 KiB/s 1.70 ms 371.98 us 2024-03-25T09:28:29.967 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 6/s 161 KiB/s 228 KiB/s 1.75 ms 313.98 us 2024-03-25T09:28:29.968 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 5/s 154 KiB/s 168 KiB/s 1.60 ms 346.08 us 2024-03-25T09:28:29.968 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 5/s 127 KiB/s 183 KiB/s 1.78 ms 433.02 us 2024-03-25T09:28:29.968 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 134 KiB/s 178 KiB/s 1.90 ms 272.13 us 2024-03-25T09:28:29.968 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 5/s 122 KiB/s 172 KiB/s 1.70 ms 420.09 us 2024-03-25T09:28:29.968 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 5/s 126 KiB/s 162 KiB/s 1.89 ms 308.62 us 2024-03-25T09:28:29.968 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 6/s 106 KiB/s 137 KiB/s 1.79 ms 293.34 us 2024-03-25T09:28:29.968 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 5/s 126 KiB/s 178 KiB/s 1.75 ms 307.18 us 2024-03-25T09:28:29.968 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 6/s 116 KiB/s 198 KiB/s 1.91 ms 391.43 us 2024-03-25T09:28:29.968 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 6/s 110 KiB/s 233 KiB/s 1.62 ms 380.65 us 2024-03-25T09:28:29.968 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:30.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:30.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 422 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:30 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:30 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:30 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:30 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:30 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:30.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:30 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:30 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:30.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:30 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 422 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:30 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:30 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:30 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:30 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:30 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:30 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:30 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:30.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:30 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 422 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:31.353 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:31.353 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:31.353 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:31.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:31 smithi019 ceph-mon[29386]: pgmap v582: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.8 MiB/s wr, 614 op/s 2024-03-25T09:28:31.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:31 smithi059 ceph-mon[32732]: pgmap v582: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.8 MiB/s wr, 614 op/s 2024-03-25T09:28:31.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:31 smithi040 ceph-mon[33094]: pgmap v582: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.8 MiB/s wr, 614 op/s 2024-03-25T09:28:32.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:32.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:32.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:32.801+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:33.355 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:33.355 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:33.355 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:33 smithi019 ceph-mon[29386]: pgmap v583: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.8 MiB/s rd, 9.9 MiB/s wr, 684 op/s 2024-03-25T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:33 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:28:33.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:33 smithi059 ceph-mon[32732]: pgmap v583: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.8 MiB/s rd, 9.9 MiB/s wr, 684 op/s 2024-03-25T09:28:33.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:33 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:28:33.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:33 smithi040 ceph-mon[33094]: pgmap v583: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.8 MiB/s rd, 9.9 MiB/s wr, 684 op/s 2024-03-25T09:28:33.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:33 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:28:34.251 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:34.252 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:34.252 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:34.970 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:34.970 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 5/s 173 KiB/s 190 KiB/s 1.74 ms 316.36 us 2024-03-25T09:28:34.970 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 4/s 158 KiB/s 102 KiB/s 1.79 ms 289.77 us 2024-03-25T09:28:34.970 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 4/s 164 KiB/s 112 KiB/s 1.99 ms 259.31 us 2024-03-25T09:28:34.970 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 5/s 158 KiB/s 170 KiB/s 1.71 ms 372.56 us 2024-03-25T09:28:34.970 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 4/s 187 KiB/s 119 KiB/s 1.87 ms 330.39 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 4/s 205 KiB/s 121 KiB/s 1.84 ms 292.27 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 4/s 165 KiB/s 101 KiB/s 1.60 ms 280.50 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 4/s 179 KiB/s 139 KiB/s 1.79 ms 308.93 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 4/s 180 KiB/s 162 KiB/s 1.67 ms 355.48 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 5/s 156 KiB/s 139 KiB/s 1.79 ms 255.68 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 4/s 144 KiB/s 123 KiB/s 1.76 ms 365.07 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 3/s 170 KiB/s 85 KiB/s 1.80 ms 399.45 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 136 KiB/s 124 KiB/s 2.02 ms 278.22 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 5/s 141 KiB/s 145 KiB/s 2.00 ms 344.53 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 5/s 134 KiB/s 131 KiB/s 1.77 ms 315.49 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 5/s 183 KiB/s 142 KiB/s 1.87 ms 295.36 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 3/s 178 KiB/s 107 KiB/s 1.70 ms 302.86 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 5/s 167 KiB/s 147 KiB/s 1.82 ms 312.81 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 4/s 186 KiB/s 105 KiB/s 1.80 ms 304.96 us 2024-03-25T09:28:34.971 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 4/s 128 KiB/s 134 KiB/s 1.92 ms 339.40 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 5/s 154 KiB/s 126 KiB/s 1.71 ms 285.00 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 161 KiB/s 153 KiB/s 1.90 ms 332.91 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 5/s 112 KiB/s 149 KiB/s 1.95 ms 293.87 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 6/s 150 KiB/s 212 KiB/s 1.84 ms 405.85 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 131 KiB/s 151 KiB/s 1.74 ms 402.33 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 5/s 112 KiB/s 149 KiB/s 1.73 ms 444.06 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 6/s 182 KiB/s 176 KiB/s 1.85 ms 338.73 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 5/s 150 KiB/s 149 KiB/s 1.67 ms 332.30 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 5/s 145 KiB/s 171 KiB/s 2.33 ms 376.41 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 4/s 133 KiB/s 114 KiB/s 1.80 ms 350.81 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 5/s 135 KiB/s 169 KiB/s 2.02 ms 437.67 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 5/s 147 KiB/s 172 KiB/s 2.10 ms 336.39 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 134 KiB/s 135 KiB/s 1.89 ms 295.96 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 5/s 154 KiB/s 174 KiB/s 1.65 ms 316.40 us 2024-03-25T09:28:34.972 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 6/s 125 KiB/s 128 KiB/s 1.75 ms 396.18 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 5/s 175 KiB/s 140 KiB/s 1.74 ms 360.41 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 5/s 110 KiB/s 141 KiB/s 1.77 ms 324.37 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 157 KiB/s 134 KiB/s 1.70 ms 338.80 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 6/s 154 KiB/s 187 KiB/s 1.56 ms 382.61 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 5/s 173 KiB/s 134 KiB/s 1.67 ms 342.39 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 154 KiB/s 147 KiB/s 1.76 ms 316.14 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 150 KiB/s 126 KiB/s 1.84 ms 290.69 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 136 KiB/s 187 KiB/s 1.76 ms 348.01 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 6/s 104 KiB/s 197 KiB/s 1.88 ms 389.49 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 6/s 141 KiB/s 176 KiB/s 1.67 ms 313.02 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 6/s 135 KiB/s 206 KiB/s 1.72 ms 304.63 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 5/s 128 KiB/s 190 KiB/s 1.88 ms 389.83 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 5/s 136 KiB/s 150 KiB/s 2.02 ms 485.34 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 6/s 150 KiB/s 176 KiB/s 1.81 ms 365.84 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 6/s 125 KiB/s 184 KiB/s 1.81 ms 310.65 us 2024-03-25T09:28:34.973 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 6/s 94 KiB/s 167 KiB/s 1.78 ms 362.78 us 2024-03-25T09:28:34.974 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 6/s 146 KiB/s 237 KiB/s 1.75 ms 392.03 us 2024-03-25T09:28:34.974 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 101 KiB/s 173 KiB/s 2.08 ms 304.13 us 2024-03-25T09:28:34.974 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 5/s 125 KiB/s 185 KiB/s 1.65 ms 337.98 us 2024-03-25T09:28:34.974 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 5/s 99 KiB/s 174 KiB/s 1.73 ms 388.53 us 2024-03-25T09:28:34.974 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 5/s 106 KiB/s 166 KiB/s 1.98 ms 362.67 us 2024-03-25T09:28:34.974 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 6/s 116 KiB/s 195 KiB/s 1.74 ms 311.80 us 2024-03-25T09:28:34.974 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 7/s 105 KiB/s 221 KiB/s 1.94 ms 383.54 us 2024-03-25T09:28:34.974 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 6/s 109 KiB/s 201 KiB/s 1.66 ms 311.49 us 2024-03-25T09:28:34.974 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 6/s 90 KiB/s 183 KiB/s 1.81 ms 315.40 us 2024-03-25T09:28:34.974 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:35.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:35.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:35.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:36.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: pgmap v584: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.6 MiB/s wr, 599 op/s 2024-03-25T09:28:36.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 427 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:28:36.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:28:36.013 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:35 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: pgmap v584: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.6 MiB/s wr, 599 op/s 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:36.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 427 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:36.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:28:36.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:28:36.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:36.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: pgmap v584: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.6 MiB/s wr, 599 op/s 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 427 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:36.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:28:36.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:28:36.160 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:35 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:28:36.997 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:36 smithi019 ceph-mon[29386]: pgmap v585: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 9.8 MiB/s wr, 693 op/s 2024-03-25T09:28:36.997 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:36 smithi019 ceph-mon[29386]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-25T09:28:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:36 smithi059 ceph-mon[32732]: pgmap v585: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 9.8 MiB/s wr, 693 op/s 2024-03-25T09:28:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:36 smithi059 ceph-mon[32732]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-25T09:28:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:36 smithi040 ceph-mon[33094]: pgmap v585: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 9.8 MiB/s wr, 693 op/s 2024-03-25T09:28:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:36 smithi040 ceph-mon[33094]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-25T09:28:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:37.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:37.800+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:38.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:38.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:38.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:39.009 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:38 smithi019 ceph-mon[29386]: pgmap v586: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.1 MiB/s rd, 8.8 MiB/s wr, 634 op/s 2024-03-25T09:28:39.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:38 smithi059 ceph-mon[32732]: pgmap v586: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.1 MiB/s rd, 8.8 MiB/s wr, 634 op/s 2024-03-25T09:28:39.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:38 smithi040 ceph-mon[33094]: pgmap v586: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.1 MiB/s rd, 8.8 MiB/s wr, 634 op/s 2024-03-25T09:28:39.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:39.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:39.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:39.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:28:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 150.4k 131.6k 0.0k 1.5M 1.3M 0.0k nvme2n1 2024-03-25T09:28:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 118.0k 127.6k 0.0k 1.2M 1.2M 0.0k nvme2n10 2024-03-25T09:28:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 136.8k 154.4k 0.0k 1.3M 1.5M 0.0k nvme2n11 2024-03-25T09:28:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 130.0k 170.4k 0.0k 1.3M 1.7M 0.0k nvme2n12 2024-03-25T09:28:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 158.8k 119.2k 0.0k 1.6M 1.2M 0.0k nvme2n13 2024-03-25T09:28:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 170.0k 125.6k 0.0k 1.7M 1.2M 0.0k nvme2n14 2024-03-25T09:28:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 158.8k 129.6k 0.0k 1.6M 1.3M 0.0k nvme2n15 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 152.8k 154.4k 0.0k 1.5M 1.5M 0.0k nvme2n16 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 150.4k 156.0k 0.0k 1.5M 1.5M 0.0k nvme2n17 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 156.8k 120.8k 0.0k 1.5M 1.2M 0.0k nvme2n18 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 189.2k 125.2k 0.0k 1.8M 1.2M 0.0k nvme2n19 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 138.8k 138.0k 0.0k 1.4M 1.3M 0.0k nvme2n2 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 136.8k 126.8k 0.0k 1.3M 1.2M 0.0k nvme2n20 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 120.0k 160.0k 0.0k 1.2M 1.6M 0.0k nvme2n3 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 162.4k 122.4k 0.0k 1.6M 1.2M 0.0k nvme2n4 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 117.2k 130.8k 0.0k 1.1M 1.3M 0.0k nvme2n5 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 126.0k 140.4k 0.0k 1.2M 1.4M 0.0k nvme2n6 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 141.6k 113.2k 0.0k 1.4M 1.1M 0.0k nvme2n7 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 110.8k 162.4k 0.0k 1.1M 1.6M 0.0k nvme2n8 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 134.0k 158.4k 0.0k 1.3M 1.5M 0.0k nvme2n9 2024-03-25T09:28:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 177.2k 124.8k 0.0k 1.7M 1.2M 0.0k nvme5n1 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 164.8k 136.4k 0.0k 1.6M 1.3M 0.0k nvme5n10 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 135.2k 141.6k 0.0k 1.3M 1.4M 0.0k nvme5n11 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 158.8k 137.6k 0.0k 1.6M 1.3M 0.0k nvme5n12 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 146.8k 161.2k 0.0k 1.4M 1.6M 0.0k nvme5n13 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 164.8k 152.4k 0.0k 1.6M 1.5M 0.0k nvme5n14 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 179.6k 128.0k 0.0k 1.8M 1.2M 0.0k nvme5n15 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 147.6k 150.0k 0.0k 1.4M 1.5M 0.0k nvme5n16 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 121.2k 129.6k 0.0k 1.2M 1.3M 0.0k nvme5n17 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 126.0k 168.8k 0.0k 1.2M 1.6M 0.0k nvme5n18 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 123.2k 167.2k 0.0k 1.2M 1.6M 0.0k nvme5n19 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 172.4k 103.6k 0.0k 1.7M 1.0M 0.0k nvme5n2 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 148.0k 150.0k 0.0k 1.4M 1.5M 0.0k nvme5n20 2024-03-25T09:28:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 183.2k 112.8k 0.0k 1.8M 1.1M 0.0k nvme5n3 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 145.2k 157.2k 0.0k 1.4M 1.5M 0.0k nvme5n4 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 159.6k 144.0k 0.0k 1.6M 1.4M 0.0k nvme5n5 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 178.4k 144.8k 0.0k 1.7M 1.4M 0.0k nvme5n6 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 134.0k 151.6k 0.0k 1.3M 1.5M 0.0k nvme5n7 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 158.0k 134.4k 0.0k 1.5M 1.3M 0.0k nvme5n8 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 114.0k 142.8k 0.0k 1.1M 1.4M 0.0k nvme5n9 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 190.8k 90.0k 0.0k 1.9M 900.0k 0.0k nvme8n1 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 121.6k 123.6k 0.0k 1.2M 1.2M 0.0k nvme8n10 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 153.2k 158.8k 0.0k 1.5M 1.6M 0.0k nvme8n11 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 144.4k 168.4k 0.0k 1.4M 1.6M 0.0k nvme8n12 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 138.8k 177.2k 0.0k 1.4M 1.7M 0.0k nvme8n13 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 127.6k 134.4k 0.0k 1.2M 1.3M 0.0k nvme8n14 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 153.2k 127.2k 0.0k 1.5M 1.2M 0.0k nvme8n15 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 131.6k 107.2k 0.0k 1.3M 1.0M 0.0k nvme8n16 2024-03-25T09:28:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.50 124.0k 171.6k 0.0k 1.2M 1.7M 0.0k nvme8n17 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 152.0k 128.0k 0.0k 1.5M 1.2M 0.0k nvme8n18 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 149.6k 116.0k 0.0k 1.5M 1.1M 0.0k nvme8n19 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 104.0k 169.2k 0.0k 1.0M 1.7M 0.0k nvme8n2 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 152.4k 150.0k 0.0k 1.5M 1.5M 0.0k nvme8n20 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 158.8k 134.4k 0.0k 1.6M 1.3M 0.0k nvme8n3 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 194.8k 87.2k 0.0k 1.9M 872.0k 0.0k nvme8n4 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 109.2k 164.8k 0.0k 1.1M 1.6M 0.0k nvme8n5 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 154.0k 129.2k 0.0k 1.5M 1.3M 0.0k nvme8n6 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 170.8k 144.0k 0.0k 1.7M 1.4M 0.0k nvme8n7 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 181.2k 126.4k 0.0k 1.8M 1.2M 0.0k nvme8n8 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.40 162.0k 163.6k 0.0k 1.6M 1.6M 0.0k nvme8n9 2024-03-25T09:28:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 4/s 205 KiB/s 106 KiB/s 1.79 ms 319.03 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 6/s 3/s 184 KiB/s 122 KiB/s 1.64 ms 496.63 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 5/s 161 KiB/s 155 KiB/s 1.90 ms 405.40 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 5/s 199 KiB/s 161 KiB/s 1.79 ms 405.68 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 3/s 178 KiB/s 100 KiB/s 1.75 ms 292.12 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 4/s 146 KiB/s 104 KiB/s 1.79 ms 416.18 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 4/s 170 KiB/s 117 KiB/s 1.75 ms 306.26 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 4/s 212 KiB/s 126 KiB/s 1.84 ms 305.29 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 6/s 5/s 201 KiB/s 141 KiB/s 1.77 ms 466.14 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 3/s 161 KiB/s 115 KiB/s 2.09 ms 419.06 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 4/s 175 KiB/s 135 KiB/s 1.81 ms 320.05 us 2024-03-25T09:28:39.976 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 6/s 4/s 158 KiB/s 111 KiB/s 1.73 ms 327.09 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 4/s 168 KiB/s 113 KiB/s 2.02 ms 430.95 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 5/s 194 KiB/s 186 KiB/s 1.91 ms 350.18 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 138 KiB/s 174 KiB/s 1.89 ms 324.36 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 5/s 146 KiB/s 160 KiB/s 1.86 ms 373.91 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 4/s 165 KiB/s 86 KiB/s 2.35 ms 346.44 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 5/s 151 KiB/s 122 KiB/s 1.79 ms 391.70 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 5/s 151 KiB/s 179 KiB/s 1.85 ms 318.78 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 5/s 158 KiB/s 107 KiB/s 1.84 ms 312.38 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 5/s 122 KiB/s 141 KiB/s 1.91 ms 311.08 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 134 KiB/s 138 KiB/s 1.94 ms 331.83 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 5/s 168 KiB/s 125 KiB/s 1.81 ms 372.46 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 5/s 162 KiB/s 178 KiB/s 1.98 ms 340.82 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 5/s 148 KiB/s 142 KiB/s 1.80 ms 317.76 us 2024-03-25T09:28:39.977 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 5/s 150 KiB/s 118 KiB/s 1.90 ms 367.27 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 144 KiB/s 101 KiB/s 1.85 ms 400.17 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 4/s 154 KiB/s 94 KiB/s 1.85 ms 336.45 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 5/s 132 KiB/s 132 KiB/s 1.71 ms 310.25 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 5/s 129 KiB/s 151 KiB/s 1.89 ms 333.29 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 5/s 134 KiB/s 145 KiB/s 1.82 ms 341.24 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 4/s 109 KiB/s 134 KiB/s 1.86 ms 271.29 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 5/s 114 KiB/s 152 KiB/s 1.74 ms 351.17 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 5/s 151 KiB/s 153 KiB/s 1.85 ms 298.17 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 5/s 142 KiB/s 154 KiB/s 1.99 ms 354.62 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 6/s 159 KiB/s 162 KiB/s 2.03 ms 321.63 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 7/s 113 KiB/s 220 KiB/s 1.65 ms 347.68 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 6/s 182 KiB/s 182 KiB/s 1.65 ms 307.64 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 120 KiB/s 126 KiB/s 1.80 ms 336.89 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 4/s 106 KiB/s 88 KiB/s 1.88 ms 403.43 us 2024-03-25T09:28:39.978 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 5/s 141 KiB/s 170 KiB/s 1.79 ms 367.35 us 2024-03-25T09:28:39.979 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 91 KiB/s 164 KiB/s 2.18 ms 379.21 us 2024-03-25T09:28:39.979 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 6/s 152 KiB/s 172 KiB/s 1.83 ms 300.98 us 2024-03-25T09:28:39.979 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 5/s 136 KiB/s 158 KiB/s 2.17 ms 330.38 us 2024-03-25T09:28:39.979 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 6/s 123 KiB/s 182 KiB/s 1.77 ms 343.10 us 2024-03-25T09:28:39.979 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 137 KiB/s 123 KiB/s 2.25 ms 452.71 us 2024-03-25T09:28:39.979 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 5/s 134 KiB/s 128 KiB/s 1.80 ms 298.67 us 2024-03-25T09:28:39.979 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 5/s 122 KiB/s 174 KiB/s 1.88 ms 310.19 us 2024-03-25T09:28:39.979 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 6/s 127 KiB/s 174 KiB/s 1.78 ms 317.68 us 2024-03-25T09:28:39.979 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 6/s 111 KiB/s 186 KiB/s 1.87 ms 348.84 us 2024-03-25T09:28:39.979 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 6/s 102 KiB/s 162 KiB/s 1.62 ms 326.86 us 2024-03-25T09:28:39.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 124 KiB/s 106 KiB/s 1.87 ms 370.58 us 2024-03-25T09:28:39.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 7/s 102 KiB/s 181 KiB/s 1.73 ms 316.91 us 2024-03-25T09:28:39.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 6/s 91 KiB/s 173 KiB/s 1.85 ms 333.98 us 2024-03-25T09:28:39.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 5/s 106 KiB/s 178 KiB/s 1.93 ms 364.14 us 2024-03-25T09:28:39.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 6/s 105 KiB/s 259 KiB/s 1.87 ms 380.62 us 2024-03-25T09:28:39.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 6/s 105 KiB/s 130 KiB/s 1.93 ms 403.97 us 2024-03-25T09:28:39.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 6/s 104 KiB/s 150 KiB/s 2.02 ms 311.06 us 2024-03-25T09:28:39.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 7/s 94 KiB/s 198 KiB/s 1.97 ms 336.70 us 2024-03-25T09:28:39.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 2/s 6/s 83 KiB/s 190 KiB/s 1.85 ms 363.33 us 2024-03-25T09:28:39.982 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:40.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:40 smithi059 ceph-mon[32732]: pgmap v587: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 8.4 MiB/s wr, 619 op/s 2024-03-25T09:28:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:40 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:40 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:40 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:40 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:41.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:40 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:41.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:40 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:41.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:40 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:41.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:40 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 432 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:41.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:40 smithi040 ceph-mon[33094]: pgmap v587: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 8.4 MiB/s wr, 619 op/s 2024-03-25T09:28:41.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:40 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:41.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:40 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:41.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:40 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:41.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:40 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:41.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:40 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:41.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:40 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:41.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:40 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:41.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:40 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 432 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:41.021 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:40 smithi019 ceph-mon[29386]: pgmap v587: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 8.4 MiB/s wr, 619 op/s 2024-03-25T09:28:41.021 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:40 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:41.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:40 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:41.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:40 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:41.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:40 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:41.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:40 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:41.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:40 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:41.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:40 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:41.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:40 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 432 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:41.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:41.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:41.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:42.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:42.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:42.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:43.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:42 smithi059 ceph-mon[32732]: pgmap v588: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.3 MiB/s wr, 703 op/s 2024-03-25T09:28:43.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:42.801+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:43.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:42 smithi040 ceph-mon[33094]: pgmap v588: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.3 MiB/s wr, 703 op/s 2024-03-25T09:28:43.033 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:42 smithi019 ceph-mon[29386]: pgmap v588: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.3 MiB/s wr, 703 op/s 2024-03-25T09:28:43.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:43.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:43.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:44.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:44.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:44.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:44.980 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 7/s 4/s 178 KiB/s 114 KiB/s 1.82 ms 344.66 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 7/s 4/s 166 KiB/s 131 KiB/s 1.57 ms 381.91 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 4/s 170 KiB/s 101 KiB/s 1.90 ms 388.92 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 6/s 5/s 168 KiB/s 130 KiB/s 1.72 ms 280.17 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 3/s 166 KiB/s 82 KiB/s 1.89 ms 368.74 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 4/s 146 KiB/s 131 KiB/s 1.74 ms 298.32 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 6/s 4/s 179 KiB/s 146 KiB/s 1.68 ms 308.16 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 4/s 165 KiB/s 117 KiB/s 1.80 ms 331.04 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 5/s 155 KiB/s 144 KiB/s 1.82 ms 323.90 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 4/s 176 KiB/s 110 KiB/s 1.84 ms 394.99 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 5/s 148 KiB/s 100 KiB/s 1.92 ms 337.80 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 4/s 171 KiB/s 110 KiB/s 1.80 ms 395.44 us 2024-03-25T09:28:44.981 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 5/s 162 KiB/s 126 KiB/s 1.94 ms 316.66 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 4/s 133 KiB/s 119 KiB/s 1.79 ms 278.28 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 5/s 161 KiB/s 122 KiB/s 1.83 ms 299.43 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 5/s 139 KiB/s 141 KiB/s 1.83 ms 302.87 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 132 KiB/s 133 KiB/s 1.83 ms 342.00 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 3/s 135 KiB/s 102 KiB/s 1.54 ms 352.28 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 5/s 124 KiB/s 132 KiB/s 1.58 ms 363.23 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 5/s 122 KiB/s 135 KiB/s 1.90 ms 355.10 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 5/s 142 KiB/s 148 KiB/s 1.85 ms 342.05 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 4/s 156 KiB/s 127 KiB/s 1.76 ms 441.86 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 4/s 148 KiB/s 89 KiB/s 1.75 ms 324.77 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 4/s 167 KiB/s 114 KiB/s 1.79 ms 298.16 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 5/s 146 KiB/s 157 KiB/s 1.81 ms 393.01 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 5/s 136 KiB/s 148 KiB/s 1.73 ms 377.69 us 2024-03-25T09:28:44.982 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 5/s 154 KiB/s 159 KiB/s 1.66 ms 386.28 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 6/s 128 KiB/s 147 KiB/s 1.95 ms 285.91 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 5/s 124 KiB/s 128 KiB/s 1.74 ms 335.81 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 5/s 160 KiB/s 149 KiB/s 1.90 ms 304.85 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 6/s 169 KiB/s 150 KiB/s 2.12 ms 322.20 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 5/s 146 KiB/s 111 KiB/s 1.83 ms 371.24 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 4/s 132 KiB/s 125 KiB/s 1.85 ms 306.50 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 132 KiB/s 150 KiB/s 1.98 ms 301.25 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 4/s 162 KiB/s 113 KiB/s 1.95 ms 334.11 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 4/s 110 KiB/s 115 KiB/s 1.79 ms 292.94 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 5/s 150 KiB/s 136 KiB/s 1.62 ms 425.85 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 5/s 142 KiB/s 142 KiB/s 2.01 ms 306.50 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 5/s 150 KiB/s 130 KiB/s 1.63 ms 324.59 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 5/s 155 KiB/s 168 KiB/s 1.71 ms 327.25 us 2024-03-25T09:28:44.983 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 5/s 142 KiB/s 152 KiB/s 1.79 ms 347.78 us 2024-03-25T09:28:44.984 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 5/s 150 KiB/s 142 KiB/s 1.67 ms 354.27 us 2024-03-25T09:28:44.984 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 4/s 130 KiB/s 95 KiB/s 1.71 ms 355.77 us 2024-03-25T09:28:44.984 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 5/s 145 KiB/s 164 KiB/s 1.74 ms 368.16 us 2024-03-25T09:28:44.984 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 6/s 112 KiB/s 135 KiB/s 1.91 ms 341.85 us 2024-03-25T09:28:44.984 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 6/s 148 KiB/s 176 KiB/s 1.64 ms 375.71 us 2024-03-25T09:28:44.984 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 126 KiB/s 132 KiB/s 2.14 ms 406.40 us 2024-03-25T09:28:44.984 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 5/s 100 KiB/s 124 KiB/s 1.85 ms 271.41 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 6/s 118 KiB/s 168 KiB/s 1.81 ms 304.33 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 7/s 98 KiB/s 154 KiB/s 1.89 ms 278.27 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 6/s 131 KiB/s 209 KiB/s 2.06 ms 363.59 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 6/s 106 KiB/s 174 KiB/s 1.66 ms 298.27 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 6/s 134 KiB/s 179 KiB/s 1.72 ms 315.06 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 6/s 101 KiB/s 154 KiB/s 1.95 ms 304.74 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 74 KiB/s 160 KiB/s 1.87 ms 343.27 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 5/s 105 KiB/s 144 KiB/s 1.77 ms 287.35 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 6/s 111 KiB/s 167 KiB/s 2.32 ms 325.41 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 5/s 90 KiB/s 146 KiB/s 1.75 ms 358.80 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 6/s 90 KiB/s 124 KiB/s 1.91 ms 352.74 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 6/s 96 KiB/s 156 KiB/s 1.99 ms 347.73 us 2024-03-25T09:28:44.985 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:45.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:44 smithi059 ceph-mon[32732]: pgmap v589: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.5 MiB/s wr, 577 op/s 2024-03-25T09:28:45.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:44 smithi040 ceph-mon[33094]: pgmap v589: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.5 MiB/s wr, 577 op/s 2024-03-25T09:28:45.046 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:44 smithi019 ceph-mon[29386]: pgmap v589: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.5 MiB/s wr, 577 op/s 2024-03-25T09:28:45.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:45.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:45.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:46.009 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:45 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:46.009 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:45 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:46.010 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:45 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:46.010 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:45 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:46.010 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:45 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:46.010 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:45 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:46.010 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:45 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:46.010 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:45 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 437 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:46.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:45 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:46.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:45 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:46.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:45 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:46.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:45 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:46.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:45 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:46.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:45 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:46.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:45 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:46.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:45 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 437 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:46.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:46.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:46.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:46.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:46.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:46.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:46.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:46.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:45 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 437 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:46.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:46.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:46.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:47.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:46 smithi059 ceph-mon[32732]: pgmap v590: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.7 MiB/s wr, 679 op/s 2024-03-25T09:28:47.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:46 smithi040 ceph-mon[33094]: pgmap v590: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.7 MiB/s wr, 679 op/s 2024-03-25T09:28:47.058 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:46 smithi019 ceph-mon[29386]: pgmap v590: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.7 MiB/s wr, 679 op/s 2024-03-25T09:28:47.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:47.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:47.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:47.802+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:48.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:48.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:48.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:49.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:48 smithi059 ceph-mon[32732]: pgmap v591: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.7 MiB/s wr, 611 op/s 2024-03-25T09:28:49.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:48 smithi040 ceph-mon[33094]: pgmap v591: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.7 MiB/s wr, 611 op/s 2024-03-25T09:28:49.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:48 smithi019 ceph-mon[29386]: pgmap v591: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.7 MiB/s wr, 611 op/s 2024-03-25T09:28:49.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:49.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:49.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:49.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:28:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 139.6k 100.8k 0.0k 1.4M 1008.0k 0.0k nvme2n1 2024-03-25T09:28:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 70.8k 163.2k 0.0k 708.0k 1.6M 0.0k nvme2n10 2024-03-25T09:28:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 106.8k 150.8k 0.0k 1.0M 1.5M 0.0k nvme2n11 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 135.6k 112.8k 0.0k 1.3M 1.1M 0.0k nvme2n12 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 136.0k 115.6k 0.0k 1.3M 1.1M 0.0k nvme2n13 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 132.4k 142.4k 0.0k 1.3M 1.4M 0.0k nvme2n14 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 148.4k 107.6k 0.0k 1.4M 1.1M 0.0k nvme2n15 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 124.8k 139.2k 0.0k 1.2M 1.4M 0.0k nvme2n16 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 123.2k 159.2k 0.0k 1.2M 1.6M 0.0k nvme2n17 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 126.4k 134.0k 0.0k 1.2M 1.3M 0.0k nvme2n18 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 171.6k 128.0k 0.0k 1.7M 1.2M 0.0k nvme2n19 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 119.2k 146.4k 0.0k 1.2M 1.4M 0.0k nvme2n2 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 126.8k 111.6k 0.0k 1.2M 1.1M 0.0k nvme2n20 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 120.4k 132.0k 0.0k 1.2M 1.3M 0.0k nvme2n3 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 139.2k 131.6k 0.0k 1.4M 1.3M 0.0k nvme2n4 2024-03-25T09:28:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 132.0k 139.2k 0.0k 1.3M 1.4M 0.0k nvme2n5 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 122.4k 86.8k 0.0k 1.2M 868.0k 0.0k nvme2n6 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 132.4k 126.8k 0.0k 1.3M 1.2M 0.0k nvme2n7 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 132.0k 116.0k 0.0k 1.3M 1.1M 0.0k nvme2n8 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 123.2k 126.4k 0.0k 1.2M 1.2M 0.0k nvme2n9 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 112.4k 124.8k 0.0k 1.1M 1.2M 0.0k nvme5n1 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 141.6k 140.0k 0.0k 1.4M 1.4M 0.0k nvme5n10 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 130.4k 127.6k 0.0k 1.3M 1.2M 0.0k nvme5n11 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 126.0k 144.8k 0.0k 1.2M 1.4M 0.0k nvme5n12 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 103.2k 130.0k 0.0k 1.0M 1.3M 0.0k nvme5n13 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 144.4k 132.4k 0.0k 1.4M 1.3M 0.0k nvme5n14 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 104.4k 156.8k 0.0k 1.0M 1.5M 0.0k nvme5n15 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 109.6k 129.2k 0.0k 1.1M 1.3M 0.0k nvme5n16 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 106.0k 124.8k 0.0k 1.0M 1.2M 0.0k nvme5n17 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 83.6k 137.2k 0.0k 836.0k 1.3M 0.0k nvme5n18 2024-03-25T09:28:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.30 154.0k 133.6k 0.0k 1.5M 1.3M 0.0k nvme5n19 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 120.4k 123.6k 0.0k 1.2M 1.2M 0.0k nvme5n2 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 110.4k 163.6k 0.0k 1.1M 1.6M 0.0k nvme5n20 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 134.8k 138.4k 0.0k 1.3M 1.4M 0.0k nvme5n3 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 116.4k 152.0k 0.0k 1.1M 1.5M 0.0k nvme5n4 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 120.0k 140.4k 0.0k 1.2M 1.4M 0.0k nvme5n5 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 140.8k 120.0k 0.0k 1.4M 1.2M 0.0k nvme5n6 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 129.2k 109.2k 0.0k 1.3M 1.1M 0.0k nvme5n7 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 129.2k 127.2k 0.0k 1.3M 1.2M 0.0k nvme5n8 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 138.4k 122.4k 0.0k 1.4M 1.2M 0.0k nvme5n9 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 135.2k 120.0k 0.0k 1.3M 1.2M 0.0k nvme8n1 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 143.6k 112.8k 0.0k 1.4M 1.1M 0.0k nvme8n10 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 112.8k 118.8k 0.0k 1.1M 1.2M 0.0k nvme8n11 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 117.2k 175.2k 0.0k 1.1M 1.7M 0.0k nvme8n12 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 147.2k 110.4k 0.0k 1.4M 1.1M 0.0k nvme8n13 2024-03-25T09:28:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 118.4k 123.2k 0.0k 1.2M 1.2M 0.0k nvme8n14 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 121.6k 143.6k 0.0k 1.2M 1.4M 0.0k nvme8n15 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 136.4k 103.6k 0.0k 1.3M 1.0M 0.0k nvme8n16 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 117.2k 134.0k 0.0k 1.1M 1.3M 0.0k nvme8n17 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.30 134.4k 130.4k 0.0k 1.3M 1.3M 0.0k nvme8n18 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 119.2k 126.0k 0.0k 1.2M 1.2M 0.0k nvme8n19 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 111.2k 136.8k 0.0k 1.1M 1.3M 0.0k nvme8n2 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 120.8k 120.8k 0.0k 1.2M 1.2M 0.0k nvme8n20 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 117.2k 118.0k 0.0k 1.1M 1.2M 0.0k nvme8n3 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 110.4k 150.8k 0.0k 1.1M 1.5M 0.0k nvme8n4 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 105.2k 161.2k 0.0k 1.0M 1.6M 0.0k nvme8n5 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 154.8k 106.0k 0.0k 1.5M 1.0M 0.0k nvme8n6 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 138.4k 139.2k 0.0k 1.4M 1.4M 0.0k nvme8n7 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 115.6k 140.0k 0.0k 1.1M 1.4M 0.0k nvme8n8 2024-03-25T09:28:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 129.6k 135.6k 0.0k 1.3M 1.3M 0.0k nvme8n9 2024-03-25T09:28:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 8/s 3/s 178 KiB/s 55 KiB/s 1.92 ms 273.02 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 7/s 4/s 196 KiB/s 112 KiB/s 1.80 ms 314.86 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 7/s 3/s 177 KiB/s 100 KiB/s 1.86 ms 319.89 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 4/s 166 KiB/s 138 KiB/s 1.94 ms 352.34 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 6/s 4/s 171 KiB/s 127 KiB/s 1.77 ms 497.73 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 5/s 127 KiB/s 138 KiB/s 1.86 ms 292.01 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 4/s 135 KiB/s 93 KiB/s 1.85 ms 317.56 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 4/s 128 KiB/s 89 KiB/s 1.79 ms 305.64 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 4/s 157 KiB/s 126 KiB/s 1.89 ms 358.65 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 5/s 166 KiB/s 146 KiB/s 1.62 ms 320.89 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 5/s 134 KiB/s 103 KiB/s 2.36 ms 337.67 us 2024-03-25T09:28:49.985 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 5/s 181 KiB/s 133 KiB/s 1.64 ms 292.00 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 5/s 147 KiB/s 137 KiB/s 1.81 ms 310.78 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 5/s 142 KiB/s 152 KiB/s 1.78 ms 355.38 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 4/s 116 KiB/s 95 KiB/s 1.84 ms 437.44 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 5/s 120 KiB/s 110 KiB/s 1.87 ms 264.16 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 5/s 131 KiB/s 135 KiB/s 2.01 ms 323.22 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 5/s 109 KiB/s 131 KiB/s 1.65 ms 303.65 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 4/s 131 KiB/s 138 KiB/s 1.71 ms 382.30 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 138 KiB/s 106 KiB/s 1.77 ms 296.61 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 4/s 157 KiB/s 126 KiB/s 2.13 ms 337.27 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 5/s 142 KiB/s 158 KiB/s 1.99 ms 348.52 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 4/s 98 KiB/s 111 KiB/s 1.69 ms 296.01 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 5/s 122 KiB/s 150 KiB/s 1.75 ms 383.90 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 5/s 138 KiB/s 154 KiB/s 1.75 ms 522.53 us 2024-03-25T09:28:49.986 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 5/s 156 KiB/s 123 KiB/s 1.78 ms 307.16 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 5/s 117 KiB/s 147 KiB/s 1.76 ms 275.20 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 4/s 128 KiB/s 128 KiB/s 1.81 ms 299.62 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 4/s 133 KiB/s 106 KiB/s 1.88 ms 345.84 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 6/s 132 KiB/s 149 KiB/s 1.97 ms 333.54 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 116 KiB/s 124 KiB/s 1.96 ms 393.67 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 130 KiB/s 138 KiB/s 1.74 ms 334.26 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 5/s 130 KiB/s 161 KiB/s 1.83 ms 308.80 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 5/s 123 KiB/s 121 KiB/s 2.18 ms 396.64 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 4/s 154 KiB/s 106 KiB/s 1.85 ms 332.09 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 122 KiB/s 111 KiB/s 1.70 ms 285.93 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 6/s 170 KiB/s 138 KiB/s 1.93 ms 340.63 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 5/s 128 KiB/s 111 KiB/s 1.95 ms 359.47 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 120 KiB/s 111 KiB/s 1.88 ms 343.02 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 5/s 122 KiB/s 118 KiB/s 2.22 ms 374.69 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 5/s 130 KiB/s 165 KiB/s 1.65 ms 423.17 us 2024-03-25T09:28:49.987 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 126 KiB/s 103 KiB/s 2.02 ms 299.85 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 7/s 108 KiB/s 164 KiB/s 1.72 ms 298.30 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 6/s 126 KiB/s 131 KiB/s 1.96 ms 339.41 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 110 KiB/s 128 KiB/s 1.83 ms 326.07 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 5/s 90 KiB/s 132 KiB/s 1.72 ms 369.94 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 5/s 119 KiB/s 126 KiB/s 1.93 ms 444.07 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 6/s 118 KiB/s 150 KiB/s 1.75 ms 286.21 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 5/s 103 KiB/s 114 KiB/s 1.87 ms 309.36 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 4/s 77 KiB/s 119 KiB/s 1.78 ms 315.31 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 5/s 90 KiB/s 106 KiB/s 1.66 ms 296.84 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 5/s 116 KiB/s 142 KiB/s 1.90 ms 340.64 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 5/s 101 KiB/s 133 KiB/s 1.91 ms 287.19 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 5/s 109 KiB/s 165 KiB/s 1.72 ms 403.12 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 5/s 125 KiB/s 130 KiB/s 1.83 ms 309.62 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 6/s 84 KiB/s 112 KiB/s 1.72 ms 298.95 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 100 KiB/s 91 KiB/s 1.99 ms 266.88 us 2024-03-25T09:28:49.988 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 7/s 82 KiB/s 194 KiB/s 1.71 ms 288.51 us 2024-03-25T09:28:49.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 6/s 72 KiB/s 162 KiB/s 1.68 ms 326.79 us 2024-03-25T09:28:49.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 6/s 62 KiB/s 134 KiB/s 2.08 ms 294.14 us 2024-03-25T09:28:49.989 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:50.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:50.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:50.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:51.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:50 smithi059 ceph-mon[32732]: pgmap v592: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.5 MiB/s wr, 601 op/s 2024-03-25T09:28:51.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:50 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:51.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:50 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:51.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:50 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:51.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:50 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:51.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:50 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:51.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:50 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:51.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:50 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:51.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:50 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 442 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-mon[33094]: pgmap v592: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.5 MiB/s wr, 601 op/s 2024-03-25T09:28:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:51.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:50 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 442 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:51.083 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:50 smithi019 ceph-mon[29386]: pgmap v592: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.5 MiB/s wr, 601 op/s 2024-03-25T09:28:51.083 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:50 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:51.083 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:50 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:51.083 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:50 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:51.083 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:50 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:51.083 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:50 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:51.083 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:50 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:51.083 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:50 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:51.084 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:50 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 442 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:51.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:51.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:51.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:52.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:52.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:52.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:53.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:52 smithi059 ceph-mon[32732]: pgmap v593: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.3 MiB/s wr, 672 op/s 2024-03-25T09:28:53.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:52.802+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:53.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:52 smithi040 ceph-mon[33094]: pgmap v593: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.3 MiB/s wr, 672 op/s 2024-03-25T09:28:53.095 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:52 smithi019 ceph-mon[29386]: pgmap v593: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.3 MiB/s wr, 672 op/s 2024-03-25T09:28:53.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:53.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:53.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:54.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:54.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:54.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 7/s 3/s 175 KiB/s 74 KiB/s 1.81 ms 311.58 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 7/s 3/s 142 KiB/s 75 KiB/s 1.78 ms 368.71 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 4/s 186 KiB/s 126 KiB/s 2.06 ms 390.07 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 4/s 158 KiB/s 122 KiB/s 1.85 ms 326.01 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 4/s 147 KiB/s 83 KiB/s 1.82 ms 285.12 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 6/s 4/s 150 KiB/s 128 KiB/s 1.80 ms 314.12 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 4/s 140 KiB/s 111 KiB/s 1.85 ms 403.69 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 4/s 155 KiB/s 97 KiB/s 1.70 ms 283.45 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 6/s 4/s 149 KiB/s 94 KiB/s 1.95 ms 311.10 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 2/s 169 KiB/s 81 KiB/s 1.95 ms 289.59 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 4/s 134 KiB/s 106 KiB/s 1.70 ms 339.43 us 2024-03-25T09:28:54.989 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 5/s 162 KiB/s 72 KiB/s 1.83 ms 346.61 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 5/s 147 KiB/s 107 KiB/s 1.83 ms 366.55 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 5/s 142 KiB/s 142 KiB/s 1.89 ms 347.36 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 5/s 138 KiB/s 127 KiB/s 1.89 ms 298.38 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 4/s 135 KiB/s 106 KiB/s 1.80 ms 322.63 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 5/s 138 KiB/s 102 KiB/s 1.87 ms 298.31 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 4/s 138 KiB/s 109 KiB/s 1.94 ms 293.10 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 4/s 101 KiB/s 82 KiB/s 1.70 ms 456.72 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 5/s 141 KiB/s 119 KiB/s 1.77 ms 325.00 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 5/s 135 KiB/s 120 KiB/s 1.80 ms 307.37 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 4/s 148 KiB/s 94 KiB/s 1.94 ms 318.55 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 155 KiB/s 102 KiB/s 2.02 ms 386.37 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 4/s 142 KiB/s 78 KiB/s 1.99 ms 348.50 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 4/s 124 KiB/s 70 KiB/s 1.89 ms 294.86 us 2024-03-25T09:28:54.990 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 5/s 114 KiB/s 110 KiB/s 1.79 ms 318.56 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 5/s 125 KiB/s 134 KiB/s 2.01 ms 316.82 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 4/s 120 KiB/s 88 KiB/s 1.79 ms 298.33 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 5/s 142 KiB/s 127 KiB/s 1.91 ms 334.89 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 5/s 142 KiB/s 126 KiB/s 1.94 ms 340.80 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 5/s 117 KiB/s 118 KiB/s 2.01 ms 346.41 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 4/s 108 KiB/s 115 KiB/s 1.86 ms 317.07 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 4/s 118 KiB/s 118 KiB/s 1.82 ms 298.98 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 6/s 130 KiB/s 130 KiB/s 2.08 ms 379.79 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 3/s 138 KiB/s 75 KiB/s 1.74 ms 333.08 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 5/s 114 KiB/s 108 KiB/s 1.91 ms 304.82 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 6/s 135 KiB/s 147 KiB/s 1.90 ms 304.21 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 118 KiB/s 89 KiB/s 1.81 ms 481.22 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 4/s 102 KiB/s 96 KiB/s 2.10 ms 325.07 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 5/s 125 KiB/s 138 KiB/s 1.81 ms 293.43 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 5/s 114 KiB/s 154 KiB/s 1.83 ms 337.37 us 2024-03-25T09:28:54.991 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 5/s 90 KiB/s 104 KiB/s 2.18 ms 296.48 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 88 KiB/s 98 KiB/s 1.81 ms 301.18 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 5/s 94 KiB/s 108 KiB/s 1.92 ms 407.48 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 5/s 115 KiB/s 126 KiB/s 1.74 ms 301.15 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 6/s 103 KiB/s 154 KiB/s 1.88 ms 367.74 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 4/s 115 KiB/s 135 KiB/s 1.75 ms 295.81 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 120 KiB/s 98 KiB/s 1.97 ms 414.75 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 6/s 118 KiB/s 140 KiB/s 1.73 ms 298.11 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 144 KiB/s 124 KiB/s 1.81 ms 307.69 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 125 KiB/s 111 KiB/s 2.06 ms 311.44 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 6/s 89 KiB/s 157 KiB/s 1.89 ms 340.85 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 5/s 130 KiB/s 117 KiB/s 1.74 ms 320.89 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 5/s 102 KiB/s 152 KiB/s 1.75 ms 375.56 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 5/s 67 KiB/s 136 KiB/s 2.14 ms 309.48 us 2024-03-25T09:28:54.992 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 5/s 115 KiB/s 118 KiB/s 1.91 ms 285.99 us 2024-03-25T09:28:54.993 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 5/s 90 KiB/s 145 KiB/s 1.71 ms 277.47 us 2024-03-25T09:28:54.993 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 6/s 78 KiB/s 145 KiB/s 2.03 ms 311.54 us 2024-03-25T09:28:54.993 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 6/s 98 KiB/s 158 KiB/s 1.85 ms 294.83 us 2024-03-25T09:28:54.993 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 4/s 73 KiB/s 80 KiB/s 2.02 ms 295.29 us 2024-03-25T09:28:54.993 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:55.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:54 smithi059 ceph-mon[32732]: pgmap v594: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.6 MiB/s wr, 545 op/s 2024-03-25T09:28:55.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:54 smithi040 ceph-mon[33094]: pgmap v594: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.6 MiB/s wr, 545 op/s 2024-03-25T09:28:55.107 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:54 smithi019 ceph-mon[29386]: pgmap v594: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.6 MiB/s wr, 545 op/s 2024-03-25T09:28:55.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:55.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:55.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:55 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:55 smithi059 ceph-mon[32732]: { 2024-03-25T09:28:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:55 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:28:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:55 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:28:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:55 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:28:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:55 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:28:56.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:55 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:28:56.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:55 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 447 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:55 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:55 smithi040 ceph-mon[33094]: { 2024-03-25T09:28:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:55 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:28:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:55 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:28:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:55 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:28:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:55 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:28:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:55 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:28:56.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:55 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 447 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:28:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-mon[29386]: { 2024-03-25T09:28:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:28:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:28:56.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:28:56.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:28:56.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:28:56.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:55 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 447 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:28:56.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:56.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:56.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:56 smithi059 ceph-mon[32732]: pgmap v595: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 8.2 MiB/s wr, 686 op/s 2024-03-25T09:28:57.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:56 smithi040 ceph-mon[33094]: pgmap v595: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 8.2 MiB/s wr, 686 op/s 2024-03-25T09:28:57.119 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:56 smithi019 ceph-mon[29386]: pgmap v595: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 8.2 MiB/s wr, 686 op/s 2024-03-25T09:28:57.410 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:57.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:57.411 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:28:57.802+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:28:58.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:58.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:28:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:58.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:28:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:59.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:28:58 smithi059 ceph-mon[32732]: pgmap v596: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 7.1 MiB/s wr, 603 op/s 2024-03-25T09:28:59.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:28:58 smithi040 ceph-mon[33094]: pgmap v596: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 7.1 MiB/s wr, 603 op/s 2024-03-25T09:28:59.132 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:28:58 smithi019 ceph-mon[29386]: pgmap v596: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 7.1 MiB/s wr, 603 op/s 2024-03-25T09:28:59.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:28:59.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:28:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:28:59.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:28:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:28:59.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:28:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 114.4k 101.6k 0.0k 1.1M 1016.0k 0.0k nvme2n1 2024-03-25T09:28:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 109.2k 133.2k 0.0k 1.1M 1.3M 0.0k nvme2n10 2024-03-25T09:28:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 120.8k 98.4k 0.0k 1.2M 984.0k 0.0k nvme2n11 2024-03-25T09:28:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 115.6k 116.4k 0.0k 1.1M 1.1M 0.0k nvme2n12 2024-03-25T09:28:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 116.0k 127.2k 0.0k 1.1M 1.2M 0.0k nvme2n13 2024-03-25T09:28:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 131.6k 112.8k 0.0k 1.3M 1.1M 0.0k nvme2n14 2024-03-25T09:28:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 101.2k 117.2k 0.0k 1012.0k 1.1M 0.0k nvme2n15 2024-03-25T09:28:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 124.0k 133.2k 0.0k 1.2M 1.3M 0.0k nvme2n16 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 128.0k 107.6k 0.0k 1.2M 1.1M 0.0k nvme2n17 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 145.6k 110.4k 0.0k 1.4M 1.1M 0.0k nvme2n18 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 98.4k 120.4k 0.0k 984.0k 1.2M 0.0k nvme2n19 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 102.0k 118.4k 0.0k 1020.0k 1.2M 0.0k nvme2n2 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 136.0k 109.6k 0.0k 1.3M 1.1M 0.0k nvme2n20 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 123.2k 142.4k 0.0k 1.2M 1.4M 0.0k nvme2n3 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 107.2k 98.0k 0.0k 1.0M 980.0k 0.0k nvme2n4 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 110.4k 135.6k 0.0k 1.1M 1.3M 0.0k nvme2n5 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 108.8k 111.6k 0.0k 1.1M 1.1M 0.0k nvme2n6 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 97.2k 140.8k 0.0k 972.0k 1.4M 0.0k nvme2n7 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 106.4k 107.2k 0.0k 1.0M 1.0M 0.0k nvme2n8 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 116.0k 94.4k 0.0k 1.1M 944.0k 0.0k nvme2n9 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 112.8k 109.2k 0.0k 1.1M 1.1M 0.0k nvme5n1 2024-03-25T09:28:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 109.6k 154.8k 0.0k 1.1M 1.5M 0.0k nvme5n10 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 96.0k 131.2k 0.0k 960.0k 1.3M 0.0k nvme5n11 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 128.4k 90.4k 0.0k 1.3M 904.0k 0.0k nvme5n12 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 126.0k 110.8k 0.0k 1.2M 1.1M 0.0k nvme5n13 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 100.0k 132.8k 0.0k 1000.0k 1.3M 0.0k nvme5n14 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 125.2k 136.4k 0.0k 1.2M 1.3M 0.0k nvme5n15 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 119.6k 88.8k 0.0k 1.2M 888.0k 0.0k nvme5n16 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 101.2k 126.4k 0.0k 1012.0k 1.2M 0.0k nvme5n17 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 107.2k 117.6k 0.0k 1.0M 1.1M 0.0k nvme5n18 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 134.0k 108.8k 0.0k 1.3M 1.1M 0.0k nvme5n19 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 110.8k 109.6k 0.0k 1.1M 1.1M 0.0k nvme5n2 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 128.0k 104.4k 0.0k 1.2M 1.0M 0.0k nvme5n20 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 116.0k 128.4k 0.0k 1.1M 1.3M 0.0k nvme5n3 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 72.8k 143.2k 0.0k 728.0k 1.4M 0.0k nvme5n4 2024-03-25T09:28:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 90.4k 112.4k 0.0k 904.0k 1.1M 0.0k nvme5n5 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 85.6k 120.8k 0.0k 856.0k 1.2M 0.0k nvme5n6 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 98.0k 103.2k 0.0k 980.0k 1.0M 0.0k nvme5n7 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 122.8k 94.8k 0.0k 1.2M 948.0k 0.0k nvme5n8 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 116.0k 107.6k 0.0k 1.1M 1.1M 0.0k nvme5n9 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 98.0k 136.0k 0.0k 980.0k 1.3M 0.0k nvme8n1 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 148.0k 88.0k 0.0k 1.4M 880.0k 0.0k nvme8n10 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 120.4k 108.4k 0.0k 1.2M 1.1M 0.0k nvme8n11 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 91.6k 123.6k 0.0k 916.0k 1.2M 0.0k nvme8n12 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 99.6k 107.6k 0.0k 996.0k 1.1M 0.0k nvme8n13 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 96.8k 117.6k 0.0k 968.0k 1.1M 0.0k nvme8n14 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 109.6k 132.4k 0.0k 1.1M 1.3M 0.0k nvme8n15 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 112.4k 119.6k 0.0k 1.1M 1.2M 0.0k nvme8n16 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 113.2k 130.0k 0.0k 1.1M 1.3M 0.0k nvme8n17 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 93.6k 129.2k 0.0k 936.0k 1.3M 0.0k nvme8n18 2024-03-25T09:28:59.687 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 114.0k 108.0k 0.0k 1.1M 1.1M 0.0k nvme8n19 2024-03-25T09:28:59.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 136.0k 118.8k 0.0k 1.3M 1.2M 0.0k nvme8n2 2024-03-25T09:28:59.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 116.8k 104.4k 0.0k 1.1M 1.0M 0.0k nvme8n20 2024-03-25T09:28:59.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 126.4k 112.0k 0.0k 1.2M 1.1M 0.0k nvme8n3 2024-03-25T09:28:59.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 129.6k 133.6k 0.0k 1.3M 1.3M 0.0k nvme8n4 2024-03-25T09:28:59.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 94.4k 124.4k 0.0k 944.0k 1.2M 0.0k nvme8n5 2024-03-25T09:28:59.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 107.2k 113.6k 0.0k 1.0M 1.1M 0.0k nvme8n6 2024-03-25T09:28:59.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 137.2k 106.8k 0.0k 1.3M 1.0M 0.0k nvme8n7 2024-03-25T09:28:59.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 93.6k 110.8k 0.0k 936.0k 1.1M 0.0k nvme8n8 2024-03-25T09:28:59.688 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 128.4k 132.0k 0.0k 1.3M 1.3M 0.0k nvme8n9 2024-03-25T09:28:59.688 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:28:59.993 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 7/s 3/s 177 KiB/s 90 KiB/s 2.02 ms 314.60 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 4/s 157 KiB/s 80 KiB/s 1.81 ms 281.74 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 3/s 125 KiB/s 86 KiB/s 1.79 ms 331.06 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 6/s 4/s 130 KiB/s 122 KiB/s 1.96 ms 357.53 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 5/s 134 KiB/s 78 KiB/s 2.35 ms 314.63 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 4/s 110 KiB/s 80 KiB/s 1.76 ms 296.79 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 4/s 105 KiB/s 96 KiB/s 1.78 ms 365.29 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 4/s 135 KiB/s 97 KiB/s 1.90 ms 325.18 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 143 KiB/s 124 KiB/s 2.08 ms 333.28 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 4/s 136 KiB/s 98 KiB/s 1.97 ms 290.39 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 4/s 135 KiB/s 86 KiB/s 1.65 ms 332.76 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 5/s 120 KiB/s 113 KiB/s 1.90 ms 340.75 us 2024-03-25T09:28:59.994 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 4/s 117 KiB/s 104 KiB/s 1.93 ms 285.81 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 5/s 157 KiB/s 131 KiB/s 1.87 ms 391.08 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 150 KiB/s 123 KiB/s 2.00 ms 389.28 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 5/s 118 KiB/s 122 KiB/s 1.77 ms 274.84 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 5/s 112 KiB/s 122 KiB/s 1.83 ms 307.37 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 4/s 151 KiB/s 113 KiB/s 1.99 ms 364.58 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 4/s 116 KiB/s 93 KiB/s 1.77 ms 285.68 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 4/s 106 KiB/s 102 KiB/s 2.10 ms 277.66 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 5/s 117 KiB/s 113 KiB/s 1.68 ms 295.89 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 4/s 132 KiB/s 111 KiB/s 1.80 ms 300.71 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 6/s 106 KiB/s 150 KiB/s 1.75 ms 326.03 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 4/s 164 KiB/s 124 KiB/s 1.75 ms 301.08 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 4/s 126 KiB/s 134 KiB/s 1.90 ms 313.59 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 4/s 142 KiB/s 98 KiB/s 1.83 ms 295.15 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 5/s 134 KiB/s 122 KiB/s 1.87 ms 259.78 us 2024-03-25T09:28:59.995 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 128 KiB/s 76 KiB/s 1.81 ms 312.57 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 5/s 130 KiB/s 109 KiB/s 2.00 ms 311.06 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 4/s 134 KiB/s 93 KiB/s 1.98 ms 325.03 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 4/s 136 KiB/s 88 KiB/s 1.94 ms 320.20 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 5/s 137 KiB/s 103 KiB/s 1.70 ms 346.61 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 5/s 108 KiB/s 82 KiB/s 1.78 ms 279.43 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 5/s 130 KiB/s 105 KiB/s 1.96 ms 299.47 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 5/s 114 KiB/s 117 KiB/s 1.81 ms 283.56 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 4/s 86 KiB/s 107 KiB/s 1.78 ms 308.19 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 4/s 121 KiB/s 106 KiB/s 1.80 ms 314.94 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 4/s 129 KiB/s 128 KiB/s 1.71 ms 379.74 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 3/s 106 KiB/s 71 KiB/s 1.77 ms 518.41 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 110 KiB/s 108 KiB/s 1.79 ms 360.84 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 125 KiB/s 110 KiB/s 2.27 ms 407.09 us 2024-03-25T09:28:59.996 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 5/s 87 KiB/s 97 KiB/s 1.66 ms 321.52 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 6/s 94 KiB/s 137 KiB/s 1.70 ms 267.88 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 4/s 90 KiB/s 100 KiB/s 1.73 ms 335.30 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 5/s 94 KiB/s 159 KiB/s 1.92 ms 303.67 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 6/s 115 KiB/s 161 KiB/s 1.78 ms 304.08 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 5/s 84 KiB/s 112 KiB/s 1.87 ms 324.30 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 6/s 100 KiB/s 125 KiB/s 1.99 ms 357.70 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 80 KiB/s 78 KiB/s 1.85 ms 309.87 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 6/s 102 KiB/s 123 KiB/s 1.90 ms 262.08 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 5/s 65 KiB/s 116 KiB/s 1.96 ms 360.04 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 6/s 86 KiB/s 128 KiB/s 2.29 ms 342.05 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 6/s 130 KiB/s 150 KiB/s 1.83 ms 361.20 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 110 KiB/s 118 KiB/s 1.88 ms 389.68 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 6/s 88 KiB/s 134 KiB/s 1.99 ms 294.54 us 2024-03-25T09:28:59.997 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 5/s 104 KiB/s 126 KiB/s 1.79 ms 322.08 us 2024-03-25T09:28:59.998 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 6/s 107 KiB/s 129 KiB/s 1.76 ms 309.76 us 2024-03-25T09:28:59.998 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 5/s 90 KiB/s 95 KiB/s 2.13 ms 372.58 us 2024-03-25T09:28:59.998 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 5/s 82 KiB/s 109 KiB/s 1.88 ms 292.54 us 2024-03-25T09:28:59.998 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 7/s 75 KiB/s 150 KiB/s 1.83 ms 335.54 us 2024-03-25T09:28:59.998 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:00.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:00.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:00.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:01.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:00 smithi059 ceph-mon[32732]: pgmap v597: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.9 MiB/s wr, 594 op/s 2024-03-25T09:29:01.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:00 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:01.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:00 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:01.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:00 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:01.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:00 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:01.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:00 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:01.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:00 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:01.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:00 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:01.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:00 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 452 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:01.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-mon[33094]: pgmap v597: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.9 MiB/s wr, 594 op/s 2024-03-25T09:29:01.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:01.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:01.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:01.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:01.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:01.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:01.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:01.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:00 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 452 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:01.144 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:00 smithi019 ceph-mon[29386]: pgmap v597: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.9 MiB/s wr, 594 op/s 2024-03-25T09:29:01.145 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:00 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:01.145 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:00 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:01.145 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:00 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:01.146 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:00 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:01.146 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:00 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:01.146 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:00 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:01.146 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:00 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:01.146 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:00 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 452 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:01.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:01.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:01.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:02.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:02.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:02.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:03.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:02 smithi059 ceph-mon[32732]: pgmap v598: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.5 MiB/s wr, 667 op/s 2024-03-25T09:29:03.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:02.803+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:03.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:02 smithi040 ceph-mon[33094]: pgmap v598: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.5 MiB/s wr, 667 op/s 2024-03-25T09:29:03.156 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:02 smithi019 ceph-mon[29386]: pgmap v598: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.5 MiB/s wr, 667 op/s 2024-03-25T09:29:03.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:03.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:03.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:04.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:04.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:04.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:04.998 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:04.999 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 6/s 5/s 118 KiB/s 102 KiB/s 1.78 ms 355.97 us 2024-03-25T09:29:04.999 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 3/s 144 KiB/s 77 KiB/s 1.88 ms 351.50 us 2024-03-25T09:29:04.999 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 4/s 143 KiB/s 102 KiB/s 2.02 ms 309.52 us 2024-03-25T09:29:04.999 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 6/s 3/s 148 KiB/s 77 KiB/s 1.86 ms 319.17 us 2024-03-25T09:29:04.999 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 3/s 149 KiB/s 82 KiB/s 1.98 ms 392.94 us 2024-03-25T09:29:05.000 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 4/s 154 KiB/s 90 KiB/s 1.81 ms 357.15 us 2024-03-25T09:29:05.000 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 4/s 157 KiB/s 80 KiB/s 1.99 ms 457.47 us 2024-03-25T09:29:05.000 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 6/s 4/s 138 KiB/s 66 KiB/s 1.97 ms 281.01 us 2024-03-25T09:29:05.000 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 4/s 136 KiB/s 89 KiB/s 1.81 ms 255.87 us 2024-03-25T09:29:05.000 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 5/s 141 KiB/s 98 KiB/s 2.03 ms 374.27 us 2024-03-25T09:29:05.000 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 5/s 107 KiB/s 108 KiB/s 1.74 ms 354.59 us 2024-03-25T09:29:05.001 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 4/s 122 KiB/s 84 KiB/s 1.85 ms 305.32 us 2024-03-25T09:29:05.001 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 4/s 141 KiB/s 94 KiB/s 2.05 ms 331.45 us 2024-03-25T09:29:05.001 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 5/s 134 KiB/s 89 KiB/s 1.80 ms 270.44 us 2024-03-25T09:29:05.001 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 5/s 135 KiB/s 107 KiB/s 1.85 ms 313.56 us 2024-03-25T09:29:05.001 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 4/s 122 KiB/s 96 KiB/s 1.71 ms 304.23 us 2024-03-25T09:29:05.001 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 3/s 147 KiB/s 98 KiB/s 1.98 ms 329.59 us 2024-03-25T09:29:05.002 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 96 KiB/s 113 KiB/s 2.03 ms 329.98 us 2024-03-25T09:29:05.002 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 4/s 93 KiB/s 84 KiB/s 2.00 ms 302.37 us 2024-03-25T09:29:05.002 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 130 KiB/s 105 KiB/s 1.85 ms 280.31 us 2024-03-25T09:29:05.002 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 3/s 122 KiB/s 64 KiB/s 1.95 ms 329.13 us 2024-03-25T09:29:05.002 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 4/s 138 KiB/s 98 KiB/s 1.76 ms 284.78 us 2024-03-25T09:29:05.002 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 80 KiB/s 154 KiB/s 1.76 ms 340.10 us 2024-03-25T09:29:05.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 5/s 89 KiB/s 125 KiB/s 1.98 ms 300.31 us 2024-03-25T09:29:05.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 5/s 129 KiB/s 125 KiB/s 1.98 ms 324.91 us 2024-03-25T09:29:05.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 4/s 102 KiB/s 118 KiB/s 1.83 ms 327.44 us 2024-03-25T09:29:05.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 5/s 114 KiB/s 118 KiB/s 1.83 ms 302.90 us 2024-03-25T09:29:05.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 5/s 120 KiB/s 114 KiB/s 1.77 ms 301.87 us 2024-03-25T09:29:05.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 5/s 114 KiB/s 110 KiB/s 2.26 ms 340.27 us 2024-03-25T09:29:05.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 4/s 84 KiB/s 80 KiB/s 1.83 ms 280.38 us 2024-03-25T09:29:05.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 4/s 112 KiB/s 115 KiB/s 1.90 ms 342.88 us 2024-03-25T09:29:05.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 3/s 79 KiB/s 86 KiB/s 2.02 ms 365.96 us 2024-03-25T09:29:05.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 5/s 100 KiB/s 122 KiB/s 2.19 ms 312.46 us 2024-03-25T09:29:05.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 6/s 93 KiB/s 150 KiB/s 2.07 ms 294.60 us 2024-03-25T09:29:05.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 5/s 94 KiB/s 94 KiB/s 1.77 ms 281.32 us 2024-03-25T09:29:05.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 6/s 110 KiB/s 144 KiB/s 1.74 ms 381.27 us 2024-03-25T09:29:05.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 123 KiB/s 72 KiB/s 1.83 ms 400.19 us 2024-03-25T09:29:05.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 5/s 111 KiB/s 119 KiB/s 1.85 ms 283.14 us 2024-03-25T09:29:05.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 5/s 142 KiB/s 118 KiB/s 2.08 ms 468.66 us 2024-03-25T09:29:05.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 6/s 84 KiB/s 131 KiB/s 1.73 ms 286.33 us 2024-03-25T09:29:05.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 85 KiB/s 126 KiB/s 1.90 ms 343.06 us 2024-03-25T09:29:05.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 5/s 105 KiB/s 103 KiB/s 1.90 ms 327.08 us 2024-03-25T09:29:05.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 120 KiB/s 105 KiB/s 2.21 ms 294.84 us 2024-03-25T09:29:05.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 119 KiB/s 100 KiB/s 1.73 ms 315.31 us 2024-03-25T09:29:05.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 5/s 103 KiB/s 122 KiB/s 1.93 ms 358.09 us 2024-03-25T09:29:05.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 6/s 68 KiB/s 187 KiB/s 1.95 ms 344.58 us 2024-03-25T09:29:05.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 4/s 100 KiB/s 103 KiB/s 1.67 ms 283.63 us 2024-03-25T09:29:05.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 4/s 73 KiB/s 86 KiB/s 1.84 ms 315.53 us 2024-03-25T09:29:05.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 6/s 109 KiB/s 134 KiB/s 1.87 ms 301.66 us 2024-03-25T09:29:05.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 6/s 63 KiB/s 134 KiB/s 1.86 ms 325.98 us 2024-03-25T09:29:05.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 5/s 66 KiB/s 94 KiB/s 2.36 ms 300.72 us 2024-03-25T09:29:05.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 5/s 75 KiB/s 125 KiB/s 1.75 ms 369.16 us 2024-03-25T09:29:05.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 63 KiB/s 95 KiB/s 1.79 ms 323.37 us 2024-03-25T09:29:05.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 5/s 107 KiB/s 110 KiB/s 1.87 ms 328.08 us 2024-03-25T09:29:05.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 5/s 87 KiB/s 102 KiB/s 1.84 ms 279.15 us 2024-03-25T09:29:05.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 6/s 71 KiB/s 159 KiB/s 1.71 ms 351.28 us 2024-03-25T09:29:05.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 6/s 70 KiB/s 152 KiB/s 1.84 ms 295.69 us 2024-03-25T09:29:05.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 5/s 71 KiB/s 113 KiB/s 1.83 ms 287.69 us 2024-03-25T09:29:05.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 6/s 62 KiB/s 130 KiB/s 1.87 ms 333.74 us 2024-03-25T09:29:05.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 5/s 82 KiB/s 147 KiB/s 1.75 ms 362.58 us 2024-03-25T09:29:05.009 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:05.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:04 smithi059 ceph-mon[32732]: pgmap v599: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.1 MiB/s wr, 551 op/s 2024-03-25T09:29:05.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:04 smithi040 ceph-mon[33094]: pgmap v599: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.1 MiB/s wr, 551 op/s 2024-03-25T09:29:05.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:04 smithi019 ceph-mon[29386]: pgmap v599: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.1 MiB/s wr, 551 op/s 2024-03-25T09:29:05.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:05.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:05.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:06.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:05 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:06.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:05 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:06.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:05 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:06.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:05 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:06.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:05 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:06.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:05 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:06.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:05 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:06.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:05 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 457 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:06.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:05 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:06.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:05 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:06.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:05 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:06.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:05 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:06.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:05 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:06.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:05 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:06.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:05 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:06.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:05 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 457 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:06.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:06.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:06.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:06.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:06.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:06.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:06.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:06.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:05 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 457 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:06.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:06.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:06.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:07.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:06 smithi059 ceph-mon[32732]: pgmap v600: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.4 MiB/s wr, 691 op/s 2024-03-25T09:29:07.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:06 smithi040 ceph-mon[33094]: pgmap v600: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.4 MiB/s wr, 691 op/s 2024-03-25T09:29:07.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:06 smithi019 ceph-mon[29386]: pgmap v600: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.4 MiB/s wr, 691 op/s 2024-03-25T09:29:07.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:07.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:07.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:08.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:07.803+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:08.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:08.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:08.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:09.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:08 smithi059 ceph-mon[32732]: pgmap v601: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.4 MiB/s wr, 609 op/s 2024-03-25T09:29:09.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:08 smithi040 ceph-mon[33094]: pgmap v601: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.4 MiB/s wr, 609 op/s 2024-03-25T09:29:09.059 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:08 smithi019 ceph-mon[29386]: pgmap v601: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.4 MiB/s wr, 609 op/s 2024-03-25T09:29:09.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:09.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:09.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:09.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 111.6k 87.6k 0.0k 1.1M 876.0k 0.0k nvme2n1 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 105.2k 107.6k 0.0k 1.0M 1.1M 0.0k nvme2n10 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 85.6k 131.6k 0.0k 856.0k 1.3M 0.0k nvme2n11 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 114.4k 94.4k 0.0k 1.1M 944.0k 0.0k nvme2n12 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 102.0k 101.2k 0.0k 1020.0k 1012.0k 0.0k nvme2n13 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 130.4k 91.2k 0.0k 1.3M 912.0k 0.0k nvme2n14 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 112.0k 98.4k 0.0k 1.1M 984.0k 0.0k nvme2n15 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 105.6k 112.8k 0.0k 1.0M 1.1M 0.0k nvme2n16 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 142.4k 104.4k 0.0k 1.4M 1.0M 0.0k nvme2n17 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 106.0k 108.0k 0.0k 1.0M 1.1M 0.0k nvme2n18 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 82.0k 113.2k 0.0k 820.0k 1.1M 0.0k nvme2n19 2024-03-25T09:29:09.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 114.4k 117.2k 0.0k 1.1M 1.1M 0.0k nvme2n2 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 83.6k 108.8k 0.0k 836.0k 1.1M 0.0k nvme2n20 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 97.6k 108.0k 0.0k 976.0k 1.1M 0.0k nvme2n3 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 122.0k 107.2k 0.0k 1.2M 1.0M 0.0k nvme2n4 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 112.0k 116.0k 0.0k 1.1M 1.1M 0.0k nvme2n5 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 121.2k 96.8k 0.0k 1.2M 968.0k 0.0k nvme2n6 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 119.2k 98.8k 0.0k 1.2M 988.0k 0.0k nvme2n7 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 80.4k 109.2k 0.0k 804.0k 1.1M 0.0k nvme2n8 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 120.8k 98.4k 0.0k 1.2M 984.0k 0.0k nvme2n9 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 101.6k 111.6k 0.0k 1016.0k 1.1M 0.0k nvme5n1 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 104.0k 121.2k 0.0k 1.0M 1.2M 0.0k nvme5n10 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 121.2k 85.2k 0.0k 1.2M 852.0k 0.0k nvme5n11 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 89.2k 102.4k 0.0k 892.0k 1.0M 0.0k nvme5n12 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 104.8k 103.6k 0.0k 1.0M 1.0M 0.0k nvme5n13 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 116.0k 102.0k 0.0k 1.1M 1020.0k 0.0k nvme5n14 2024-03-25T09:29:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 107.6k 142.0k 0.0k 1.1M 1.4M 0.0k nvme5n15 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 96.4k 105.6k 0.0k 964.0k 1.0M 0.0k nvme5n16 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 104.4k 77.2k 0.0k 1.0M 772.0k 0.0k nvme5n17 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 94.8k 111.2k 0.0k 948.0k 1.1M 0.0k nvme5n18 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 127.6k 116.4k 0.0k 1.2M 1.1M 0.0k nvme5n19 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 104.0k 89.6k 0.0k 1.0M 896.0k 0.0k nvme5n2 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 122.0k 90.8k 0.0k 1.2M 908.0k 0.0k nvme5n20 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 113.6k 129.2k 0.0k 1.1M 1.3M 0.0k nvme5n3 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 95.2k 117.6k 0.0k 952.0k 1.1M 0.0k nvme5n4 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 98.0k 80.8k 0.0k 980.0k 808.0k 0.0k nvme5n5 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 116.0k 96.8k 0.0k 1.1M 968.0k 0.0k nvme5n6 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 89.6k 88.4k 0.0k 896.0k 884.0k 0.0k nvme5n7 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 97.2k 122.8k 0.0k 972.0k 1.2M 0.0k nvme5n8 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 87.2k 93.6k 0.0k 872.0k 936.0k 0.0k nvme5n9 2024-03-25T09:29:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 80.4k 129.6k 0.0k 804.0k 1.3M 0.0k nvme8n1 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 102.0k 101.2k 0.0k 1020.0k 1012.0k 0.0k nvme8n10 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 112.0k 102.4k 0.0k 1.1M 1.0M 0.0k nvme8n11 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 111.6k 125.2k 0.0k 1.1M 1.2M 0.0k nvme8n12 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 88.4k 105.6k 0.0k 884.0k 1.0M 0.0k nvme8n13 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 99.2k 115.2k 0.0k 992.0k 1.1M 0.0k nvme8n14 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 89.2k 120.0k 0.0k 892.0k 1.2M 0.0k nvme8n15 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 80.4k 121.6k 0.0k 804.0k 1.2M 0.0k nvme8n16 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 120.0k 121.2k 0.0k 1.2M 1.2M 0.0k nvme8n17 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 100.8k 119.6k 0.0k 1008.0k 1.2M 0.0k nvme8n18 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 90.0k 110.4k 0.0k 900.0k 1.1M 0.0k nvme8n19 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 98.0k 120.8k 0.0k 980.0k 1.2M 0.0k nvme8n2 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 77.6k 112.8k 0.0k 776.0k 1.1M 0.0k nvme8n20 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 90.8k 119.6k 0.0k 908.0k 1.2M 0.0k nvme8n3 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 90.8k 99.6k 0.0k 908.0k 996.0k 0.0k nvme8n4 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 131.2k 86.4k 0.0k 1.3M 864.0k 0.0k nvme8n5 2024-03-25T09:29:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 135.6k 92.4k 0.0k 1.3M 924.0k 0.0k nvme8n6 2024-03-25T09:29:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 122.0k 106.0k 0.0k 1.2M 1.0M 0.0k nvme8n7 2024-03-25T09:29:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 70.4k 108.8k 0.0k 704.0k 1.1M 0.0k nvme8n8 2024-03-25T09:29:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.20 92.4k 111.2k 0.0k 924.0k 1.1M 0.0k nvme8n9 2024-03-25T09:29:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:10.002 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:10.002 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 7/s 3/s 153 KiB/s 88 KiB/s 1.80 ms 377.70 us 2024-03-25T09:29:10.002 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 3/s 120 KiB/s 78 KiB/s 1.81 ms 303.76 us 2024-03-25T09:29:10.002 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 4/s 138 KiB/s 82 KiB/s 1.85 ms 298.21 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 4/s 174 KiB/s 79 KiB/s 1.81 ms 285.89 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 4/s 146 KiB/s 94 KiB/s 1.69 ms 322.20 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 6/s 4/s 122 KiB/s 70 KiB/s 1.77 ms 287.51 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 3/s 144 KiB/s 72 KiB/s 1.94 ms 308.52 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 3/s 112 KiB/s 67 KiB/s 1.79 ms 378.61 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 5/s 122 KiB/s 140 KiB/s 2.01 ms 302.78 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 4/s 117 KiB/s 79 KiB/s 1.74 ms 284.16 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 6/s 4/s 124 KiB/s 98 KiB/s 1.90 ms 357.75 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 5/s 138 KiB/s 124 KiB/s 1.97 ms 395.39 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 4/s 126 KiB/s 77 KiB/s 1.76 ms 281.70 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 4/s 78 KiB/s 97 KiB/s 1.83 ms 425.67 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 4/s 98 KiB/s 95 KiB/s 1.87 ms 368.53 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 138 KiB/s 79 KiB/s 1.96 ms 433.68 us 2024-03-25T09:29:10.003 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 3/s 113 KiB/s 77 KiB/s 1.96 ms 315.21 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 5/s 94 KiB/s 122 KiB/s 2.00 ms 297.26 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 4/s 108 KiB/s 100 KiB/s 1.92 ms 388.01 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 135 KiB/s 87 KiB/s 1.89 ms 461.72 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 101 KiB/s 113 KiB/s 1.91 ms 301.19 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 5/s 108 KiB/s 72 KiB/s 1.96 ms 330.63 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 6/s 101 KiB/s 161 KiB/s 1.91 ms 337.13 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 5/s 117 KiB/s 124 KiB/s 1.81 ms 268.09 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 4/s 120 KiB/s 99 KiB/s 1.84 ms 292.02 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 5/s 112 KiB/s 114 KiB/s 1.90 ms 311.28 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 5/s 97 KiB/s 98 KiB/s 1.96 ms 274.36 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 4/s 96 KiB/s 83 KiB/s 2.49 ms 305.24 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 98 KiB/s 139 KiB/s 2.06 ms 318.62 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 5/s 114 KiB/s 100 KiB/s 1.81 ms 347.77 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 4/s 110 KiB/s 122 KiB/s 2.10 ms 319.45 us 2024-03-25T09:29:10.004 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 4/s 93 KiB/s 99 KiB/s 2.10 ms 380.87 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 5/s 122 KiB/s 112 KiB/s 1.72 ms 314.73 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 5/s 107 KiB/s 106 KiB/s 2.01 ms 315.69 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 5/s 106 KiB/s 118 KiB/s 1.94 ms 343.00 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 4/s 93 KiB/s 88 KiB/s 1.83 ms 334.14 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 5/s 117 KiB/s 106 KiB/s 1.97 ms 320.30 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 142 KiB/s 152 KiB/s 1.86 ms 327.21 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 4/s 110 KiB/s 108 KiB/s 1.90 ms 362.98 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 5/s 90 KiB/s 88 KiB/s 1.90 ms 342.55 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 126 KiB/s 122 KiB/s 2.11 ms 454.22 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 5/s 105 KiB/s 102 KiB/s 1.96 ms 359.45 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 5/s 110 KiB/s 119 KiB/s 1.91 ms 414.97 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 5/s 92 KiB/s 82 KiB/s 1.82 ms 310.44 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 5/s 79 KiB/s 74 KiB/s 2.04 ms 310.07 us 2024-03-25T09:29:10.005 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 96 KiB/s 78 KiB/s 2.25 ms 303.94 us 2024-03-25T09:29:10.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 5/s 97 KiB/s 85 KiB/s 1.79 ms 281.45 us 2024-03-25T09:29:10.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 5/s 103 KiB/s 107 KiB/s 1.68 ms 294.40 us 2024-03-25T09:29:10.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 6/s 107 KiB/s 150 KiB/s 2.06 ms 309.71 us 2024-03-25T09:29:10.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 102 KiB/s 78 KiB/s 1.96 ms 314.00 us 2024-03-25T09:29:10.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 5/s 75 KiB/s 105 KiB/s 1.79 ms 338.94 us 2024-03-25T09:29:10.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 6/s 58 KiB/s 95 KiB/s 2.00 ms 306.18 us 2024-03-25T09:29:10.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 6/s 85 KiB/s 110 KiB/s 1.85 ms 278.33 us 2024-03-25T09:29:10.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 6/s 87 KiB/s 119 KiB/s 2.03 ms 332.48 us 2024-03-25T09:29:10.006 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 6/s 114 KiB/s 125 KiB/s 1.87 ms 319.00 us 2024-03-25T09:29:10.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 6/s 94 KiB/s 115 KiB/s 1.83 ms 276.69 us 2024-03-25T09:29:10.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 5/s 93 KiB/s 99 KiB/s 1.81 ms 349.94 us 2024-03-25T09:29:10.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 5/s 82 KiB/s 107 KiB/s 2.05 ms 305.28 us 2024-03-25T09:29:10.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 5/s 82 KiB/s 116 KiB/s 1.81 ms 299.64 us 2024-03-25T09:29:10.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 6/s 66 KiB/s 126 KiB/s 2.09 ms 342.33 us 2024-03-25T09:29:10.007 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:10.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:10.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:11.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:10 smithi059 ceph-mon[32732]: pgmap v602: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-03-25T09:29:11.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:10 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:11.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:10 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:11.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:10 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:11.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:10 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:11.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:10 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:11.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:10 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:11.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:10 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:11.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:10 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 462 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-mon[33094]: pgmap v602: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-03-25T09:29:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:11.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:10 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 462 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:11.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:10 smithi019 ceph-mon[29386]: pgmap v602: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-03-25T09:29:11.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:10 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:11.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:10 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:11.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:10 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:11.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:10 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:11.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:10 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:11.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:10 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:11.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:10 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:11.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:10 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 462 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:11.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:11.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:11.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:12.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:12.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:12.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:13.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:12 smithi059 ceph-mon[32732]: pgmap v603: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.9 MiB/s wr, 670 op/s 2024-03-25T09:29:13.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:12.803+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:13.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:12 smithi040 ceph-mon[33094]: pgmap v603: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.9 MiB/s wr, 670 op/s 2024-03-25T09:29:13.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:12 smithi019 ceph-mon[29386]: pgmap v603: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.9 MiB/s wr, 670 op/s 2024-03-25T09:29:13.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:13.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:13.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:14.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:14.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:14.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:15.007 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:15.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 8/s 3/s 154 KiB/s 86 KiB/s 1.74 ms 291.29 us 2024-03-25T09:29:15.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 3/s 152 KiB/s 94 KiB/s 1.94 ms 379.28 us 2024-03-25T09:29:15.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 3/s 123 KiB/s 73 KiB/s 1.85 ms 315.58 us 2024-03-25T09:29:15.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 4/s 115 KiB/s 93 KiB/s 2.06 ms 297.39 us 2024-03-25T09:29:15.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 6/s 5/s 116 KiB/s 106 KiB/s 2.04 ms 389.51 us 2024-03-25T09:29:15.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 5/s 126 KiB/s 92 KiB/s 2.07 ms 304.06 us 2024-03-25T09:29:15.007 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 6/s 122 KiB/s 158 KiB/s 1.83 ms 353.40 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 4/s 115 KiB/s 68 KiB/s 2.24 ms 321.13 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 4/s 118 KiB/s 58 KiB/s 1.83 ms 281.58 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 4/s 118 KiB/s 70 KiB/s 2.06 ms 292.89 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 4/s 150 KiB/s 94 KiB/s 2.17 ms 422.07 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 3/s 130 KiB/s 80 KiB/s 1.82 ms 350.46 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 4/s 110 KiB/s 72 KiB/s 2.02 ms 290.62 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 120 KiB/s 81 KiB/s 1.89 ms 323.14 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 5/s 105 KiB/s 120 KiB/s 1.81 ms 307.92 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 4/s 94 KiB/s 101 KiB/s 1.72 ms 263.19 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 98 KiB/s 138 KiB/s 1.89 ms 337.94 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 107 KiB/s 91 KiB/s 1.89 ms 368.24 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 4/s 122 KiB/s 64 KiB/s 1.72 ms 299.83 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 4/s 91 KiB/s 108 KiB/s 1.84 ms 306.66 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 4/s 118 KiB/s 71 KiB/s 2.08 ms 294.63 us 2024-03-25T09:29:15.008 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 5/s 107 KiB/s 113 KiB/s 1.94 ms 303.06 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 4/s 98 KiB/s 98 KiB/s 1.84 ms 391.55 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 118 KiB/s 119 KiB/s 2.02 ms 310.29 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 4/s 82 KiB/s 97 KiB/s 1.88 ms 397.34 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 6/s 86 KiB/s 126 KiB/s 1.89 ms 399.19 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 6/s 123 KiB/s 117 KiB/s 1.69 ms 371.91 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 4/s 124 KiB/s 91 KiB/s 1.91 ms 309.25 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 5/s 95 KiB/s 115 KiB/s 2.56 ms 330.68 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 4/s 104 KiB/s 113 KiB/s 1.91 ms 336.56 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 5/s 110 KiB/s 122 KiB/s 1.66 ms 291.29 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 6/s 87 KiB/s 106 KiB/s 1.77 ms 361.65 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 4/s 102 KiB/s 87 KiB/s 1.90 ms 297.63 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 5/s 119 KiB/s 122 KiB/s 2.07 ms 420.39 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 5/s 122 KiB/s 105 KiB/s 1.96 ms 325.20 us 2024-03-25T09:29:15.009 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 5/s 110 KiB/s 99 KiB/s 2.11 ms 386.65 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 6/s 134 KiB/s 112 KiB/s 1.93 ms 310.76 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 5/s 118 KiB/s 88 KiB/s 1.93 ms 345.36 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 4/s 95 KiB/s 79 KiB/s 1.92 ms 329.32 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 5/s 82 KiB/s 92 KiB/s 1.84 ms 293.75 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 5/s 89 KiB/s 117 KiB/s 1.84 ms 324.66 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 6/s 85 KiB/s 134 KiB/s 2.06 ms 335.69 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 3/s 99 KiB/s 90 KiB/s 1.88 ms 412.64 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 5/s 102 KiB/s 140 KiB/s 1.73 ms 317.84 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 5/s 92 KiB/s 109 KiB/s 1.69 ms 308.56 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 88 KiB/s 90 KiB/s 1.92 ms 355.34 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 5/s 111 KiB/s 112 KiB/s 1.87 ms 368.04 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 5/s 69 KiB/s 120 KiB/s 1.86 ms 443.16 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 5/s 109 KiB/s 91 KiB/s 1.86 ms 297.08 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 6/s 100 KiB/s 137 KiB/s 1.84 ms 318.14 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 5/s 71 KiB/s 114 KiB/s 2.17 ms 398.49 us 2024-03-25T09:29:15.010 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 5/s 106 KiB/s 126 KiB/s 1.89 ms 277.53 us 2024-03-25T09:29:15.011 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 98 KiB/s 89 KiB/s 1.99 ms 427.15 us 2024-03-25T09:29:15.011 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 5/s 75 KiB/s 94 KiB/s 1.76 ms 294.75 us 2024-03-25T09:29:15.011 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 5/s 81 KiB/s 105 KiB/s 1.84 ms 312.78 us 2024-03-25T09:29:15.011 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 5/s 104 KiB/s 116 KiB/s 2.11 ms 393.75 us 2024-03-25T09:29:15.011 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 6/s 71 KiB/s 134 KiB/s 1.79 ms 322.81 us 2024-03-25T09:29:15.011 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 62 KiB/s 98 KiB/s 2.12 ms 365.07 us 2024-03-25T09:29:15.011 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 6/s 61 KiB/s 133 KiB/s 1.80 ms 286.63 us 2024-03-25T09:29:15.011 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 2/s 7/s 58 KiB/s 153 KiB/s 2.11 ms 342.94 us 2024-03-25T09:29:15.011 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:15.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:14 smithi059 ceph-mon[32732]: pgmap v604: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 548 op/s 2024-03-25T09:29:15.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:14 smithi040 ceph-mon[33094]: pgmap v604: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 548 op/s 2024-03-25T09:29:15.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:14 smithi019 ceph-mon[29386]: pgmap v604: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 548 op/s 2024-03-25T09:29:15.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:15.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:15.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:16.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:15 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:16.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:15 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:16.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:15 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:16.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:15 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:16.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:15 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:16.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:15 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:16.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:15 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:16.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:15 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 467 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:16.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:16.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:16.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:16.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:16.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:16.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:16.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:16.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:15 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 467 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:15 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:15 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:15 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:15 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:15 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:15 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:15 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:15 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 467 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:16.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:16.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:16.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:17.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:16 smithi040 ceph-mon[33094]: pgmap v605: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.8 MiB/s wr, 686 op/s 2024-03-25T09:29:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:16 smithi019 ceph-mon[29386]: pgmap v605: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.8 MiB/s wr, 686 op/s 2024-03-25T09:29:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:16 smithi059 ceph-mon[32732]: pgmap v605: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.8 MiB/s wr, 686 op/s 2024-03-25T09:29:17.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:17.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:17.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:18.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:17.804+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:18.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:18.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:18.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:19.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:18 smithi019 ceph-mon[29386]: pgmap v606: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 596 op/s 2024-03-25T09:29:19.161 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:18 smithi059 ceph-mon[32732]: pgmap v606: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 596 op/s 2024-03-25T09:29:19.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:18 smithi040 ceph-mon[33094]: pgmap v606: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 596 op/s 2024-03-25T09:29:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:19.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:19.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 93.2k 95.6k 0.0k 932.0k 956.0k 0.0k nvme2n1 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 89.2k 95.2k 0.0k 892.0k 952.0k 0.0k nvme2n10 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 112.8k 95.6k 0.0k 1.1M 956.0k 0.0k nvme2n11 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 65.2k 106.0k 0.0k 652.0k 1.0M 0.0k nvme2n12 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 111.2k 67.2k 0.0k 1.1M 672.0k 0.0k nvme2n13 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 86.8k 90.0k 0.0k 868.0k 900.0k 0.0k nvme2n14 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 98.4k 112.4k 0.0k 984.0k 1.1M 0.0k nvme2n15 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 93.2k 110.4k 0.0k 932.0k 1.1M 0.0k nvme2n16 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 118.8k 82.0k 0.0k 1.2M 820.0k 0.0k nvme2n17 2024-03-25T09:29:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 102.8k 86.0k 0.0k 1.0M 860.0k 0.0k nvme2n18 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 92.0k 112.8k 0.0k 920.0k 1.1M 0.0k nvme2n19 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 87.2k 84.8k 0.0k 872.0k 848.0k 0.0k nvme2n2 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 95.2k 152.0k 0.0k 952.0k 1.5M 0.0k nvme2n20 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 102.8k 95.2k 0.0k 1.0M 952.0k 0.0k nvme2n3 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 89.2k 102.4k 0.0k 892.0k 1.0M 0.0k nvme2n4 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 105.6k 86.4k 0.0k 1.0M 864.0k 0.0k nvme2n5 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 90.4k 93.6k 0.0k 904.0k 936.0k 0.0k nvme2n6 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 100.8k 101.2k 0.0k 1008.0k 1012.0k 0.0k nvme2n7 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 103.2k 102.4k 0.0k 1.0M 1.0M 0.0k nvme2n8 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 106.4k 72.4k 0.0k 1.0M 724.0k 0.0k nvme2n9 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 96.4k 101.2k 0.0k 964.0k 1012.0k 0.0k nvme5n1 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 95.2k 91.6k 0.0k 952.0k 916.0k 0.0k nvme5n10 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 103.2k 82.4k 0.0k 1.0M 824.0k 0.0k nvme5n11 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 85.6k 97.2k 0.0k 856.0k 972.0k 0.0k nvme5n12 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 85.6k 106.8k 0.0k 856.0k 1.0M 0.0k nvme5n13 2024-03-25T09:29:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 88.8k 106.8k 0.0k 888.0k 1.0M 0.0k nvme5n14 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 111.2k 91.2k 0.0k 1.1M 912.0k 0.0k nvme5n15 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 113.2k 95.6k 0.0k 1.1M 956.0k 0.0k nvme5n16 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 114.0k 74.8k 0.0k 1.1M 748.0k 0.0k nvme5n17 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 112.8k 92.4k 0.0k 1.1M 924.0k 0.0k nvme5n18 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 97.2k 86.4k 0.0k 972.0k 864.0k 0.0k nvme5n19 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 78.0k 109.6k 0.0k 780.0k 1.1M 0.0k nvme5n2 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 82.8k 101.6k 0.0k 828.0k 1016.0k 0.0k nvme5n20 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 99.6k 118.8k 0.0k 996.0k 1.2M 0.0k nvme5n3 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 112.8k 84.0k 0.0k 1.1M 840.0k 0.0k nvme5n4 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 109.2k 78.0k 0.0k 1.1M 780.0k 0.0k nvme5n5 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 105.6k 85.2k 0.0k 1.0M 852.0k 0.0k nvme5n6 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 106.0k 84.8k 0.0k 1.0M 848.0k 0.0k nvme5n7 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 114.8k 104.8k 0.0k 1.1M 1.0M 0.0k nvme5n8 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 100.8k 108.8k 0.0k 1008.0k 1.1M 0.0k nvme5n9 2024-03-25T09:29:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 109.6k 78.8k 0.0k 1.1M 788.0k 0.0k nvme8n1 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 86.0k 124.4k 0.0k 860.0k 1.2M 0.0k nvme8n10 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 79.2k 94.8k 0.0k 792.0k 948.0k 0.0k nvme8n11 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 109.6k 94.4k 0.0k 1.1M 944.0k 0.0k nvme8n12 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 125.2k 79.6k 0.0k 1.2M 796.0k 0.0k nvme8n13 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 90.8k 100.0k 0.0k 908.0k 1000.0k 0.0k nvme8n14 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 77.6k 126.4k 0.0k 776.0k 1.2M 0.0k nvme8n15 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 88.4k 114.4k 0.0k 884.0k 1.1M 0.0k nvme8n16 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.10 112.4k 105.6k 0.0k 1.1M 1.0M 0.0k nvme8n17 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 107.2k 86.0k 0.0k 1.0M 860.0k 0.0k nvme8n18 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 115.6k 100.4k 0.0k 1.1M 1004.0k 0.0k nvme8n19 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 88.0k 87.6k 0.0k 880.0k 876.0k 0.0k nvme8n2 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 88.4k 111.6k 0.0k 884.0k 1.1M 0.0k nvme8n20 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 83.2k 89.6k 0.0k 832.0k 896.0k 0.0k nvme8n3 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 77.6k 104.0k 0.0k 776.0k 1.0M 0.0k nvme8n4 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 116.4k 78.4k 0.0k 1.1M 784.0k 0.0k nvme8n5 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 93.6k 85.6k 0.0k 936.0k 856.0k 0.0k nvme8n6 2024-03-25T09:29:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 102.0k 96.4k 0.0k 1020.0k 964.0k 0.0k nvme8n7 2024-03-25T09:29:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 106.8k 92.4k 0.0k 1.0M 924.0k 0.0k nvme8n8 2024-03-25T09:29:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 10.00 102.4k 102.4k 0.0k 1.0M 1.0M 0.0k nvme8n9 2024-03-25T09:29:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:20.011 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:20.011 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 7/s 6/s 122 KiB/s 132 KiB/s 1.75 ms 315.82 us 2024-03-25T09:29:20.011 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 7/s 4/s 178 KiB/s 100 KiB/s 1.76 ms 341.65 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 4/s 133 KiB/s 93 KiB/s 1.90 ms 382.61 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 4/s 134 KiB/s 90 KiB/s 1.80 ms 310.48 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 5/s 121 KiB/s 132 KiB/s 1.89 ms 371.42 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 6/s 4/s 142 KiB/s 121 KiB/s 1.73 ms 319.81 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 4/s 112 KiB/s 75 KiB/s 1.93 ms 300.76 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 6/s 3/s 122 KiB/s 66 KiB/s 1.92 ms 291.57 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 4/s 116 KiB/s 66 KiB/s 1.88 ms 292.46 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 5/s 86 KiB/s 90 KiB/s 1.94 ms 270.85 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 5/s 112 KiB/s 101 KiB/s 2.51 ms 312.40 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 3/s 135 KiB/s 48 KiB/s 1.85 ms 367.77 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 4/s 121 KiB/s 85 KiB/s 1.91 ms 289.53 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 5/s 87 KiB/s 109 KiB/s 1.90 ms 334.00 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 3/s 99 KiB/s 78 KiB/s 2.32 ms 311.73 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 4/s 102 KiB/s 87 KiB/s 2.10 ms 290.15 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 5/s 95 KiB/s 94 KiB/s 2.16 ms 295.84 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 4/s 62 KiB/s 86 KiB/s 2.18 ms 418.64 us 2024-03-25T09:29:20.012 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 5/s 77 KiB/s 114 KiB/s 1.96 ms 320.74 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 6/s 111 KiB/s 106 KiB/s 2.40 ms 348.09 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 5/s 102 KiB/s 110 KiB/s 2.18 ms 392.29 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 5/s 93 KiB/s 108 KiB/s 1.75 ms 365.98 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 4/s 77 KiB/s 82 KiB/s 1.95 ms 339.42 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 5/s 87 KiB/s 107 KiB/s 1.80 ms 326.39 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 5/s 110 KiB/s 80 KiB/s 2.18 ms 331.92 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 4/s 104 KiB/s 95 KiB/s 1.90 ms 301.52 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 5/s 104 KiB/s 78 KiB/s 1.79 ms 316.34 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 5/s 101 KiB/s 114 KiB/s 1.87 ms 289.78 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 108 KiB/s 82 KiB/s 2.00 ms 429.63 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 5/s 74 KiB/s 105 KiB/s 2.00 ms 338.07 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 5/s 111 KiB/s 110 KiB/s 1.92 ms 324.72 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 102 KiB/s 88 KiB/s 1.91 ms 310.93 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 6/s 94 KiB/s 115 KiB/s 1.74 ms 332.66 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 86 KiB/s 76 KiB/s 1.88 ms 348.84 us 2024-03-25T09:29:20.013 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 77 KiB/s 76 KiB/s 1.85 ms 310.26 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 5/s 78 KiB/s 114 KiB/s 1.99 ms 375.59 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 6/s 90 KiB/s 148 KiB/s 1.92 ms 397.61 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 5/s 123 KiB/s 110 KiB/s 1.97 ms 329.35 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 6/s 79 KiB/s 102 KiB/s 2.12 ms 297.14 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 5/s 111 KiB/s 124 KiB/s 2.21 ms 378.57 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 5/s 72 KiB/s 107 KiB/s 1.88 ms 306.46 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 4/s 110 KiB/s 90 KiB/s 1.99 ms 287.81 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 87 KiB/s 102 KiB/s 1.93 ms 302.98 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 5/s 79 KiB/s 100 KiB/s 1.91 ms 388.22 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 86 KiB/s 83 KiB/s 1.98 ms 322.29 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 5/s 73 KiB/s 83 KiB/s 1.86 ms 331.06 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 5/s 75 KiB/s 115 KiB/s 2.09 ms 340.39 us 2024-03-25T09:29:20.014 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 6/s 101 KiB/s 113 KiB/s 2.11 ms 280.21 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 6/s 85 KiB/s 108 KiB/s 1.93 ms 342.92 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 5/s 50 KiB/s 98 KiB/s 1.96 ms 346.57 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 5/s 73 KiB/s 123 KiB/s 1.94 ms 320.85 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 6/s 82 KiB/s 132 KiB/s 2.08 ms 386.02 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 6/s 55 KiB/s 122 KiB/s 1.80 ms 371.72 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 73 KiB/s 93 KiB/s 2.19 ms 436.58 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 5/s 56 KiB/s 92 KiB/s 1.93 ms 312.71 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 3/s 88 KiB/s 79 KiB/s 1.87 ms 404.37 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 66 KiB/s 86 KiB/s 1.92 ms 343.80 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 2/s 59 KiB/s 61 KiB/s 1.58 ms 283.28 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 7/s 77 KiB/s 128 KiB/s 1.98 ms 340.04 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 2/s 6/s 64 KiB/s 130 KiB/s 1.77 ms 291.89 us 2024-03-25T09:29:20.015 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:20.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:20.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:20.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:21.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:20 smithi019 ceph-mon[29386]: pgmap v607: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 582 op/s 2024-03-25T09:29:21.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:20 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:21.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:20 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:21.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:20 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:21.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:20 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:21.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:20 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:21.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:20 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:21.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:20 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:21.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:20 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 472 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:20 smithi059 ceph-mon[32732]: pgmap v607: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 582 op/s 2024-03-25T09:29:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:20 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:20 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:20 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:20 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:20 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:20 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:20 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:21.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:20 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 472 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-mon[33094]: pgmap v607: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 582 op/s 2024-03-25T09:29:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:20 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 472 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:21.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:21.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:21.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:22.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:23.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:22 smithi019 ceph-mon[29386]: pgmap v608: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.3 MiB/s wr, 660 op/s 2024-03-25T09:29:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:22 smithi059 ceph-mon[32732]: pgmap v608: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.3 MiB/s wr, 660 op/s 2024-03-25T09:29:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:22.804+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:23.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:22 smithi040 ceph-mon[33094]: pgmap v608: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.3 MiB/s wr, 660 op/s 2024-03-25T09:29:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:24.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:24.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:25.015 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:25.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 7/s 4/s 118 KiB/s 74 KiB/s 2.05 ms 320.84 us 2024-03-25T09:29:25.015 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 7/s 4/s 125 KiB/s 110 KiB/s 2.04 ms 264.64 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 4/s 158 KiB/s 95 KiB/s 2.46 ms 339.56 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 4/s 105 KiB/s 63 KiB/s 1.91 ms 351.36 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 4/s 131 KiB/s 76 KiB/s 1.83 ms 267.09 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 4/s 106 KiB/s 82 KiB/s 1.92 ms 288.84 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 6/s 118 KiB/s 106 KiB/s 1.80 ms 289.67 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 7/s 108 KiB/s 138 KiB/s 1.91 ms 298.78 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 6/s 6/s 149 KiB/s 133 KiB/s 2.41 ms 307.21 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 6/s 4/s 101 KiB/s 106 KiB/s 1.71 ms 318.56 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 6/s 159 KiB/s 141 KiB/s 1.93 ms 418.19 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 4/s 126 KiB/s 72 KiB/s 1.92 ms 309.80 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 3/s 111 KiB/s 79 KiB/s 1.94 ms 416.16 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 5/s 128 KiB/s 126 KiB/s 1.79 ms 318.78 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 4/s 102 KiB/s 106 KiB/s 1.78 ms 308.93 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 4/s 109 KiB/s 70 KiB/s 1.87 ms 308.07 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 4/s 121 KiB/s 57 KiB/s 2.01 ms 308.68 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 7/s 138 KiB/s 172 KiB/s 1.93 ms 307.22 us 2024-03-25T09:29:25.016 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 4/s 122 KiB/s 73 KiB/s 1.88 ms 374.67 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 5/s 103 KiB/s 111 KiB/s 1.84 ms 351.52 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 5/s 81 KiB/s 112 KiB/s 1.87 ms 296.14 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 3/s 95 KiB/s 67 KiB/s 1.98 ms 420.31 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 5/s 101 KiB/s 109 KiB/s 2.05 ms 378.90 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 4/s 82 KiB/s 73 KiB/s 1.79 ms 300.73 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 5/s 93 KiB/s 98 KiB/s 2.40 ms 310.76 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 4/s 94 KiB/s 70 KiB/s 2.10 ms 346.95 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 5/s 181 KiB/s 170 KiB/s 1.97 ms 446.32 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 6/s 118 KiB/s 120 KiB/s 2.11 ms 313.85 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 4/s 114 KiB/s 76 KiB/s 1.75 ms 315.28 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 3/s 85 KiB/s 60 KiB/s 2.00 ms 345.55 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 82 KiB/s 86 KiB/s 1.93 ms 364.78 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 4/s 115 KiB/s 131 KiB/s 2.08 ms 341.54 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 3/s 127 KiB/s 91 KiB/s 2.22 ms 455.67 us 2024-03-25T09:29:25.017 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 5/s 158 KiB/s 141 KiB/s 1.72 ms 348.62 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 5/s 85 KiB/s 123 KiB/s 1.65 ms 332.84 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 117 KiB/s 110 KiB/s 2.10 ms 371.13 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 83 KiB/s 90 KiB/s 2.02 ms 375.24 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 5/s 84 KiB/s 92 KiB/s 1.88 ms 304.52 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 6/s 97 KiB/s 138 KiB/s 1.79 ms 453.59 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 5/s 77 KiB/s 101 KiB/s 1.84 ms 258.20 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 6/s 87 KiB/s 98 KiB/s 2.26 ms 324.23 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 94 KiB/s 87 KiB/s 1.95 ms 355.57 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 6/s 79 KiB/s 102 KiB/s 1.86 ms 282.70 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 6/s 78 KiB/s 129 KiB/s 1.80 ms 282.58 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 58 KiB/s 70 KiB/s 1.89 ms 302.69 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 5/s 95 KiB/s 90 KiB/s 2.06 ms 292.16 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 4/s 94 KiB/s 104 KiB/s 1.86 ms 429.84 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 2/s 90 KiB/s 52 KiB/s 1.86 ms 397.31 us 2024-03-25T09:29:25.018 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 6/s 75 KiB/s 104 KiB/s 1.87 ms 306.64 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 5/s 58 KiB/s 82 KiB/s 1.98 ms 319.58 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 6/s 66 KiB/s 120 KiB/s 1.90 ms 295.35 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 6/s 66 KiB/s 126 KiB/s 1.86 ms 360.01 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 6/s 64 KiB/s 102 KiB/s 2.07 ms 316.90 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 8/s 76 KiB/s 147 KiB/s 1.93 ms 320.20 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 5/s 85 KiB/s 134 KiB/s 2.24 ms 308.44 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 2/s 83 KiB/s 50 KiB/s 1.70 ms 220.45 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 5/s 69 KiB/s 122 KiB/s 1.99 ms 358.17 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 3/s 58 KiB/s 64 KiB/s 1.63 ms 272.23 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 2/s 3/s 32 KiB/s 71 KiB/s 1.94 ms 233.20 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 2/s 4/s 28 KiB/s 87 KiB/s 1.84 ms 304.11 us 2024-03-25T09:29:25.019 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:25.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:24 smithi019 ceph-mon[29386]: pgmap v609: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 533 op/s 2024-03-25T09:29:25.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:24 smithi059 ceph-mon[32732]: pgmap v609: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 533 op/s 2024-03-25T09:29:25.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:24 smithi040 ceph-mon[33094]: pgmap v609: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 533 op/s 2024-03-25T09:29:25.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:25.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:25.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:26.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:26.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:26.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:26.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:26.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:26.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:26.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:26.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:25 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 477 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:26.256 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:25 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:26.256 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:25 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:26.256 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:25 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:26.256 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:25 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:26.256 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:25 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:26.257 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:25 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:26.257 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:25 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:26.257 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:25 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 477 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:25 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:25 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:25 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:25 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:25 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:25 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:25 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:25 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 477 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:27.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:26 smithi019 ceph-mon[29386]: pgmap v610: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.6 MiB/s wr, 673 op/s 2024-03-25T09:29:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:26 smithi059 ceph-mon[32732]: pgmap v610: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.6 MiB/s wr, 673 op/s 2024-03-25T09:29:27.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:26 smithi040 ceph-mon[33094]: pgmap v610: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.6 MiB/s wr, 673 op/s 2024-03-25T09:29:27.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:27.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:27.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:28.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:27.804+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:28.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:28.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:28.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:29.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:28 smithi019 ceph-mon[29386]: pgmap v611: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 580 op/s 2024-03-25T09:29:29.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:28 smithi059 ceph-mon[32732]: pgmap v611: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 580 op/s 2024-03-25T09:29:29.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:28 smithi040 ceph-mon[33094]: pgmap v611: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 580 op/s 2024-03-25T09:29:29.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:29.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:29.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:29.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:29:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 170.0k 117.6k 0.0k 1.7M 1.1M 0.0k nvme2n1 2024-03-25T09:29:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 194.4k 117.2k 0.0k 1.9M 1.1M 0.0k nvme2n10 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 77.2k 88.0k 0.0k 772.0k 880.0k 0.0k nvme2n11 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 80.4k 80.4k 0.0k 804.0k 804.0k 0.0k nvme2n12 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 132.0k 166.0k 0.0k 1.3M 1.6M 0.0k nvme2n13 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 66.4k 120.0k 0.0k 664.0k 1.2M 0.0k nvme2n14 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 135.6k 126.4k 0.0k 1.3M 1.2M 0.0k nvme2n15 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 82.0k 160.0k 0.0k 820.0k 1.6M 0.0k nvme2n16 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 114.0k 111.6k 0.0k 1.1M 1.1M 0.0k nvme2n17 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 153.6k 110.8k 0.0k 1.5M 1.1M 0.0k nvme2n18 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 96.8k 114.0k 0.0k 968.0k 1.1M 0.0k nvme2n19 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 124.4k 134.0k 0.0k 1.2M 1.3M 0.0k nvme2n2 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 164.8k 156.0k 0.0k 1.6M 1.5M 0.0k nvme2n20 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 86.0k 136.8k 0.0k 860.0k 1.3M 0.0k nvme2n3 2024-03-25T09:29:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 134.0k 166.4k 0.0k 1.3M 1.6M 0.0k nvme2n4 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 116.0k 108.0k 0.0k 1.1M 1.1M 0.0k nvme2n5 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 122.8k 177.6k 0.0k 1.2M 1.7M 0.0k nvme2n6 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 152.8k 166.8k 0.0k 1.5M 1.6M 0.0k nvme2n7 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 124.8k 139.6k 0.0k 1.2M 1.4M 0.0k nvme2n8 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 104.8k 152.8k 0.0k 1.0M 1.5M 0.0k nvme2n9 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 168.4k 175.2k 0.0k 1.6M 1.7M 0.0k nvme5n1 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 101.2k 133.2k 0.0k 1012.0k 1.3M 0.0k nvme5n10 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 122.8k 142.0k 0.0k 1.2M 1.4M 0.0k nvme5n11 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 74.0k 94.8k 0.0k 740.0k 948.0k 0.0k nvme5n12 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 123.6k 64.8k 0.0k 1.2M 648.0k 0.0k nvme5n13 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 87.2k 79.2k 0.0k 872.0k 792.0k 0.0k nvme5n14 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 95.2k 66.8k 0.0k 952.0k 668.0k 0.0k nvme5n15 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 164.4k 122.4k 0.0k 1.6M 1.2M 0.0k nvme5n16 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 153.2k 140.8k 0.0k 1.5M 1.4M 0.0k nvme5n17 2024-03-25T09:29:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 102.4k 80.4k 0.0k 1.0M 804.0k 0.0k nvme5n18 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 115.6k 106.0k 0.0k 1.1M 1.0M 0.0k nvme5n19 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 149.6k 134.4k 0.0k 1.5M 1.3M 0.0k nvme5n2 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 94.8k 91.2k 0.0k 948.0k 912.0k 0.0k nvme5n20 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 83.6k 74.4k 0.0k 836.0k 744.0k 0.0k nvme5n3 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 106.8k 74.4k 0.0k 1.0M 744.0k 0.0k nvme5n4 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 120.8k 152.0k 0.0k 1.2M 1.5M 0.0k nvme5n5 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 82.4k 83.2k 0.0k 824.0k 832.0k 0.0k nvme5n6 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 145.6k 140.4k 0.0k 1.4M 1.4M 0.0k nvme5n7 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 103.6k 79.2k 0.0k 1.0M 792.0k 0.0k nvme5n8 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 160.0k 138.0k 0.0k 1.6M 1.3M 0.0k nvme5n9 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 97.6k 127.2k 0.0k 976.0k 1.2M 0.0k nvme8n1 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 118.0k 165.6k 0.0k 1.2M 1.6M 0.0k nvme8n10 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 148.8k 109.2k 0.0k 1.5M 1.1M 0.0k nvme8n11 2024-03-25T09:29:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 139.6k 120.0k 0.0k 1.4M 1.2M 0.0k nvme8n12 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 78.4k 86.0k 0.0k 784.0k 860.0k 0.0k nvme8n13 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 150.8k 146.0k 0.0k 1.5M 1.4M 0.0k nvme8n14 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 93.6k 71.6k 0.0k 936.0k 716.0k 0.0k nvme8n15 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 135.2k 163.6k 0.0k 1.3M 1.6M 0.0k nvme8n16 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 78.4k 124.8k 0.0k 784.0k 1.2M 0.0k nvme8n17 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 91.2k 91.6k 0.0k 912.0k 916.0k 0.0k nvme8n18 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 99.2k 124.0k 0.0k 992.0k 1.2M 0.0k nvme8n19 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 156.4k 125.6k 0.0k 1.5M 1.2M 0.0k nvme8n2 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 120.4k 156.0k 0.0k 1.2M 1.5M 0.0k nvme8n20 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 106.0k 78.4k 0.0k 1.0M 784.0k 0.0k nvme8n3 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 98.8k 82.4k 0.0k 988.0k 824.0k 0.0k nvme8n4 2024-03-25T09:29:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.70 64.0k 127.2k 0.0k 640.0k 1.2M 0.0k nvme8n5 2024-03-25T09:29:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 138.4k 140.4k 0.0k 1.4M 1.4M 0.0k nvme8n6 2024-03-25T09:29:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 120.4k 140.8k 0.0k 1.2M 1.4M 0.0k nvme8n7 2024-03-25T09:29:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 126.0k 129.6k 0.0k 1.2M 1.3M 0.0k nvme8n8 2024-03-25T09:29:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 73.6k 92.4k 0.0k 736.0k 924.0k 0.0k nvme8n9 2024-03-25T09:29:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:30.020 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:30.020 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 7/s 5/s 170 KiB/s 117 KiB/s 1.95 ms 349.44 us 2024-03-25T09:29:30.020 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 7/s 6/s 134 KiB/s 138 KiB/s 2.07 ms 350.23 us 2024-03-25T09:29:30.020 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 5/s 178 KiB/s 121 KiB/s 1.95 ms 303.55 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 7/s 4/s 150 KiB/s 75 KiB/s 2.04 ms 352.97 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 4/s 139 KiB/s 127 KiB/s 1.64 ms 337.96 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 6/s 106 KiB/s 120 KiB/s 2.11 ms 337.19 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 5/s 94 KiB/s 95 KiB/s 1.87 ms 327.96 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 6/s 4/s 162 KiB/s 118 KiB/s 2.03 ms 329.69 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 6/s 4/s 178 KiB/s 148 KiB/s 2.48 ms 347.31 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 5/s 124 KiB/s 136 KiB/s 2.12 ms 324.37 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 5/s 102 KiB/s 78 KiB/s 2.08 ms 345.65 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 6/s 4/s 219 KiB/s 140 KiB/s 2.25 ms 347.07 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 3/s 193 KiB/s 116 KiB/s 2.05 ms 425.37 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 4/s 201 KiB/s 110 KiB/s 2.11 ms 308.75 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 3/s 102 KiB/s 65 KiB/s 2.21 ms 336.55 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 2/s 109 KiB/s 49 KiB/s 2.11 ms 328.24 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 2/s 167 KiB/s 80 KiB/s 2.07 ms 348.72 us 2024-03-25T09:29:30.021 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 4/s 203 KiB/s 153 KiB/s 1.79 ms 404.19 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 4/s 142 KiB/s 156 KiB/s 2.07 ms 301.02 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 4/s 112 KiB/s 82 KiB/s 1.87 ms 341.94 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 5/s 130 KiB/s 129 KiB/s 1.95 ms 397.77 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 5/s 130 KiB/s 92 KiB/s 1.99 ms 312.20 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 3/s 182 KiB/s 133 KiB/s 1.80 ms 329.44 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 5/s 140 KiB/s 180 KiB/s 2.01 ms 345.18 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 3/s 130 KiB/s 71 KiB/s 2.04 ms 288.47 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 4/s 148 KiB/s 117 KiB/s 1.80 ms 296.91 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 174 KiB/s 147 KiB/s 1.85 ms 389.35 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 112 KiB/s 120 KiB/s 1.92 ms 333.75 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 4/s 178 KiB/s 128 KiB/s 1.87 ms 385.86 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 6/s 81 KiB/s 99 KiB/s 2.02 ms 314.51 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 4/s 137 KiB/s 152 KiB/s 1.88 ms 435.55 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 5/s 137 KiB/s 115 KiB/s 1.95 ms 332.88 us 2024-03-25T09:29:30.022 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 4/s 142 KiB/s 123 KiB/s 1.83 ms 425.69 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 4/s 85 KiB/s 79 KiB/s 1.99 ms 350.66 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 4/s 148 KiB/s 128 KiB/s 1.87 ms 296.67 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 4/s 96 KiB/s 90 KiB/s 1.80 ms 381.65 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 4/s 102 KiB/s 75 KiB/s 2.11 ms 354.30 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 163 KiB/s 146 KiB/s 2.00 ms 321.87 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 96 KiB/s 78 KiB/s 2.17 ms 280.73 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 141 KiB/s 129 KiB/s 2.29 ms 332.91 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 5/s 150 KiB/s 158 KiB/s 2.11 ms 303.68 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 86 KiB/s 66 KiB/s 1.96 ms 314.08 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 3/s 59 KiB/s 82 KiB/s 2.45 ms 318.14 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 150 KiB/s 110 KiB/s 2.06 ms 286.65 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 6/s 90 KiB/s 97 KiB/s 1.91 ms 284.09 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 5/s 118 KiB/s 149 KiB/s 1.88 ms 334.05 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 5/s 100 KiB/s 180 KiB/s 2.38 ms 372.50 us 2024-03-25T09:29:30.023 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 5/s 68 KiB/s 118 KiB/s 1.89 ms 328.70 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 5/s 126 KiB/s 154 KiB/s 1.67 ms 302.70 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 85 KiB/s 74 KiB/s 1.89 ms 321.54 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 6/s 76 KiB/s 112 KiB/s 2.23 ms 366.94 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 6/s 118 KiB/s 230 KiB/s 2.12 ms 387.87 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 3/s 126 KiB/s 108 KiB/s 2.09 ms 337.13 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 3/s 89 KiB/s 78 KiB/s 1.96 ms 405.29 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 6/s 64 KiB/s 118 KiB/s 1.90 ms 328.73 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 5/s 52 KiB/s 115 KiB/s 1.93 ms 300.46 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 5/s 86 KiB/s 129 KiB/s 2.07 ms 364.57 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 56 KiB/s 70 KiB/s 1.89 ms 282.47 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 4/s 58 KiB/s 67 KiB/s 1.85 ms 315.20 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 4/s 42 KiB/s 90 KiB/s 2.10 ms 350.29 us 2024-03-25T09:29:30.024 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:30.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:30.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:30.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:31.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:30 smithi019 ceph-mon[29386]: pgmap v612: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.1 MiB/s wr, 569 op/s 2024-03-25T09:29:31.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:30 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:31.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:30 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:31.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:30 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:31.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:30 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:31.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:30 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:30 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:30 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:31.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:30 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 482 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:30 smithi059 ceph-mon[32732]: pgmap v612: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.1 MiB/s wr, 569 op/s 2024-03-25T09:29:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:30 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:30 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:30 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:30 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:30 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:30 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:30 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:30 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 482 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-mon[33094]: pgmap v612: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.1 MiB/s wr, 569 op/s 2024-03-25T09:29:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:30 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 482 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:31.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:31.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:31.661 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:32.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:32.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:32.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:33.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:32 smithi019 ceph-mon[29386]: pgmap v613: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.4 MiB/s wr, 635 op/s 2024-03-25T09:29:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:32 smithi059 ceph-mon[32732]: pgmap v613: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.4 MiB/s wr, 635 op/s 2024-03-25T09:29:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:32.805+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:33.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:32 smithi040 ceph-mon[33094]: pgmap v613: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.4 MiB/s wr, 635 op/s 2024-03-25T09:29:33.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:33.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:33.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:34.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:35.024 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 7/s 3/s 188 KiB/s 90 KiB/s 2.06 ms 350.54 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 6/s 3/s 168 KiB/s 82 KiB/s 2.00 ms 306.28 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 6/s 3/s 230 KiB/s 102 KiB/s 2.27 ms 357.26 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 5/s 146 KiB/s 118 KiB/s 1.99 ms 311.19 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 3/s 184 KiB/s 112 KiB/s 2.09 ms 325.20 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 6/s 3/s 219 KiB/s 123 KiB/s 2.28 ms 354.26 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 6/s 4/s 154 KiB/s 130 KiB/s 2.02 ms 442.02 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 4/s 164 KiB/s 131 KiB/s 2.08 ms 301.86 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 3/s 224 KiB/s 98 KiB/s 2.13 ms 375.74 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 4/s 86 KiB/s 80 KiB/s 1.88 ms 328.88 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 5/s 139 KiB/s 106 KiB/s 2.35 ms 362.76 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 3/s 180 KiB/s 126 KiB/s 1.85 ms 481.32 us 2024-03-25T09:29:35.025 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 5/s 106 KiB/s 98 KiB/s 2.17 ms 300.07 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 5/s 198 KiB/s 195 KiB/s 1.83 ms 338.33 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 3/s 92 KiB/s 94 KiB/s 1.91 ms 326.91 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 5/s 107 KiB/s 106 KiB/s 1.78 ms 322.63 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 4/s 212 KiB/s 113 KiB/s 1.88 ms 312.44 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 143 KiB/s 134 KiB/s 2.07 ms 363.11 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 5/s 180 KiB/s 167 KiB/s 2.13 ms 348.75 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 5/s 78 KiB/s 98 KiB/s 1.92 ms 391.43 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 4/s 136 KiB/s 121 KiB/s 1.85 ms 343.39 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 4/s 174 KiB/s 106 KiB/s 2.10 ms 256.28 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 5/s 150 KiB/s 164 KiB/s 1.80 ms 381.37 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 5/s 166 KiB/s 168 KiB/s 1.90 ms 348.33 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 5/s 148 KiB/s 162 KiB/s 2.10 ms 314.62 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 5/s 96 KiB/s 136 KiB/s 2.25 ms 443.43 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 3/s 134 KiB/s 106 KiB/s 1.90 ms 309.76 us 2024-03-25T09:29:35.026 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 155 KiB/s 120 KiB/s 1.66 ms 300.94 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 156 KiB/s 114 KiB/s 2.20 ms 293.59 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 160 KiB/s 191 KiB/s 2.01 ms 460.73 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 5/s 154 KiB/s 194 KiB/s 2.06 ms 355.43 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 144 KiB/s 130 KiB/s 2.28 ms 355.42 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 142 KiB/s 154 KiB/s 2.14 ms 332.43 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 4/s 158 KiB/s 130 KiB/s 2.00 ms 347.38 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 155 KiB/s 136 KiB/s 1.91 ms 318.98 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 104 KiB/s 86 KiB/s 2.13 ms 354.38 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 5/s 125 KiB/s 148 KiB/s 1.97 ms 421.77 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 158 KiB/s 190 KiB/s 2.05 ms 318.68 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 4/s 104 KiB/s 138 KiB/s 1.98 ms 336.03 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 72 KiB/s 82 KiB/s 1.97 ms 309.87 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 5/s 98 KiB/s 150 KiB/s 1.89 ms 377.63 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 82 KiB/s 86 KiB/s 2.15 ms 322.96 us 2024-03-25T09:29:35.027 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 5/s 103 KiB/s 120 KiB/s 1.82 ms 394.87 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 5/s 149 KiB/s 166 KiB/s 2.17 ms 311.38 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 121 KiB/s 153 KiB/s 2.41 ms 430.25 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 5/s 133 KiB/s 155 KiB/s 1.84 ms 302.87 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 87 KiB/s 103 KiB/s 1.80 ms 368.70 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 6/s 145 KiB/s 203 KiB/s 1.94 ms 372.26 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 5/s 69 KiB/s 80 KiB/s 1.81 ms 298.71 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 106 KiB/s 154 KiB/s 2.29 ms 395.44 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 119 KiB/s 170 KiB/s 1.93 ms 364.10 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 5/s 125 KiB/s 141 KiB/s 2.33 ms 437.47 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 110 KiB/s 158 KiB/s 1.86 ms 335.73 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 6/s 125 KiB/s 221 KiB/s 1.92 ms 414.79 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 5/s 132 KiB/s 178 KiB/s 2.06 ms 373.60 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 54 KiB/s 82 KiB/s 2.11 ms 342.62 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 5/s 82 KiB/s 146 KiB/s 2.47 ms 342.31 us 2024-03-25T09:29:35.028 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 5/s 92 KiB/s 142 KiB/s 2.22 ms 405.14 us 2024-03-25T09:29:35.029 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 2/s 6/s 75 KiB/s 178 KiB/s 1.92 ms 348.32 us 2024-03-25T09:29:35.029 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 1/s 3/s 21 KiB/s 82 KiB/s 2.37 ms 314.09 us 2024-03-25T09:29:35.029 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:35.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:34 smithi019 ceph-mon[29386]: pgmap v614: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 506 op/s 2024-03-25T09:29:35.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:34 smithi059 ceph-mon[32732]: pgmap v614: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 506 op/s 2024-03-25T09:29:35.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:34 smithi040 ceph-mon[33094]: pgmap v614: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 506 op/s 2024-03-25T09:29:35.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:35.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:35.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:35 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 487 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:35 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:35 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:35 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:35 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:35 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:35 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:35 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:35 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 487 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:35 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:35 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:35 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:35 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:36.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:35 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:36.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:35 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:36.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:35 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:36.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:35 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 487 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:36.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:36.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:36.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:36 smithi019 ceph-mon[29386]: pgmap v615: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.3 MiB/s wr, 642 op/s 2024-03-25T09:29:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:29:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:29:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:29:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:29:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:36 smithi059 ceph-mon[32732]: pgmap v615: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.3 MiB/s wr, 642 op/s 2024-03-25T09:29:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:29:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:29:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:29:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:29:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:36 smithi040 ceph-mon[33094]: pgmap v615: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.3 MiB/s wr, 642 op/s 2024-03-25T09:29:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:29:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:29:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:29:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:29:37.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:37.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:37.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:38.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:37 smithi019 ceph-mon[29386]: pgmap v616: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 8.0 MiB/s wr, 575 op/s 2024-03-25T09:29:38.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:37 smithi019 ceph-mon[29386]: pgmap v617: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.6 MiB/s wr, 599 op/s 2024-03-25T09:29:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:37 smithi059 ceph-mon[32732]: pgmap v616: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 8.0 MiB/s wr, 575 op/s 2024-03-25T09:29:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:37 smithi059 ceph-mon[32732]: pgmap v617: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.6 MiB/s wr, 599 op/s 2024-03-25T09:29:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:37.805+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:38.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:37 smithi040 ceph-mon[33094]: pgmap v616: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 8.0 MiB/s wr, 575 op/s 2024-03-25T09:29:38.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:37 smithi040 ceph-mon[33094]: pgmap v617: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.6 MiB/s wr, 599 op/s 2024-03-25T09:29:38.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:38.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:38.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:39.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:39.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:39.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:39.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:29:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 131.6k 146.8k 0.0k 1.3M 1.4M 0.0k nvme2n1 2024-03-25T09:29:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 124.0k 153.2k 0.0k 1.2M 1.5M 0.0k nvme2n10 2024-03-25T09:29:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 99.2k 142.4k 0.0k 992.0k 1.4M 0.0k nvme2n11 2024-03-25T09:29:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 158.0k 115.6k 0.0k 1.5M 1.1M 0.0k nvme2n12 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 112.0k 167.6k 0.0k 1.1M 1.6M 0.0k nvme2n13 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 162.4k 144.4k 0.0k 1.6M 1.4M 0.0k nvme2n14 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 148.0k 135.6k 0.0k 1.4M 1.3M 0.0k nvme2n15 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 152.8k 125.6k 0.0k 1.5M 1.2M 0.0k nvme2n16 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 145.2k 124.8k 0.0k 1.4M 1.2M 0.0k nvme2n17 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 114.4k 161.2k 0.0k 1.1M 1.6M 0.0k nvme2n18 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 149.2k 163.6k 0.0k 1.5M 1.6M 0.0k nvme2n19 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 153.6k 136.4k 0.0k 1.5M 1.3M 0.0k nvme2n2 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 126.0k 142.4k 0.0k 1.2M 1.4M 0.0k nvme2n20 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 121.6k 177.6k 0.0k 1.2M 1.7M 0.0k nvme2n3 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 161.2k 155.6k 0.0k 1.6M 1.5M 0.0k nvme2n4 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 143.6k 176.0k 0.0k 1.4M 1.7M 0.0k nvme2n5 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 121.6k 164.8k 0.0k 1.2M 1.6M 0.0k nvme2n6 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 142.8k 162.8k 0.0k 1.4M 1.6M 0.0k nvme2n7 2024-03-25T09:29:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 124.4k 153.2k 0.0k 1.2M 1.5M 0.0k nvme2n8 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 167.6k 126.4k 0.0k 1.6M 1.2M 0.0k nvme2n9 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 119.6k 158.4k 0.0k 1.2M 1.5M 0.0k nvme5n1 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 133.6k 162.8k 0.0k 1.3M 1.6M 0.0k nvme5n10 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 164.0k 136.0k 0.0k 1.6M 1.3M 0.0k nvme5n11 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 155.2k 106.4k 0.0k 1.5M 1.0M 0.0k nvme5n12 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 209.2k 98.8k 0.0k 2.0M 988.0k 0.0k nvme5n13 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 118.0k 133.2k 0.0k 1.2M 1.3M 0.0k nvme5n14 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 149.6k 120.8k 0.0k 1.5M 1.2M 0.0k nvme5n15 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 138.0k 139.6k 0.0k 1.3M 1.4M 0.0k nvme5n16 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 132.8k 183.6k 0.0k 1.3M 1.8M 0.0k nvme5n17 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 169.2k 152.4k 0.0k 1.7M 1.5M 0.0k nvme5n18 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 158.8k 114.8k 0.0k 1.6M 1.1M 0.0k nvme5n19 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 152.8k 131.6k 0.0k 1.5M 1.3M 0.0k nvme5n2 2024-03-25T09:29:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 151.6k 162.8k 0.0k 1.5M 1.6M 0.0k nvme5n20 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 149.2k 120.8k 0.0k 1.5M 1.2M 0.0k nvme5n3 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 128.0k 120.0k 0.0k 1.2M 1.2M 0.0k nvme5n4 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 158.0k 117.2k 0.0k 1.5M 1.1M 0.0k nvme5n5 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 161.2k 157.6k 0.0k 1.6M 1.5M 0.0k nvme5n6 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 175.6k 106.8k 0.0k 1.7M 1.0M 0.0k nvme5n7 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 139.2k 180.4k 0.0k 1.4M 1.8M 0.0k nvme5n8 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 131.2k 135.2k 0.0k 1.3M 1.3M 0.0k nvme5n9 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 142.4k 130.0k 0.0k 1.4M 1.3M 0.0k nvme8n1 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 136.4k 109.6k 0.0k 1.3M 1.1M 0.0k nvme8n10 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 171.2k 139.6k 0.0k 1.7M 1.4M 0.0k nvme8n11 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 131.6k 132.8k 0.0k 1.3M 1.3M 0.0k nvme8n12 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 137.6k 132.4k 0.0k 1.3M 1.3M 0.0k nvme8n13 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 176.0k 135.2k 0.0k 1.7M 1.3M 0.0k nvme8n14 2024-03-25T09:29:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 115.6k 135.6k 0.0k 1.1M 1.3M 0.0k nvme8n15 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 164.8k 108.0k 0.0k 1.6M 1.1M 0.0k nvme8n16 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 120.0k 146.0k 0.0k 1.2M 1.4M 0.0k nvme8n17 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 171.6k 137.6k 0.0k 1.7M 1.3M 0.0k nvme8n18 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 145.6k 128.4k 0.0k 1.4M 1.3M 0.0k nvme8n19 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 132.8k 144.0k 0.0k 1.3M 1.4M 0.0k nvme8n2 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 113.6k 156.0k 0.0k 1.1M 1.5M 0.0k nvme8n20 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 126.4k 139.2k 0.0k 1.2M 1.4M 0.0k nvme8n3 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 182.4k 118.0k 0.0k 1.8M 1.2M 0.0k nvme8n4 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 140.0k 180.4k 0.0k 1.4M 1.8M 0.0k nvme8n5 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 138.8k 162.4k 0.0k 1.4M 1.6M 0.0k nvme8n6 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 128.0k 173.6k 0.0k 1.2M 1.7M 0.0k nvme8n7 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 185.6k 120.8k 0.0k 1.8M 1.2M 0.0k nvme8n8 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 137.2k 156.8k 0.0k 1.3M 1.5M 0.0k nvme8n9 2024-03-25T09:29:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:40.029 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:40.029 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 7/s 3/s 187 KiB/s 90 KiB/s 2.00 ms 360.42 us 2024-03-25T09:29:40.029 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 3/s 188 KiB/s 104 KiB/s 1.87 ms 297.92 us 2024-03-25T09:29:40.029 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 4/s 174 KiB/s 134 KiB/s 2.04 ms 403.79 us 2024-03-25T09:29:40.029 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 6/s 3/s 225 KiB/s 120 KiB/s 2.14 ms 434.93 us 2024-03-25T09:29:40.029 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 4/s 166 KiB/s 150 KiB/s 2.13 ms 497.60 us 2024-03-25T09:29:40.029 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 4/s 166 KiB/s 125 KiB/s 2.30 ms 323.95 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 4/s 199 KiB/s 154 KiB/s 2.07 ms 359.81 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 173 KiB/s 138 KiB/s 2.00 ms 347.86 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 3/s 134 KiB/s 103 KiB/s 2.09 ms 310.53 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 4/s 134 KiB/s 136 KiB/s 1.85 ms 326.32 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 3/s 164 KiB/s 92 KiB/s 1.98 ms 337.15 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 3/s 158 KiB/s 99 KiB/s 2.09 ms 280.89 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 3/s 160 KiB/s 84 KiB/s 1.98 ms 319.41 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 4/s 181 KiB/s 142 KiB/s 2.01 ms 362.25 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 4/s 155 KiB/s 146 KiB/s 1.96 ms 312.13 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 4/s 182 KiB/s 147 KiB/s 2.06 ms 471.76 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 4/s 166 KiB/s 143 KiB/s 2.02 ms 326.56 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 5/s 175 KiB/s 154 KiB/s 1.86 ms 319.20 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 153 KiB/s 124 KiB/s 2.02 ms 291.67 us 2024-03-25T09:29:40.030 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 4/s 151 KiB/s 134 KiB/s 1.97 ms 318.89 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 4/s 154 KiB/s 145 KiB/s 2.10 ms 390.04 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 6/s 178 KiB/s 175 KiB/s 2.34 ms 313.78 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 5/s 114 KiB/s 166 KiB/s 2.17 ms 387.14 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 5/s 116 KiB/s 130 KiB/s 2.03 ms 342.97 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 3/s 158 KiB/s 115 KiB/s 2.29 ms 381.44 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 4/s 148 KiB/s 150 KiB/s 2.20 ms 392.59 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 5/s 151 KiB/s 146 KiB/s 2.17 ms 351.86 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 4/s 137 KiB/s 146 KiB/s 2.10 ms 257.08 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 3/s 132 KiB/s 102 KiB/s 1.96 ms 339.71 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 114 KiB/s 163 KiB/s 2.23 ms 309.22 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 118 KiB/s 131 KiB/s 1.79 ms 329.45 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 170 KiB/s 203 KiB/s 2.36 ms 417.37 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 148 KiB/s 154 KiB/s 1.94 ms 351.17 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 3/s 181 KiB/s 99 KiB/s 2.01 ms 312.32 us 2024-03-25T09:29:40.031 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 5/s 147 KiB/s 179 KiB/s 2.05 ms 324.49 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 5/s 143 KiB/s 153 KiB/s 2.18 ms 283.56 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 148 KiB/s 125 KiB/s 2.29 ms 384.55 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 132 KiB/s 91 KiB/s 1.93 ms 337.98 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 5/s 122 KiB/s 183 KiB/s 2.05 ms 367.34 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 5/s 154 KiB/s 126 KiB/s 1.91 ms 300.57 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 5/s 152 KiB/s 139 KiB/s 2.02 ms 407.61 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 5/s 122 KiB/s 149 KiB/s 1.92 ms 330.82 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 151 KiB/s 159 KiB/s 2.13 ms 335.73 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 5/s 105 KiB/s 175 KiB/s 2.22 ms 359.24 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 111 KiB/s 142 KiB/s 2.50 ms 380.00 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 5/s 108 KiB/s 161 KiB/s 1.90 ms 412.77 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 4/s 137 KiB/s 160 KiB/s 1.92 ms 333.26 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 5/s 152 KiB/s 166 KiB/s 2.23 ms 330.67 us 2024-03-25T09:29:40.032 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 5/s 111 KiB/s 197 KiB/s 2.66 ms 369.04 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 5/s 161 KiB/s 152 KiB/s 1.99 ms 301.19 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 5/s 151 KiB/s 96 KiB/s 1.96 ms 286.74 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 158 KiB/s 154 KiB/s 2.12 ms 311.44 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 4/s 131 KiB/s 129 KiB/s 2.15 ms 291.84 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 5/s 134 KiB/s 165 KiB/s 2.12 ms 312.03 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 5/s 151 KiB/s 171 KiB/s 2.06 ms 427.32 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 5/s 99 KiB/s 132 KiB/s 2.00 ms 392.76 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 5/s 151 KiB/s 176 KiB/s 2.09 ms 305.03 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 131 KiB/s 184 KiB/s 2.39 ms 436.93 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 123 KiB/s 149 KiB/s 2.47 ms 377.73 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 7/s 95 KiB/s 259 KiB/s 1.94 ms 405.62 us 2024-03-25T09:29:40.033 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:40.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:39 smithi019 ceph-mon[29386]: pgmap v618: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.6 MiB/s rd, 7.8 MiB/s wr, 542 op/s 2024-03-25T09:29:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:39 smithi059 ceph-mon[32732]: pgmap v618: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.6 MiB/s rd, 7.8 MiB/s wr, 542 op/s 2024-03-25T09:29:40.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:39 smithi040 ceph-mon[33094]: pgmap v618: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.6 MiB/s rd, 7.8 MiB/s wr, 542 op/s 2024-03-25T09:29:40.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:40.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:40.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:41.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:40 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:41.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:40 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:41.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:40 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:41.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:40 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:41.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:40 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:41.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:40 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:41.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:40 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:41.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:40 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 492 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:40 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:40 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:40 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:40 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:40 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:40 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:40 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:40 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 492 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:40 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 492 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:41.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:41.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:41.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:42.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:41 smithi019 ceph-mon[29386]: pgmap v619: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.2 MiB/s wr, 562 op/s 2024-03-25T09:29:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:41 smithi059 ceph-mon[32732]: pgmap v619: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.2 MiB/s wr, 562 op/s 2024-03-25T09:29:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:41 smithi040 ceph-mon[33094]: pgmap v619: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.2 MiB/s wr, 562 op/s 2024-03-25T09:29:42.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:42.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:42.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:43.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:42.805+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:43.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:43.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:43.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:43 smithi019 ceph-mon[29386]: pgmap v620: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 9.3 MiB/s wr, 635 op/s 2024-03-25T09:29:44.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:43 smithi059 ceph-mon[32732]: pgmap v620: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 9.3 MiB/s wr, 635 op/s 2024-03-25T09:29:44.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:43 smithi040 ceph-mon[33094]: pgmap v620: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 9.3 MiB/s wr, 635 op/s 2024-03-25T09:29:44.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:44.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:44.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:45.033 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:45.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 6/s 4/s 130 KiB/s 178 KiB/s 1.95 ms 369.28 us 2024-03-25T09:29:45.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 3/s 155 KiB/s 92 KiB/s 1.80 ms 323.17 us 2024-03-25T09:29:45.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 5/s 133 KiB/s 154 KiB/s 1.91 ms 390.53 us 2024-03-25T09:29:45.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 3/s 207 KiB/s 106 KiB/s 2.23 ms 440.00 us 2024-03-25T09:29:45.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 6/s 4/s 169 KiB/s 143 KiB/s 2.42 ms 309.60 us 2024-03-25T09:29:45.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 3/s 153 KiB/s 124 KiB/s 1.94 ms 293.22 us 2024-03-25T09:29:45.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 3/s 148 KiB/s 128 KiB/s 2.28 ms 335.57 us 2024-03-25T09:29:45.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 4/s 123 KiB/s 130 KiB/s 2.21 ms 332.20 us 2024-03-25T09:29:45.033 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 4/s 164 KiB/s 126 KiB/s 1.89 ms 393.94 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 151 KiB/s 146 KiB/s 2.00 ms 433.71 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 3/s 159 KiB/s 100 KiB/s 2.11 ms 334.81 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 5/s 170 KiB/s 136 KiB/s 2.15 ms 348.61 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 3/s 198 KiB/s 118 KiB/s 1.99 ms 351.85 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 130 KiB/s 170 KiB/s 1.92 ms 323.64 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 4/s 178 KiB/s 115 KiB/s 2.28 ms 341.48 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 4/s 161 KiB/s 142 KiB/s 2.22 ms 347.57 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 5/s 152 KiB/s 124 KiB/s 2.08 ms 280.77 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 3/s 180 KiB/s 117 KiB/s 2.26 ms 610.08 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 4/s 161 KiB/s 122 KiB/s 1.92 ms 303.38 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 4/s 150 KiB/s 132 KiB/s 2.00 ms 373.04 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 3/s 171 KiB/s 110 KiB/s 2.21 ms 327.71 us 2024-03-25T09:29:45.034 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 4/s 139 KiB/s 140 KiB/s 2.11 ms 376.18 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 4/s 174 KiB/s 98 KiB/s 1.92 ms 377.50 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 121 KiB/s 140 KiB/s 2.22 ms 333.86 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 5/s 158 KiB/s 167 KiB/s 2.07 ms 331.10 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 122 KiB/s 122 KiB/s 2.05 ms 312.59 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 138 KiB/s 96 KiB/s 2.13 ms 386.70 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 4/s 128 KiB/s 161 KiB/s 1.89 ms 471.75 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 120 KiB/s 170 KiB/s 1.99 ms 367.66 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 5/s 159 KiB/s 135 KiB/s 1.96 ms 406.08 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 159 KiB/s 98 KiB/s 1.90 ms 422.15 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 128 KiB/s 94 KiB/s 2.08 ms 293.38 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 141 KiB/s 141 KiB/s 2.55 ms 313.61 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 123 KiB/s 145 KiB/s 2.24 ms 374.56 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 134 KiB/s 170 KiB/s 2.04 ms 386.32 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 4/s 114 KiB/s 131 KiB/s 2.02 ms 403.58 us 2024-03-25T09:29:45.035 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 132 KiB/s 150 KiB/s 2.02 ms 339.47 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 133 KiB/s 134 KiB/s 1.91 ms 379.85 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 5/s 91 KiB/s 165 KiB/s 1.91 ms 363.66 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 143 KiB/s 132 KiB/s 1.94 ms 400.26 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 4/s 121 KiB/s 138 KiB/s 2.13 ms 332.27 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 150 KiB/s 139 KiB/s 2.83 ms 400.52 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 5/s 124 KiB/s 147 KiB/s 2.32 ms 334.39 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 5/s 117 KiB/s 137 KiB/s 2.06 ms 335.25 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 5/s 121 KiB/s 159 KiB/s 2.01 ms 384.35 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 6/s 142 KiB/s 181 KiB/s 2.13 ms 404.06 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 5/s 119 KiB/s 158 KiB/s 1.85 ms 348.02 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 5/s 123 KiB/s 166 KiB/s 2.18 ms 354.49 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 138 KiB/s 140 KiB/s 2.02 ms 329.72 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 5/s 114 KiB/s 129 KiB/s 2.36 ms 422.37 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 5/s 110 KiB/s 174 KiB/s 1.98 ms 401.15 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 5/s 58 KiB/s 145 KiB/s 2.44 ms 369.03 us 2024-03-25T09:29:45.036 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 5/s 103 KiB/s 194 KiB/s 2.23 ms 350.90 us 2024-03-25T09:29:45.037 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 5/s 118 KiB/s 162 KiB/s 1.86 ms 358.39 us 2024-03-25T09:29:45.037 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 5/s 87 KiB/s 160 KiB/s 2.31 ms 370.74 us 2024-03-25T09:29:45.037 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 6/s 79 KiB/s 170 KiB/s 1.97 ms 438.48 us 2024-03-25T09:29:45.037 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 112 KiB/s 149 KiB/s 2.24 ms 346.94 us 2024-03-25T09:29:45.037 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 4/s 82 KiB/s 102 KiB/s 2.09 ms 314.24 us 2024-03-25T09:29:45.037 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 5/s 106 KiB/s 141 KiB/s 1.99 ms 305.27 us 2024-03-25T09:29:45.037 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 5/s 84 KiB/s 167 KiB/s 2.08 ms 344.97 us 2024-03-25T09:29:45.037 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:45.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:45.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:45.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:46.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-mon[29386]: pgmap v621: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.4 MiB/s wr, 516 op/s 2024-03-25T09:29:46.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:46.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:46.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:46.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:46.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:46.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:46.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:46.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:45 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 497 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:46.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:45 smithi059 ceph-mon[32732]: pgmap v621: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.4 MiB/s wr, 516 op/s 2024-03-25T09:29:46.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:45 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:46.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:45 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:46.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:45 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:46.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:45 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:46.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:45 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:46.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:45 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:46.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:45 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:46.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:45 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 497 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:45 smithi040 ceph-mon[33094]: pgmap v621: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.4 MiB/s wr, 516 op/s 2024-03-25T09:29:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:45 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:45 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:45 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:45 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:45 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:45 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:45 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:46.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:45 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 497 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:46.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:47.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:48.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:47 smithi019 ceph-mon[29386]: pgmap v622: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.0 MiB/s wr, 569 op/s 2024-03-25T09:29:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:47.806+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:47 smithi059 ceph-mon[32732]: pgmap v622: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.0 MiB/s wr, 569 op/s 2024-03-25T09:29:48.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:47 smithi040 ceph-mon[33094]: pgmap v622: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.0 MiB/s wr, 569 op/s 2024-03-25T09:29:48.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:48.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:48.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:49.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:29:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 116.0k 162.8k 0.0k 1.1M 1.6M 0.0k nvme2n1 2024-03-25T09:29:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 120.8k 162.4k 0.0k 1.2M 1.6M 0.0k nvme2n10 2024-03-25T09:29:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 149.2k 124.8k 0.0k 1.5M 1.2M 0.0k nvme2n11 2024-03-25T09:29:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 150.8k 114.0k 0.0k 1.5M 1.1M 0.0k nvme2n12 2024-03-25T09:29:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 97.6k 126.8k 0.0k 976.0k 1.2M 0.0k nvme2n13 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 145.2k 148.8k 0.0k 1.4M 1.5M 0.0k nvme2n14 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 129.6k 134.8k 0.0k 1.3M 1.3M 0.0k nvme2n15 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 126.0k 138.4k 0.0k 1.2M 1.4M 0.0k nvme2n16 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 145.2k 126.4k 0.0k 1.4M 1.2M 0.0k nvme2n17 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 126.0k 124.4k 0.0k 1.2M 1.2M 0.0k nvme2n18 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 135.2k 100.8k 0.0k 1.3M 1008.0k 0.0k nvme2n19 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 111.2k 139.2k 0.0k 1.1M 1.4M 0.0k nvme2n2 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 122.4k 129.2k 0.0k 1.2M 1.3M 0.0k nvme2n20 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 137.2k 134.0k 0.0k 1.3M 1.3M 0.0k nvme2n3 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 139.6k 119.6k 0.0k 1.4M 1.2M 0.0k nvme2n4 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 150.0k 138.0k 0.0k 1.5M 1.3M 0.0k nvme2n5 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 128.0k 118.0k 0.0k 1.2M 1.2M 0.0k nvme2n6 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 124.0k 134.4k 0.0k 1.2M 1.3M 0.0k nvme2n7 2024-03-25T09:29:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 139.6k 99.2k 0.0k 1.4M 992.0k 0.0k nvme2n8 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 119.2k 148.0k 0.0k 1.2M 1.4M 0.0k nvme2n9 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 124.0k 122.8k 0.0k 1.2M 1.2M 0.0k nvme5n1 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 142.8k 127.2k 0.0k 1.4M 1.2M 0.0k nvme5n10 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 122.8k 143.6k 0.0k 1.2M 1.4M 0.0k nvme5n11 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 153.6k 170.8k 0.0k 1.5M 1.7M 0.0k nvme5n12 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 140.0k 165.2k 0.0k 1.4M 1.6M 0.0k nvme5n13 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 150.0k 160.8k 0.0k 1.5M 1.6M 0.0k nvme5n14 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 139.2k 120.0k 0.0k 1.4M 1.2M 0.0k nvme5n15 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 131.2k 132.0k 0.0k 1.3M 1.3M 0.0k nvme5n16 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 148.8k 102.4k 0.0k 1.5M 1.0M 0.0k nvme5n17 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 162.0k 122.8k 0.0k 1.6M 1.2M 0.0k nvme5n18 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 127.6k 123.2k 0.0k 1.2M 1.2M 0.0k nvme5n19 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 140.0k 113.2k 0.0k 1.4M 1.1M 0.0k nvme5n2 2024-03-25T09:29:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 138.0k 135.2k 0.0k 1.3M 1.3M 0.0k nvme5n20 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 128.8k 158.8k 0.0k 1.3M 1.6M 0.0k nvme5n3 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 128.4k 132.8k 0.0k 1.3M 1.3M 0.0k nvme5n4 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 136.0k 144.0k 0.0k 1.3M 1.4M 0.0k nvme5n5 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 141.2k 105.6k 0.0k 1.4M 1.0M 0.0k nvme5n6 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 135.2k 145.6k 0.0k 1.3M 1.4M 0.0k nvme5n7 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 123.6k 165.6k 0.0k 1.2M 1.6M 0.0k nvme5n8 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 124.0k 112.4k 0.0k 1.2M 1.1M 0.0k nvme5n9 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 125.6k 125.6k 0.0k 1.2M 1.2M 0.0k nvme8n1 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 135.6k 108.8k 0.0k 1.3M 1.1M 0.0k nvme8n10 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 144.0k 125.6k 0.0k 1.4M 1.2M 0.0k nvme8n11 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 111.6k 144.8k 0.0k 1.1M 1.4M 0.0k nvme8n12 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 140.4k 125.6k 0.0k 1.4M 1.2M 0.0k nvme8n13 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 146.4k 104.8k 0.0k 1.4M 1.0M 0.0k nvme8n14 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 135.6k 146.0k 0.0k 1.3M 1.4M 0.0k nvme8n15 2024-03-25T09:29:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 130.0k 110.0k 0.0k 1.3M 1.1M 0.0k nvme8n16 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 105.2k 173.6k 0.0k 1.0M 1.7M 0.0k nvme8n17 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 140.0k 123.6k 0.0k 1.4M 1.2M 0.0k nvme8n18 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 156.4k 109.6k 0.0k 1.5M 1.1M 0.0k nvme8n19 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 137.6k 140.4k 0.0k 1.3M 1.4M 0.0k nvme8n2 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.60 105.6k 137.2k 0.0k 1.0M 1.3M 0.0k nvme8n20 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 145.2k 126.0k 0.0k 1.4M 1.2M 0.0k nvme8n3 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 122.0k 112.4k 0.0k 1.2M 1.1M 0.0k nvme8n4 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 144.4k 153.2k 0.0k 1.4M 1.5M 0.0k nvme8n5 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 140.4k 132.4k 0.0k 1.4M 1.3M 0.0k nvme8n6 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 151.2k 124.8k 0.0k 1.5M 1.2M 0.0k nvme8n7 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 123.6k 126.0k 0.0k 1.2M 1.2M 0.0k nvme8n8 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.50 148.8k 102.8k 0.0k 1.5M 1.0M 0.0k nvme8n9 2024-03-25T09:29:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:49.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:49.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:49.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:50.037 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:50.037 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 7/s 4/s 206 KiB/s 124 KiB/s 1.99 ms 293.27 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 6/s 3/s 210 KiB/s 115 KiB/s 2.04 ms 372.62 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 3/s 135 KiB/s 82 KiB/s 1.90 ms 321.63 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 138 KiB/s 128 KiB/s 2.13 ms 280.35 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 4/s 149 KiB/s 92 KiB/s 2.21 ms 314.13 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 190 KiB/s 161 KiB/s 2.02 ms 407.00 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 4/s 165 KiB/s 142 KiB/s 2.13 ms 399.52 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 4/s 175 KiB/s 149 KiB/s 2.16 ms 339.62 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 5/s 154 KiB/s 182 KiB/s 1.85 ms 340.97 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 4/s 130 KiB/s 126 KiB/s 2.72 ms 376.26 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 3/s 151 KiB/s 93 KiB/s 2.41 ms 301.97 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 5/s 154 KiB/s 129 KiB/s 2.02 ms 280.02 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 4/s 130 KiB/s 120 KiB/s 2.35 ms 333.61 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 4/s 156 KiB/s 125 KiB/s 2.54 ms 461.70 us 2024-03-25T09:29:50.038 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 5/s 148 KiB/s 142 KiB/s 1.97 ms 299.78 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 5/s 154 KiB/s 152 KiB/s 2.34 ms 442.30 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 4/s 142 KiB/s 112 KiB/s 1.81 ms 352.94 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 4/s 129 KiB/s 158 KiB/s 1.82 ms 304.55 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 4/s 158 KiB/s 148 KiB/s 2.11 ms 302.70 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 140 KiB/s 158 KiB/s 2.10 ms 348.97 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 5/s 150 KiB/s 154 KiB/s 2.13 ms 361.51 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 3/s 123 KiB/s 63 KiB/s 1.89 ms 325.60 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 2/s 113 KiB/s 78 KiB/s 1.76 ms 328.17 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 4/s 166 KiB/s 150 KiB/s 2.14 ms 411.06 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 6/s 134 KiB/s 182 KiB/s 2.02 ms 321.37 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 5/s 137 KiB/s 146 KiB/s 2.08 ms 377.38 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 132 KiB/s 116 KiB/s 2.02 ms 435.75 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 3/s 117 KiB/s 76 KiB/s 1.94 ms 330.34 us 2024-03-25T09:29:50.039 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 5/s 181 KiB/s 119 KiB/s 1.79 ms 486.57 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 6/s 133 KiB/s 194 KiB/s 2.02 ms 358.02 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 142 KiB/s 128 KiB/s 2.08 ms 393.93 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 149 KiB/s 149 KiB/s 2.00 ms 306.17 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 146 KiB/s 105 KiB/s 1.98 ms 309.14 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 133 KiB/s 116 KiB/s 2.20 ms 399.91 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 5/s 122 KiB/s 154 KiB/s 2.23 ms 371.78 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 5/s 104 KiB/s 114 KiB/s 2.04 ms 298.68 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 6/s 121 KiB/s 155 KiB/s 1.96 ms 346.56 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 4/s 117 KiB/s 138 KiB/s 1.96 ms 325.87 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 122 KiB/s 124 KiB/s 2.19 ms 291.36 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 6/s 120 KiB/s 167 KiB/s 2.23 ms 348.34 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 4/s 123 KiB/s 95 KiB/s 2.03 ms 313.37 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 5/s 129 KiB/s 166 KiB/s 2.18 ms 386.30 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 146 KiB/s 150 KiB/s 2.22 ms 365.20 us 2024-03-25T09:29:50.040 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 127 KiB/s 150 KiB/s 2.15 ms 350.79 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 135 KiB/s 134 KiB/s 2.11 ms 327.94 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 6/s 102 KiB/s 164 KiB/s 2.30 ms 394.79 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 6/s 121 KiB/s 156 KiB/s 1.89 ms 330.36 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 98 KiB/s 149 KiB/s 2.37 ms 464.06 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 5/s 109 KiB/s 138 KiB/s 1.93 ms 442.79 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 5/s 110 KiB/s 128 KiB/s 1.96 ms 288.75 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 77 KiB/s 125 KiB/s 2.06 ms 424.52 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 5/s 133 KiB/s 152 KiB/s 2.13 ms 370.66 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 5/s 125 KiB/s 150 KiB/s 2.01 ms 354.02 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 5/s 96 KiB/s 120 KiB/s 2.08 ms 290.46 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 5/s 82 KiB/s 173 KiB/s 2.06 ms 383.58 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 5/s 128 KiB/s 126 KiB/s 2.24 ms 413.24 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 5/s 86 KiB/s 118 KiB/s 1.81 ms 366.26 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 5/s 87 KiB/s 167 KiB/s 2.06 ms 464.01 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 5/s 78 KiB/s 160 KiB/s 2.10 ms 387.20 us 2024-03-25T09:29:50.041 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 93 KiB/s 122 KiB/s 1.92 ms 316.89 us 2024-03-25T09:29:50.042 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:50.062 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:49 smithi059 ceph-mon[32732]: pgmap v623: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.0 MiB/s wr, 504 op/s 2024-03-25T09:29:50.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:49 smithi019 ceph-mon[29386]: pgmap v623: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.0 MiB/s wr, 504 op/s 2024-03-25T09:29:50.163 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:49 smithi040 ceph-mon[33094]: pgmap v623: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.0 MiB/s wr, 504 op/s 2024-03-25T09:29:50.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:50.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:50.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:50 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:50 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:50 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:50 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:50 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:50 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:50 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:51.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:50 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 502 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:50 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:50 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:50 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:50 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:50 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:50 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:50 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:50 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 502 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:50 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 502 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:51.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:51.814 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:51.814 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:51 smithi019 ceph-mon[29386]: pgmap v624: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.7 MiB/s wr, 634 op/s 2024-03-25T09:29:52.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:51 smithi059 ceph-mon[32732]: pgmap v624: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.7 MiB/s wr, 634 op/s 2024-03-25T09:29:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:51 smithi040 ceph-mon[33094]: pgmap v624: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 8.9 MiB/s rd, 8.7 MiB/s wr, 634 op/s 2024-03-25T09:29:52.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:52.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:52.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:52.805+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:53.815 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:53.815 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:53.816 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:54.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:53 smithi019 ceph-mon[29386]: pgmap v625: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.4 MiB/s wr, 562 op/s 2024-03-25T09:29:54.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:53 smithi059 ceph-mon[32732]: pgmap v625: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.4 MiB/s wr, 562 op/s 2024-03-25T09:29:54.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:53 smithi040 ceph-mon[33094]: pgmap v625: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.4 MiB/s wr, 562 op/s 2024-03-25T09:29:54.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:54.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:54.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:55.041 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:29:55.042 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 3/s 162 KiB/s 105 KiB/s 1.95 ms 463.90 us 2024-03-25T09:29:55.042 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 4/s 149 KiB/s 134 KiB/s 2.08 ms 325.61 us 2024-03-25T09:29:55.042 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 6/s 3/s 133 KiB/s 80 KiB/s 2.06 ms 333.20 us 2024-03-25T09:29:55.042 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 4/s 155 KiB/s 131 KiB/s 2.02 ms 294.12 us 2024-03-25T09:29:55.042 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 4/s 158 KiB/s 125 KiB/s 1.84 ms 378.20 us 2024-03-25T09:29:55.043 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 5/s 130 KiB/s 154 KiB/s 1.95 ms 296.57 us 2024-03-25T09:29:55.043 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 4/s 142 KiB/s 126 KiB/s 2.08 ms 478.22 us 2024-03-25T09:29:55.043 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 4/s 158 KiB/s 94 KiB/s 2.14 ms 288.10 us 2024-03-25T09:29:55.043 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 4/s 151 KiB/s 146 KiB/s 2.03 ms 340.06 us 2024-03-25T09:29:55.043 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 4/s 134 KiB/s 130 KiB/s 2.06 ms 341.28 us 2024-03-25T09:29:55.043 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 112 KiB/s 96 KiB/s 2.00 ms 318.41 us 2024-03-25T09:29:55.044 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 4/s 125 KiB/s 139 KiB/s 1.83 ms 289.13 us 2024-03-25T09:29:55.044 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 5/s 138 KiB/s 142 KiB/s 1.94 ms 336.34 us 2024-03-25T09:29:55.044 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 149 KiB/s 93 KiB/s 2.09 ms 367.34 us 2024-03-25T09:29:55.044 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 4/s 133 KiB/s 94 KiB/s 2.20 ms 307.61 us 2024-03-25T09:29:55.044 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 131 KiB/s 126 KiB/s 2.25 ms 399.96 us 2024-03-25T09:29:55.044 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 4/s 162 KiB/s 144 KiB/s 2.28 ms 348.14 us 2024-03-25T09:29:55.044 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 4/s 130 KiB/s 121 KiB/s 2.38 ms 373.17 us 2024-03-25T09:29:55.045 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 5/s 127 KiB/s 120 KiB/s 2.09 ms 324.26 us 2024-03-25T09:29:55.045 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 5/s 118 KiB/s 163 KiB/s 2.02 ms 351.70 us 2024-03-25T09:29:55.045 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 4/s 115 KiB/s 121 KiB/s 2.28 ms 316.45 us 2024-03-25T09:29:55.045 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 4/s 177 KiB/s 138 KiB/s 2.06 ms 411.14 us 2024-03-25T09:29:55.045 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 116 KiB/s 91 KiB/s 2.59 ms 350.05 us 2024-03-25T09:29:55.045 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 139 KiB/s 144 KiB/s 2.15 ms 339.15 us 2024-03-25T09:29:55.046 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 93 KiB/s 135 KiB/s 2.00 ms 368.83 us 2024-03-25T09:29:55.046 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 122 KiB/s 99 KiB/s 1.86 ms 306.56 us 2024-03-25T09:29:55.046 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 5/s 125 KiB/s 137 KiB/s 2.46 ms 320.21 us 2024-03-25T09:29:55.046 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 98 KiB/s 158 KiB/s 2.26 ms 375.02 us 2024-03-25T09:29:55.046 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 2/s 124 KiB/s 66 KiB/s 2.12 ms 290.53 us 2024-03-25T09:29:55.046 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 122 KiB/s 104 KiB/s 1.88 ms 334.75 us 2024-03-25T09:29:55.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 5/s 118 KiB/s 164 KiB/s 1.83 ms 342.74 us 2024-03-25T09:29:55.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 3/s 99 KiB/s 83 KiB/s 2.08 ms 344.80 us 2024-03-25T09:29:55.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 102 KiB/s 119 KiB/s 1.86 ms 317.59 us 2024-03-25T09:29:55.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 121 KiB/s 116 KiB/s 2.18 ms 314.33 us 2024-03-25T09:29:55.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 5/s 108 KiB/s 150 KiB/s 2.69 ms 370.54 us 2024-03-25T09:29:55.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 92 KiB/s 134 KiB/s 2.17 ms 384.50 us 2024-03-25T09:29:55.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 4/s 102 KiB/s 107 KiB/s 2.03 ms 312.36 us 2024-03-25T09:29:55.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 3/s 110 KiB/s 94 KiB/s 2.06 ms 337.54 us 2024-03-25T09:29:55.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 5/s 105 KiB/s 170 KiB/s 2.06 ms 380.38 us 2024-03-25T09:29:55.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 103 KiB/s 107 KiB/s 2.31 ms 338.65 us 2024-03-25T09:29:55.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 112 KiB/s 177 KiB/s 2.49 ms 323.51 us 2024-03-25T09:29:55.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 5/s 115 KiB/s 166 KiB/s 2.13 ms 369.30 us 2024-03-25T09:29:55.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 5/s 124 KiB/s 117 KiB/s 2.26 ms 438.93 us 2024-03-25T09:29:55.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 5/s 123 KiB/s 172 KiB/s 2.21 ms 342.33 us 2024-03-25T09:29:55.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 6/s 134 KiB/s 135 KiB/s 1.80 ms 272.57 us 2024-03-25T09:29:55.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 5/s 121 KiB/s 142 KiB/s 1.87 ms 326.52 us 2024-03-25T09:29:55.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 5/s 153 KiB/s 104 KiB/s 1.84 ms 305.37 us 2024-03-25T09:29:55.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 4/s 123 KiB/s 117 KiB/s 2.10 ms 299.37 us 2024-03-25T09:29:55.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 6/s 91 KiB/s 171 KiB/s 2.22 ms 331.25 us 2024-03-25T09:29:55.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 6/s 115 KiB/s 162 KiB/s 2.11 ms 321.05 us 2024-03-25T09:29:55.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 5/s 113 KiB/s 126 KiB/s 2.20 ms 316.91 us 2024-03-25T09:29:55.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 6/s 105 KiB/s 118 KiB/s 2.20 ms 292.67 us 2024-03-25T09:29:55.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 5/s 88 KiB/s 153 KiB/s 2.02 ms 305.16 us 2024-03-25T09:29:55.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 4/s 83 KiB/s 111 KiB/s 1.96 ms 352.37 us 2024-03-25T09:29:55.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 6/s 117 KiB/s 163 KiB/s 1.95 ms 329.66 us 2024-03-25T09:29:55.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 5/s 79 KiB/s 114 KiB/s 1.96 ms 292.96 us 2024-03-25T09:29:55.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 6/s 84 KiB/s 158 KiB/s 2.25 ms 348.09 us 2024-03-25T09:29:55.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 76 KiB/s 123 KiB/s 2.31 ms 340.35 us 2024-03-25T09:29:55.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 2/s 5/s 63 KiB/s 162 KiB/s 2.07 ms 307.93 us 2024-03-25T09:29:55.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 2/s 5/s 57 KiB/s 159 KiB/s 1.99 ms 309.51 us 2024-03-25T09:29:55.052 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:55.817 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:55.818 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:55.818 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-mon[29386]: pgmap v626: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.1 MiB/s wr, 553 op/s 2024-03-25T09:29:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-mon[29386]: { 2024-03-25T09:29:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:29:56.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:29:56.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:29:56.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:29:56.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:29:56.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:55 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 507 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:55 smithi059 ceph-mon[32732]: pgmap v626: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.1 MiB/s wr, 553 op/s 2024-03-25T09:29:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:55 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:55 smithi059 ceph-mon[32732]: { 2024-03-25T09:29:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:55 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:29:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:55 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:29:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:55 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:29:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:55 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:29:56.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:55 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:29:56.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:55 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 507 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:55 smithi040 ceph-mon[33094]: pgmap v626: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.1 MiB/s wr, 553 op/s 2024-03-25T09:29:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:55 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:29:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:55 smithi040 ceph-mon[33094]: { 2024-03-25T09:29:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:55 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:29:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:55 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:29:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:55 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:29:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:55 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:29:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:55 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:29:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:55 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 507 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:29:56.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:56.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:56.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:57.819 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:57.819 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:57.819 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:58.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:57 smithi019 ceph-mon[29386]: pgmap v627: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.9 MiB/s wr, 621 op/s 2024-03-25T09:29:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:29:57.806+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:29:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:57 smithi059 ceph-mon[32732]: pgmap v627: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.9 MiB/s wr, 621 op/s 2024-03-25T09:29:58.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:57 smithi040 ceph-mon[33094]: pgmap v627: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.9 MiB/s wr, 621 op/s 2024-03-25T09:29:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:29:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:29:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:29:59.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:29:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 88.0k 142.8k 0.0k 880.0k 1.4M 0.0k nvme2n1 2024-03-25T09:29:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 90.4k 112.8k 0.0k 904.0k 1.1M 0.0k nvme2n10 2024-03-25T09:29:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 98.8k 147.2k 0.0k 988.0k 1.4M 0.0k nvme2n11 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 110.8k 159.6k 0.0k 1.1M 1.6M 0.0k nvme2n12 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 106.8k 140.8k 0.0k 1.0M 1.4M 0.0k nvme2n13 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 124.0k 148.4k 0.0k 1.2M 1.4M 0.0k nvme2n14 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 116.8k 116.8k 0.0k 1.1M 1.1M 0.0k nvme2n15 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 110.8k 120.8k 0.0k 1.1M 1.2M 0.0k nvme2n16 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 112.4k 120.8k 0.0k 1.1M 1.2M 0.0k nvme2n17 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 110.4k 103.6k 0.0k 1.1M 1.0M 0.0k nvme2n18 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 116.0k 116.4k 0.0k 1.1M 1.1M 0.0k nvme2n19 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 113.6k 130.4k 0.0k 1.1M 1.3M 0.0k nvme2n2 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 174.4k 58.4k 0.0k 1.7M 584.0k 0.0k nvme2n20 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 119.2k 89.6k 0.0k 1.2M 896.0k 0.0k nvme2n3 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 94.8k 116.0k 0.0k 948.0k 1.1M 0.0k nvme2n4 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 118.0k 97.6k 0.0k 1.2M 976.0k 0.0k nvme2n5 2024-03-25T09:29:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 144.4k 100.0k 0.0k 1.4M 1000.0k 0.0k nvme2n6 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 91.6k 136.4k 0.0k 916.0k 1.3M 0.0k nvme2n7 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 77.6k 150.0k 0.0k 776.0k 1.5M 0.0k nvme2n8 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 93.6k 120.4k 0.0k 936.0k 1.2M 0.0k nvme2n9 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 106.8k 124.4k 0.0k 1.0M 1.2M 0.0k nvme5n1 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 122.0k 110.4k 0.0k 1.2M 1.1M 0.0k nvme5n10 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 112.8k 120.0k 0.0k 1.1M 1.2M 0.0k nvme5n11 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 111.6k 121.6k 0.0k 1.1M 1.2M 0.0k nvme5n12 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 124.4k 116.8k 0.0k 1.2M 1.1M 0.0k nvme5n13 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 114.8k 124.4k 0.0k 1.1M 1.2M 0.0k nvme5n14 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 93.2k 131.2k 0.0k 932.0k 1.3M 0.0k nvme5n15 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 117.2k 104.8k 0.0k 1.1M 1.0M 0.0k nvme5n16 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 97.6k 119.2k 0.0k 976.0k 1.2M 0.0k nvme5n17 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 112.8k 98.8k 0.0k 1.1M 988.0k 0.0k nvme5n18 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 133.6k 100.4k 0.0k 1.3M 1004.0k 0.0k nvme5n19 2024-03-25T09:29:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 129.2k 85.6k 0.0k 1.3M 856.0k 0.0k nvme5n2 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 97.6k 125.6k 0.0k 976.0k 1.2M 0.0k nvme5n20 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 115.6k 117.6k 0.0k 1.1M 1.1M 0.0k nvme5n3 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 122.0k 114.8k 0.0k 1.2M 1.1M 0.0k nvme5n4 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 115.2k 106.0k 0.0k 1.1M 1.0M 0.0k nvme5n5 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 144.0k 94.0k 0.0k 1.4M 940.0k 0.0k nvme5n6 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 108.0k 104.8k 0.0k 1.1M 1.0M 0.0k nvme5n7 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 114.0k 142.0k 0.0k 1.1M 1.4M 0.0k nvme5n8 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 104.4k 102.8k 0.0k 1.0M 1.0M 0.0k nvme5n9 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 97.6k 142.8k 0.0k 976.0k 1.4M 0.0k nvme8n1 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 142.0k 108.0k 0.0k 1.4M 1.1M 0.0k nvme8n10 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 98.4k 106.8k 0.0k 984.0k 1.0M 0.0k nvme8n11 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 103.2k 122.4k 0.0k 1.0M 1.2M 0.0k nvme8n12 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 113.6k 130.8k 0.0k 1.1M 1.3M 0.0k nvme8n13 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 98.8k 113.6k 0.0k 988.0k 1.1M 0.0k nvme8n14 2024-03-25T09:29:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 148.8k 118.4k 0.0k 1.5M 1.2M 0.0k nvme8n15 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 114.0k 112.0k 0.0k 1.1M 1.1M 0.0k nvme8n16 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 103.2k 118.0k 0.0k 1.0M 1.2M 0.0k nvme8n17 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 128.8k 89.6k 0.0k 1.3M 896.0k 0.0k nvme8n18 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 151.6k 92.8k 0.0k 1.5M 928.0k 0.0k nvme8n19 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 118.4k 120.0k 0.0k 1.2M 1.2M 0.0k nvme8n2 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 96.0k 135.2k 0.0k 960.0k 1.3M 0.0k nvme8n20 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 124.8k 128.4k 0.0k 1.2M 1.3M 0.0k nvme8n3 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 142.4k 142.0k 0.0k 1.4M 1.4M 0.0k nvme8n4 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 122.8k 115.6k 0.0k 1.2M 1.1M 0.0k nvme8n5 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 90.8k 132.4k 0.0k 908.0k 1.3M 0.0k nvme8n6 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 143.2k 88.8k 0.0k 1.4M 888.0k 0.0k nvme8n7 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 110.4k 116.0k 0.0k 1.1M 1.1M 0.0k nvme8n8 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 122.4k 123.2k 0.0k 1.2M 1.2M 0.0k nvme8n9 2024-03-25T09:29:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:29:59.821 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:29:59.821 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:29:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:29:59.821 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:29:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:00.046 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 6/s 3/s 130 KiB/s 66 KiB/s 2.28 ms 281.67 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 3/s 142 KiB/s 117 KiB/s 2.42 ms 467.16 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 4/s 124 KiB/s 114 KiB/s 1.97 ms 303.47 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 3/s 157 KiB/s 94 KiB/s 1.90 ms 324.34 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 3/s 154 KiB/s 74 KiB/s 1.98 ms 382.93 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 3/s 151 KiB/s 65 KiB/s 2.25 ms 315.76 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 4/s 147 KiB/s 110 KiB/s 2.23 ms 367.21 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 3/s 176 KiB/s 97 KiB/s 2.06 ms 386.73 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 4/s 157 KiB/s 137 KiB/s 2.10 ms 383.90 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 3/s 125 KiB/s 72 KiB/s 2.22 ms 327.21 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 2/s 152 KiB/s 53 KiB/s 2.14 ms 318.43 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 4/s 184 KiB/s 126 KiB/s 2.14 ms 357.22 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 3/s 133 KiB/s 109 KiB/s 1.92 ms 354.35 us 2024-03-25T09:30:00.047 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 3/s 166 KiB/s 114 KiB/s 2.54 ms 394.47 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 3/s 140 KiB/s 111 KiB/s 2.12 ms 332.47 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 3/s 138 KiB/s 94 KiB/s 2.26 ms 446.39 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 4/s 138 KiB/s 124 KiB/s 1.96 ms 340.32 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 151 KiB/s 96 KiB/s 1.88 ms 340.86 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 150 KiB/s 87 KiB/s 2.11 ms 338.59 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 3/s 158 KiB/s 74 KiB/s 1.89 ms 359.47 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 3/s 133 KiB/s 110 KiB/s 2.33 ms 349.90 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 4/s 141 KiB/s 92 KiB/s 2.21 ms 305.61 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 3/s 128 KiB/s 96 KiB/s 2.28 ms 318.98 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 4/s 123 KiB/s 94 KiB/s 2.21 ms 401.62 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 3/s 126 KiB/s 74 KiB/s 1.86 ms 292.76 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 127 KiB/s 89 KiB/s 2.24 ms 296.11 us 2024-03-25T09:30:00.048 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 3/s 115 KiB/s 80 KiB/s 2.39 ms 317.68 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 4/s 137 KiB/s 86 KiB/s 1.93 ms 319.05 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 4/s 131 KiB/s 142 KiB/s 1.98 ms 363.95 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 4/s 134 KiB/s 154 KiB/s 2.10 ms 373.16 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 116 KiB/s 113 KiB/s 2.08 ms 388.78 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 122 KiB/s 122 KiB/s 2.23 ms 442.08 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 143 KiB/s 110 KiB/s 2.09 ms 374.81 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 82 KiB/s 115 KiB/s 2.34 ms 394.70 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 69 KiB/s 112 KiB/s 2.09 ms 416.16 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 5/s 122 KiB/s 101 KiB/s 1.95 ms 328.15 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 108 KiB/s 82 KiB/s 2.22 ms 285.11 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 5/s 121 KiB/s 146 KiB/s 1.90 ms 316.20 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 131 KiB/s 102 KiB/s 2.34 ms 332.14 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 4/s 98 KiB/s 118 KiB/s 2.03 ms 361.75 us 2024-03-25T09:30:00.049 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 5/s 104 KiB/s 152 KiB/s 2.36 ms 377.76 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 3/s 116 KiB/s 97 KiB/s 1.99 ms 316.29 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 5/s 116 KiB/s 134 KiB/s 2.01 ms 340.85 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 4/s 134 KiB/s 83 KiB/s 2.05 ms 385.16 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 5/s 102 KiB/s 154 KiB/s 2.00 ms 443.85 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 110 KiB/s 58 KiB/s 2.03 ms 294.18 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 109 KiB/s 109 KiB/s 2.35 ms 341.48 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 78 KiB/s 153 KiB/s 2.14 ms 411.99 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 5/s 126 KiB/s 117 KiB/s 2.19 ms 378.69 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 6/s 88 KiB/s 157 KiB/s 1.95 ms 353.83 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 5/s 102 KiB/s 78 KiB/s 2.61 ms 355.79 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 82 KiB/s 93 KiB/s 2.12 ms 319.18 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 5/s 99 KiB/s 172 KiB/s 2.16 ms 353.95 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 5/s 95 KiB/s 150 KiB/s 1.79 ms 409.22 us 2024-03-25T09:30:00.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 5/s 94 KiB/s 146 KiB/s 2.25 ms 368.53 us 2024-03-25T09:30:00.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 95 KiB/s 105 KiB/s 2.09 ms 336.81 us 2024-03-25T09:30:00.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 5/s 92 KiB/s 109 KiB/s 2.06 ms 311.89 us 2024-03-25T09:30:00.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 5/s 58 KiB/s 149 KiB/s 1.86 ms 331.49 us 2024-03-25T09:30:00.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 5/s 86 KiB/s 112 KiB/s 1.99 ms 360.89 us 2024-03-25T09:30:00.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 5/s 76 KiB/s 121 KiB/s 1.96 ms 333.25 us 2024-03-25T09:30:00.051 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:00.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:29:59 smithi019 ceph-mon[29386]: pgmap v628: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.4 MiB/s wr, 507 op/s 2024-03-25T09:30:00.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:29:59 smithi059 ceph-mon[32732]: pgmap v628: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.4 MiB/s wr, 507 op/s 2024-03-25T09:30:00.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:29:59 smithi040 ceph-mon[33094]: pgmap v628: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.4 MiB/s wr, 507 op/s 2024-03-25T09:30:00.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:00.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:00.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 4 slow ops, oldest one blocked for 512 sec, mon.c has slow ops 2024-03-25T09:30:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-25T09:30:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: daemon nvmeof.nvmeof.c on smithi059 is in error state 2024-03-25T09:30:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: [WRN] SLOW_OPS: 4 slow ops, oldest one blocked for 512 sec, mon.c has slow ops 2024-03-25T09:30:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:01.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:00 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 512 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:01.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 4 slow ops, oldest one blocked for 512 sec, mon.c has slow ops 2024-03-25T09:30:01.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-25T09:30:01.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: daemon nvmeof.nvmeof.c on smithi059 is in error state 2024-03-25T09:30:01.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: [WRN] SLOW_OPS: 4 slow ops, oldest one blocked for 512 sec, mon.c has slow ops 2024-03-25T09:30:01.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:01.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:01.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:01.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:01.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:01.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:01.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:01.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:00 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 512 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 4 slow ops, oldest one blocked for 512 sec, mon.c has slow ops 2024-03-25T09:30:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-25T09:30:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: daemon nvmeof.nvmeof.c on smithi059 is in error state 2024-03-25T09:30:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: [WRN] SLOW_OPS: 4 slow ops, oldest one blocked for 512 sec, mon.c has slow ops 2024-03-25T09:30:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:01.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:01.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:01.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:01.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:00 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 512 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:01.828 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:01.829 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:01.829 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:02.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:01 smithi019 ceph-mon[29386]: pgmap v629: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 636 op/s 2024-03-25T09:30:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:01 smithi059 ceph-mon[32732]: pgmap v629: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 636 op/s 2024-03-25T09:30:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:01 smithi040 ceph-mon[33094]: pgmap v629: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 636 op/s 2024-03-25T09:30:02.767 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:02.767 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:02.767 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:02.807+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:03.830 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:03.830 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:03.830 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:04.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:03 smithi019 ceph-mon[29386]: pgmap v630: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 559 op/s 2024-03-25T09:30:04.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:03 smithi059 ceph-mon[32732]: pgmap v630: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 559 op/s 2024-03-25T09:30:04.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:03 smithi040 ceph-mon[33094]: pgmap v630: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 559 op/s 2024-03-25T09:30:04.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:04.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:04.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:05.050 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:05.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 3/s 146 KiB/s 77 KiB/s 1.99 ms 320.65 us 2024-03-25T09:30:05.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 3/s 131 KiB/s 69 KiB/s 2.26 ms 279.94 us 2024-03-25T09:30:05.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 4/s 163 KiB/s 92 KiB/s 2.14 ms 412.26 us 2024-03-25T09:30:05.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 130 KiB/s 88 KiB/s 2.12 ms 321.81 us 2024-03-25T09:30:05.050 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 137 KiB/s 99 KiB/s 1.82 ms 296.31 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 5/s 137 KiB/s 114 KiB/s 2.24 ms 351.75 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 4/s 158 KiB/s 89 KiB/s 2.02 ms 344.59 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 4/s 123 KiB/s 139 KiB/s 1.91 ms 417.90 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 4/s 114 KiB/s 85 KiB/s 1.99 ms 298.47 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 142 KiB/s 149 KiB/s 2.11 ms 313.48 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 4/s 150 KiB/s 112 KiB/s 1.97 ms 325.46 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 3/s 122 KiB/s 99 KiB/s 2.57 ms 441.56 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 3/s 90 KiB/s 80 KiB/s 2.20 ms 348.65 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 3/s 126 KiB/s 94 KiB/s 2.03 ms 275.87 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 121 KiB/s 115 KiB/s 2.13 ms 282.32 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 5/s 123 KiB/s 110 KiB/s 2.16 ms 296.18 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 4/s 106 KiB/s 94 KiB/s 2.04 ms 287.70 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 5/s 118 KiB/s 131 KiB/s 2.11 ms 377.22 us 2024-03-25T09:30:05.051 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 4/s 123 KiB/s 103 KiB/s 2.06 ms 311.95 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 4/s 136 KiB/s 101 KiB/s 2.10 ms 375.26 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 5/s 123 KiB/s 146 KiB/s 2.08 ms 289.42 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 124 KiB/s 97 KiB/s 2.28 ms 312.28 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 114 KiB/s 112 KiB/s 2.11 ms 327.98 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 134 KiB/s 118 KiB/s 2.17 ms 514.40 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 106 KiB/s 111 KiB/s 2.08 ms 300.14 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 135 KiB/s 126 KiB/s 2.08 ms 310.82 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 5/s 91 KiB/s 141 KiB/s 1.83 ms 286.55 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 94 KiB/s 134 KiB/s 2.10 ms 358.12 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 104 KiB/s 114 KiB/s 2.34 ms 303.61 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 68 KiB/s 138 KiB/s 2.02 ms 390.29 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 100 KiB/s 145 KiB/s 2.03 ms 352.58 us 2024-03-25T09:30:05.052 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 109 KiB/s 94 KiB/s 2.25 ms 378.69 us 2024-03-25T09:30:05.053 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 5/s 145 KiB/s 118 KiB/s 2.19 ms 334.59 us 2024-03-25T09:30:05.053 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 6/s 118 KiB/s 153 KiB/s 2.11 ms 429.52 us 2024-03-25T09:30:05.053 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 3/s 130 KiB/s 99 KiB/s 2.36 ms 354.02 us 2024-03-25T09:30:05.053 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 5/s 110 KiB/s 140 KiB/s 2.27 ms 317.68 us 2024-03-25T09:30:05.053 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 4/s 83 KiB/s 94 KiB/s 2.18 ms 391.95 us 2024-03-25T09:30:05.053 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 105 KiB/s 148 KiB/s 2.42 ms 348.04 us 2024-03-25T09:30:05.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 5/s 94 KiB/s 109 KiB/s 2.06 ms 381.89 us 2024-03-25T09:30:05.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 4/s 86 KiB/s 110 KiB/s 1.99 ms 407.21 us 2024-03-25T09:30:05.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 115 KiB/s 94 KiB/s 2.40 ms 307.00 us 2024-03-25T09:30:05.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 106 KiB/s 101 KiB/s 2.20 ms 304.83 us 2024-03-25T09:30:05.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 104 KiB/s 141 KiB/s 2.21 ms 382.92 us 2024-03-25T09:30:05.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 102 KiB/s 96 KiB/s 2.18 ms 325.00 us 2024-03-25T09:30:05.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 113 KiB/s 111 KiB/s 1.96 ms 437.81 us 2024-03-25T09:30:05.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 114 KiB/s 106 KiB/s 2.36 ms 457.01 us 2024-03-25T09:30:05.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 78 KiB/s 93 KiB/s 1.93 ms 435.91 us 2024-03-25T09:30:05.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 80 KiB/s 99 KiB/s 2.28 ms 387.63 us 2024-03-25T09:30:05.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 5/s 94 KiB/s 122 KiB/s 2.08 ms 330.35 us 2024-03-25T09:30:05.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 5/s 100 KiB/s 108 KiB/s 2.28 ms 334.08 us 2024-03-25T09:30:05.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 93 KiB/s 122 KiB/s 2.37 ms 338.97 us 2024-03-25T09:30:05.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 4/s 83 KiB/s 109 KiB/s 1.85 ms 353.52 us 2024-03-25T09:30:05.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 6/s 90 KiB/s 149 KiB/s 2.16 ms 308.34 us 2024-03-25T09:30:05.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 5/s 49 KiB/s 122 KiB/s 1.95 ms 287.49 us 2024-03-25T09:30:05.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 5/s 112 KiB/s 126 KiB/s 2.82 ms 323.12 us 2024-03-25T09:30:05.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 5/s 108 KiB/s 124 KiB/s 2.30 ms 302.24 us 2024-03-25T09:30:05.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 79 KiB/s 119 KiB/s 2.06 ms 330.35 us 2024-03-25T09:30:05.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 3/s 65 KiB/s 86 KiB/s 2.26 ms 435.01 us 2024-03-25T09:30:05.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 5/s 79 KiB/s 138 KiB/s 1.91 ms 374.55 us 2024-03-25T09:30:05.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 7/s 63 KiB/s 177 KiB/s 2.16 ms 398.88 us 2024-03-25T09:30:05.057 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:05.832 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:05.832 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:05.832 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:06.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-mon[29386]: pgmap v631: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 546 op/s 2024-03-25T09:30:06.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:06.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:06.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:06.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:06.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:06.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:06.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:06.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:05 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 517 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:05 smithi059 ceph-mon[32732]: pgmap v631: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 546 op/s 2024-03-25T09:30:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:05 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:05 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:05 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:05 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:05 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:05 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:05 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:06.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:05 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 517 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:05 smithi040 ceph-mon[33094]: pgmap v631: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 546 op/s 2024-03-25T09:30:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:05 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:05 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:05 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:05 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:05 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:05 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:05 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:05 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 517 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:07.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:07.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:07.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:07.834 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:07.835 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:08.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:07 smithi019 ceph-mon[29386]: pgmap v632: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.3 MiB/s wr, 618 op/s 2024-03-25T09:30:08.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:07.807+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:08.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:07 smithi059 ceph-mon[32732]: pgmap v632: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.3 MiB/s wr, 618 op/s 2024-03-25T09:30:08.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:07 smithi040 ceph-mon[33094]: pgmap v632: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.3 MiB/s wr, 618 op/s 2024-03-25T09:30:09.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:09.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:09.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:09.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:30:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 86.8k 111.6k 0.0k 868.0k 1.1M 0.0k nvme2n1 2024-03-25T09:30:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 102.4k 119.2k 0.0k 1.0M 1.2M 0.0k nvme2n10 2024-03-25T09:30:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 138.4k 109.2k 0.0k 1.4M 1.1M 0.0k nvme2n11 2024-03-25T09:30:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 98.4k 131.6k 0.0k 984.0k 1.3M 0.0k nvme2n12 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 79.6k 124.8k 0.0k 796.0k 1.2M 0.0k nvme2n13 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 85.2k 100.4k 0.0k 852.0k 1004.0k 0.0k nvme2n14 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 112.8k 105.6k 0.0k 1.1M 1.0M 0.0k nvme2n15 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 124.0k 104.4k 0.0k 1.2M 1.0M 0.0k nvme2n16 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 98.8k 123.2k 0.0k 988.0k 1.2M 0.0k nvme2n17 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 104.4k 116.8k 0.0k 1.0M 1.1M 0.0k nvme2n18 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 130.4k 95.6k 0.0k 1.3M 956.0k 0.0k nvme2n19 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 126.4k 104.8k 0.0k 1.2M 1.0M 0.0k nvme2n2 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 87.6k 117.6k 0.0k 876.0k 1.1M 0.0k nvme2n20 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 110.4k 113.6k 0.0k 1.1M 1.1M 0.0k nvme2n3 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 114.4k 92.8k 0.0k 1.1M 928.0k 0.0k nvme2n4 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 82.0k 114.4k 0.0k 820.0k 1.1M 0.0k nvme2n5 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 110.4k 106.8k 0.0k 1.1M 1.0M 0.0k nvme2n6 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 93.2k 114.4k 0.0k 932.0k 1.1M 0.0k nvme2n7 2024-03-25T09:30:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 98.8k 114.8k 0.0k 988.0k 1.1M 0.0k nvme2n8 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 123.6k 84.0k 0.0k 1.2M 840.0k 0.0k nvme2n9 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 84.0k 130.8k 0.0k 840.0k 1.3M 0.0k nvme5n1 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 102.8k 113.6k 0.0k 1.0M 1.1M 0.0k nvme5n10 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 93.6k 104.0k 0.0k 936.0k 1.0M 0.0k nvme5n11 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 106.0k 101.6k 0.0k 1.0M 1016.0k 0.0k nvme5n12 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 81.2k 118.4k 0.0k 812.0k 1.2M 0.0k nvme5n13 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 125.2k 100.0k 0.0k 1.2M 1000.0k 0.0k nvme5n14 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 106.0k 102.8k 0.0k 1.0M 1.0M 0.0k nvme5n15 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 101.6k 86.8k 0.0k 1016.0k 868.0k 0.0k nvme5n16 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 103.2k 102.8k 0.0k 1.0M 1.0M 0.0k nvme5n17 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 78.0k 138.0k 0.0k 780.0k 1.3M 0.0k nvme5n18 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 92.0k 128.0k 0.0k 920.0k 1.2M 0.0k nvme5n19 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 98.0k 120.4k 0.0k 980.0k 1.2M 0.0k nvme5n2 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 121.2k 95.2k 0.0k 1.2M 952.0k 0.0k nvme5n20 2024-03-25T09:30:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 117.6k 108.8k 0.0k 1.1M 1.1M 0.0k nvme5n3 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 140.8k 101.2k 0.0k 1.4M 1012.0k 0.0k nvme5n4 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 113.6k 105.6k 0.0k 1.1M 1.0M 0.0k nvme5n5 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 111.2k 125.2k 0.0k 1.1M 1.2M 0.0k nvme5n6 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 110.0k 118.8k 0.0k 1.1M 1.2M 0.0k nvme5n7 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 94.8k 114.8k 0.0k 948.0k 1.1M 0.0k nvme5n8 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 94.4k 96.4k 0.0k 944.0k 964.0k 0.0k nvme5n9 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 134.4k 78.4k 0.0k 1.3M 784.0k 0.0k nvme8n1 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 104.8k 98.4k 0.0k 1.0M 984.0k 0.0k nvme8n10 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 115.2k 100.8k 0.0k 1.1M 1008.0k 0.0k nvme8n11 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 96.8k 112.4k 0.0k 968.0k 1.1M 0.0k nvme8n12 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 128.4k 105.6k 0.0k 1.3M 1.0M 0.0k nvme8n13 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.40 103.2k 92.4k 0.0k 1.0M 924.0k 0.0k nvme8n14 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 103.2k 112.4k 0.0k 1.0M 1.1M 0.0k nvme8n15 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 104.4k 79.2k 0.0k 1.0M 792.0k 0.0k nvme8n16 2024-03-25T09:30:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 128.0k 98.8k 0.0k 1.2M 988.0k 0.0k nvme8n17 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 103.6k 138.0k 0.0k 1.0M 1.3M 0.0k nvme8n18 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 110.8k 99.6k 0.0k 1.1M 996.0k 0.0k nvme8n19 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 97.6k 123.6k 0.0k 976.0k 1.2M 0.0k nvme8n2 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 105.6k 111.6k 0.0k 1.0M 1.1M 0.0k nvme8n20 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 112.4k 98.4k 0.0k 1.1M 984.0k 0.0k nvme8n3 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 135.2k 96.8k 0.0k 1.3M 968.0k 0.0k nvme8n4 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 112.0k 134.4k 0.0k 1.1M 1.3M 0.0k nvme8n5 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 116.4k 92.0k 0.0k 1.1M 920.0k 0.0k nvme8n6 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 112.0k 126.0k 0.0k 1.1M 1.2M 0.0k nvme8n7 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 90.0k 122.8k 0.0k 900.0k 1.2M 0.0k nvme8n8 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 104.0k 118.0k 0.0k 1.0M 1.2M 0.0k nvme8n9 2024-03-25T09:30:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:09.836 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:09.836 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:09.836 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:10.054 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:10.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 4/s 175 KiB/s 108 KiB/s 2.09 ms 312.69 us 2024-03-25T09:30:10.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 3/s 169 KiB/s 70 KiB/s 2.01 ms 324.62 us 2024-03-25T09:30:10.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 2/s 124 KiB/s 63 KiB/s 2.01 ms 444.29 us 2024-03-25T09:30:10.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 6/s 4/s 146 KiB/s 82 KiB/s 2.23 ms 302.67 us 2024-03-25T09:30:10.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 3/s 122 KiB/s 68 KiB/s 2.10 ms 283.46 us 2024-03-25T09:30:10.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 3/s 108 KiB/s 99 KiB/s 2.21 ms 364.39 us 2024-03-25T09:30:10.054 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 5/s 118 KiB/s 103 KiB/s 2.00 ms 320.29 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 4/s 142 KiB/s 92 KiB/s 2.04 ms 450.40 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 5/s 93 KiB/s 104 KiB/s 2.23 ms 307.67 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 4/s 113 KiB/s 106 KiB/s 2.19 ms 292.68 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 4/s 128 KiB/s 100 KiB/s 2.14 ms 388.77 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 5/s 113 KiB/s 122 KiB/s 1.99 ms 307.26 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 3/s 95 KiB/s 82 KiB/s 1.90 ms 308.39 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 5/s 132 KiB/s 95 KiB/s 1.93 ms 319.24 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 4/s 102 KiB/s 96 KiB/s 2.07 ms 371.78 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 4/s 128 KiB/s 97 KiB/s 1.99 ms 373.43 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 4/s 108 KiB/s 109 KiB/s 2.03 ms 322.02 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 149 KiB/s 70 KiB/s 2.17 ms 247.48 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 4/s 102 KiB/s 110 KiB/s 1.90 ms 301.37 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 5/s 122 KiB/s 127 KiB/s 2.17 ms 339.65 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 4/s 145 KiB/s 91 KiB/s 2.03 ms 291.40 us 2024-03-25T09:30:10.055 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 3/s 103 KiB/s 82 KiB/s 2.01 ms 346.80 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 3/s 94 KiB/s 74 KiB/s 2.08 ms 338.65 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 6/s 104 KiB/s 150 KiB/s 1.98 ms 294.81 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 4/s 130 KiB/s 82 KiB/s 2.62 ms 386.25 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 99 KiB/s 95 KiB/s 2.11 ms 326.20 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 4/s 127 KiB/s 119 KiB/s 2.15 ms 377.76 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 5/s 104 KiB/s 121 KiB/s 2.01 ms 288.00 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 4/s 129 KiB/s 117 KiB/s 2.29 ms 347.68 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 109 KiB/s 114 KiB/s 2.02 ms 354.77 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 3/s 138 KiB/s 55 KiB/s 2.10 ms 270.13 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 5/s 110 KiB/s 114 KiB/s 1.88 ms 314.62 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 122 KiB/s 119 KiB/s 2.28 ms 355.16 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 5/s 125 KiB/s 122 KiB/s 1.93 ms 443.07 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 5/s 116 KiB/s 132 KiB/s 2.44 ms 341.27 us 2024-03-25T09:30:10.056 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 145 KiB/s 130 KiB/s 2.00 ms 401.32 us 2024-03-25T09:30:10.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 86 KiB/s 112 KiB/s 2.41 ms 304.79 us 2024-03-25T09:30:10.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 101 KiB/s 84 KiB/s 2.41 ms 336.92 us 2024-03-25T09:30:10.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 97 KiB/s 88 KiB/s 2.29 ms 321.67 us 2024-03-25T09:30:10.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 5/s 110 KiB/s 90 KiB/s 1.90 ms 300.28 us 2024-03-25T09:30:10.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 5/s 90 KiB/s 118 KiB/s 2.16 ms 372.51 us 2024-03-25T09:30:10.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 118 KiB/s 140 KiB/s 2.19 ms 323.20 us 2024-03-25T09:30:10.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 3/s 91 KiB/s 82 KiB/s 2.13 ms 381.21 us 2024-03-25T09:30:10.057 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 109 KiB/s 102 KiB/s 1.95 ms 385.03 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 105 KiB/s 122 KiB/s 2.02 ms 307.10 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 82 KiB/s 92 KiB/s 2.40 ms 382.01 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 114 KiB/s 86 KiB/s 2.10 ms 289.09 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 114 KiB/s 89 KiB/s 2.01 ms 307.98 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 5/s 82 KiB/s 117 KiB/s 2.20 ms 378.61 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 71 KiB/s 111 KiB/s 2.22 ms 394.12 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 6/s 94 KiB/s 154 KiB/s 2.45 ms 384.49 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 6/s 93 KiB/s 114 KiB/s 2.24 ms 379.86 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 5/s 85 KiB/s 122 KiB/s 1.90 ms 358.42 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 5/s 83 KiB/s 108 KiB/s 2.05 ms 303.11 us 2024-03-25T09:30:10.058 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 6/s 89 KiB/s 145 KiB/s 2.36 ms 343.72 us 2024-03-25T09:30:10.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 5/s 70 KiB/s 132 KiB/s 2.08 ms 291.12 us 2024-03-25T09:30:10.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 5/s 91 KiB/s 118 KiB/s 2.14 ms 484.17 us 2024-03-25T09:30:10.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 6/s 93 KiB/s 131 KiB/s 2.01 ms 421.04 us 2024-03-25T09:30:10.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 6/s 78 KiB/s 144 KiB/s 2.23 ms 378.90 us 2024-03-25T09:30:10.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 2/s 3/s 58 KiB/s 93 KiB/s 2.36 ms 404.57 us 2024-03-25T09:30:10.059 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:10.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:09 smithi019 ceph-mon[29386]: pgmap v633: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 509 op/s 2024-03-25T09:30:10.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:09 smithi059 ceph-mon[32732]: pgmap v633: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 509 op/s 2024-03-25T09:30:10.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:09 smithi040 ceph-mon[33094]: pgmap v633: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 509 op/s 2024-03-25T09:30:10.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:10.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:10.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:11.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:10 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:11.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:10 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:11.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:10 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:11.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:10 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:11.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:10 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:11.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:10 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:11.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:10 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:11.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:10 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 522 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:10 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:10 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:10 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:10 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:10 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:10 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:10 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:11.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:10 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 522 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:10 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 522 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:11.841 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:11.841 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:11.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:12.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:11 smithi019 ceph-mon[29386]: pgmap v634: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 638 op/s 2024-03-25T09:30:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:11 smithi059 ceph-mon[32732]: pgmap v634: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 638 op/s 2024-03-25T09:30:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:11 smithi040 ceph-mon[33094]: pgmap v634: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 638 op/s 2024-03-25T09:30:13.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:13.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:13.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:12.807+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:13.843 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:13.843 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:13.843 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:14.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:13 smithi019 ceph-mon[29386]: pgmap v635: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 558 op/s 2024-03-25T09:30:14.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:13 smithi059 ceph-mon[32732]: pgmap v635: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 558 op/s 2024-03-25T09:30:14.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:13 smithi040 ceph-mon[33094]: pgmap v635: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 558 op/s 2024-03-25T09:30:15.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:15.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:15.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 4/s 106 KiB/s 82 KiB/s 2.12 ms 272.67 us 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 5/s 141 KiB/s 113 KiB/s 2.17 ms 300.73 us 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 3/s 142 KiB/s 62 KiB/s 2.13 ms 509.51 us 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 4/s 124 KiB/s 81 KiB/s 2.25 ms 369.93 us 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 3/s 136 KiB/s 90 KiB/s 2.06 ms 386.65 us 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 3/s 96 KiB/s 65 KiB/s 2.30 ms 336.65 us 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 3/s 141 KiB/s 74 KiB/s 2.11 ms 310.17 us 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 4/s 117 KiB/s 106 KiB/s 2.59 ms 325.25 us 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 4/s 134 KiB/s 80 KiB/s 2.29 ms 361.10 us 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 3/s 106 KiB/s 54 KiB/s 1.86 ms 324.14 us 2024-03-25T09:30:15.059 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 3/s 111 KiB/s 87 KiB/s 2.08 ms 336.20 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 4/s 103 KiB/s 89 KiB/s 2.09 ms 306.17 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 87 KiB/s 107 KiB/s 2.42 ms 344.36 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 5/s 103 KiB/s 143 KiB/s 2.27 ms 395.99 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 3/s 113 KiB/s 107 KiB/s 1.97 ms 363.28 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 3/s 137 KiB/s 54 KiB/s 1.86 ms 354.77 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 4/s 126 KiB/s 99 KiB/s 2.43 ms 350.96 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 4/s 134 KiB/s 115 KiB/s 2.06 ms 335.42 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 4/s 110 KiB/s 93 KiB/s 2.09 ms 296.23 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 124 KiB/s 90 KiB/s 2.08 ms 402.22 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 3/s 106 KiB/s 81 KiB/s 2.14 ms 299.38 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 104 KiB/s 106 KiB/s 2.12 ms 320.28 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 3/s 99 KiB/s 104 KiB/s 2.01 ms 353.24 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 4/s 89 KiB/s 94 KiB/s 2.12 ms 380.64 us 2024-03-25T09:30:15.060 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 94 KiB/s 82 KiB/s 2.11 ms 261.39 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 5/s 117 KiB/s 98 KiB/s 1.93 ms 301.07 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 86 KiB/s 58 KiB/s 2.35 ms 290.87 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 118 KiB/s 97 KiB/s 1.99 ms 356.50 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 112 KiB/s 87 KiB/s 1.89 ms 429.82 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 5/s 82 KiB/s 134 KiB/s 2.14 ms 331.51 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 5/s 109 KiB/s 166 KiB/s 2.30 ms 352.72 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 5/s 110 KiB/s 130 KiB/s 2.75 ms 339.05 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 4/s 96 KiB/s 90 KiB/s 1.92 ms 297.64 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 86 KiB/s 86 KiB/s 2.40 ms 356.75 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 89 KiB/s 89 KiB/s 2.11 ms 310.31 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 136 KiB/s 90 KiB/s 2.06 ms 286.18 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 112 KiB/s 81 KiB/s 2.03 ms 291.77 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 126 KiB/s 129 KiB/s 2.52 ms 328.92 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 110 KiB/s 84 KiB/s 2.17 ms 272.76 us 2024-03-25T09:30:15.061 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 5/s 125 KiB/s 127 KiB/s 2.08 ms 323.86 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 3/s 95 KiB/s 67 KiB/s 1.93 ms 408.10 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 4/s 82 KiB/s 92 KiB/s 2.13 ms 325.77 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 100 KiB/s 107 KiB/s 2.13 ms 298.47 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 109 KiB/s 121 KiB/s 2.00 ms 291.63 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 5/s 99 KiB/s 106 KiB/s 1.97 ms 331.17 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 4/s 95 KiB/s 82 KiB/s 2.08 ms 319.98 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 115 KiB/s 95 KiB/s 2.23 ms 324.32 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 5/s 87 KiB/s 93 KiB/s 2.16 ms 295.88 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 120 KiB/s 109 KiB/s 2.22 ms 282.50 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 106 KiB/s 115 KiB/s 1.98 ms 338.75 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 106 KiB/s 108 KiB/s 1.98 ms 309.28 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 84 KiB/s 73 KiB/s 2.21 ms 316.09 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 90 KiB/s 91 KiB/s 2.12 ms 296.67 us 2024-03-25T09:30:15.062 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 3/s 119 KiB/s 94 KiB/s 2.19 ms 509.55 us 2024-03-25T09:30:15.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 106 KiB/s 107 KiB/s 2.14 ms 319.85 us 2024-03-25T09:30:15.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 4/s 98 KiB/s 124 KiB/s 2.25 ms 421.58 us 2024-03-25T09:30:15.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 5/s 90 KiB/s 130 KiB/s 2.22 ms 278.71 us 2024-03-25T09:30:15.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 5/s 100 KiB/s 138 KiB/s 2.43 ms 298.15 us 2024-03-25T09:30:15.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 6/s 86 KiB/s 130 KiB/s 2.00 ms 344.10 us 2024-03-25T09:30:15.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 5/s 68 KiB/s 152 KiB/s 2.08 ms 340.14 us 2024-03-25T09:30:15.063 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:15 smithi019 ceph-mon[29386]: pgmap v636: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.1 MiB/s wr, 545 op/s 2024-03-25T09:30:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:15 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 527 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:15.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:15.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:15.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:15 smithi059 ceph-mon[32732]: pgmap v636: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.1 MiB/s wr, 545 op/s 2024-03-25T09:30:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:15 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 527 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:16.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:15 smithi040 ceph-mon[33094]: pgmap v636: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.1 MiB/s wr, 545 op/s 2024-03-25T09:30:16.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:15 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 527 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:16.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:16.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:16.850 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:16 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:16 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:16 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:16 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:16 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:16 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:17.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:16 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:16 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:16 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:16 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:16 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:16 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:16 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:17.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:16 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:16 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:16 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:16 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:16 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:16 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:16 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:16 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:17.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:17 smithi019 ceph-mon[29386]: pgmap v637: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.7 MiB/s wr, 611 op/s 2024-03-25T09:30:17.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:17.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:17.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:18.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:17.808+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:18.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:17 smithi059 ceph-mon[32732]: pgmap v637: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.7 MiB/s wr, 611 op/s 2024-03-25T09:30:18.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:17 smithi040 ceph-mon[33094]: pgmap v637: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.7 MiB/s wr, 611 op/s 2024-03-25T09:30:19.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:19.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:19.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:19.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:30:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 88.0k 94.8k 0.0k 880.0k 948.0k 0.0k nvme2n1 2024-03-25T09:30:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 91.2k 78.8k 0.0k 912.0k 788.0k 0.0k nvme2n10 2024-03-25T09:30:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 106.0k 107.2k 0.0k 1.0M 1.0M 0.0k nvme2n11 2024-03-25T09:30:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 103.2k 114.0k 0.0k 1.0M 1.1M 0.0k nvme2n12 2024-03-25T09:30:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 96.0k 102.4k 0.0k 960.0k 1.0M 0.0k nvme2n13 2024-03-25T09:30:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 118.8k 99.2k 0.0k 1.2M 992.0k 0.0k nvme2n14 2024-03-25T09:30:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 113.2k 97.2k 0.0k 1.1M 972.0k 0.0k nvme2n15 2024-03-25T09:30:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 90.8k 104.8k 0.0k 908.0k 1.0M 0.0k nvme2n16 2024-03-25T09:30:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 110.8k 88.8k 0.0k 1.1M 888.0k 0.0k nvme2n17 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 113.6k 108.4k 0.0k 1.1M 1.1M 0.0k nvme2n18 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 106.8k 119.2k 0.0k 1.0M 1.2M 0.0k nvme2n19 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 101.6k 102.8k 0.0k 1016.0k 1.0M 0.0k nvme2n2 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 93.6k 83.2k 0.0k 936.0k 832.0k 0.0k nvme2n20 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 72.4k 111.2k 0.0k 724.0k 1.1M 0.0k nvme2n3 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 92.0k 90.0k 0.0k 920.0k 900.0k 0.0k nvme2n4 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 107.6k 84.4k 0.0k 1.1M 844.0k 0.0k nvme2n5 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 80.8k 90.0k 0.0k 808.0k 900.0k 0.0k nvme2n6 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 86.4k 114.4k 0.0k 864.0k 1.1M 0.0k nvme2n7 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 122.0k 78.4k 0.0k 1.2M 784.0k 0.0k nvme2n8 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 121.2k 64.0k 0.0k 1.2M 640.0k 0.0k nvme2n9 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 93.6k 83.6k 0.0k 936.0k 836.0k 0.0k nvme5n1 2024-03-25T09:30:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 78.0k 88.8k 0.0k 780.0k 888.0k 0.0k nvme5n10 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 112.0k 94.8k 0.0k 1.1M 948.0k 0.0k nvme5n11 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 96.4k 112.0k 0.0k 964.0k 1.1M 0.0k nvme5n12 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 97.6k 104.0k 0.0k 976.0k 1.0M 0.0k nvme5n13 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 117.6k 120.8k 0.0k 1.1M 1.2M 0.0k nvme5n14 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 107.2k 105.2k 0.0k 1.0M 1.0M 0.0k nvme5n15 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 79.6k 120.8k 0.0k 796.0k 1.2M 0.0k nvme5n16 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 88.4k 113.2k 0.0k 884.0k 1.1M 0.0k nvme5n17 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 103.6k 88.4k 0.0k 1.0M 884.0k 0.0k nvme5n18 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 115.2k 92.8k 0.0k 1.1M 928.0k 0.0k nvme5n19 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 118.4k 91.2k 0.0k 1.2M 912.0k 0.0k nvme5n2 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 109.6k 105.6k 0.0k 1.1M 1.0M 0.0k nvme5n20 2024-03-25T09:30:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 114.4k 93.2k 0.0k 1.1M 932.0k 0.0k nvme5n3 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 99.2k 114.0k 0.0k 992.0k 1.1M 0.0k nvme5n4 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 90.0k 110.8k 0.0k 900.0k 1.1M 0.0k nvme5n5 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 103.2k 89.6k 0.0k 1.0M 896.0k 0.0k nvme5n6 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 89.6k 96.4k 0.0k 896.0k 964.0k 0.0k nvme5n7 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 110.8k 97.6k 0.0k 1.1M 976.0k 0.0k nvme5n8 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 74.0k 130.8k 0.0k 740.0k 1.3M 0.0k nvme5n9 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 89.6k 101.6k 0.0k 896.0k 1016.0k 0.0k nvme8n1 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 81.2k 103.2k 0.0k 812.0k 1.0M 0.0k nvme8n10 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 70.8k 112.0k 0.0k 708.0k 1.1M 0.0k nvme8n11 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 76.4k 94.4k 0.0k 764.0k 944.0k 0.0k nvme8n12 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 94.0k 80.8k 0.0k 940.0k 808.0k 0.0k nvme8n13 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 66.4k 92.4k 0.0k 664.0k 924.0k 0.0k nvme8n14 2024-03-25T09:30:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 100.0k 105.2k 0.0k 1000.0k 1.0M 0.0k nvme8n15 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 112.0k 78.8k 0.0k 1.1M 788.0k 0.0k nvme8n16 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 110.8k 97.2k 0.0k 1.1M 972.0k 0.0k nvme8n17 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 113.6k 76.0k 0.0k 1.1M 760.0k 0.0k nvme8n18 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 87.6k 107.6k 0.0k 876.0k 1.1M 0.0k nvme8n19 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 124.0k 84.8k 0.0k 1.2M 848.0k 0.0k nvme8n2 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 101.6k 81.2k 0.0k 1016.0k 812.0k 0.0k nvme8n20 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 85.6k 120.4k 0.0k 856.0k 1.2M 0.0k nvme8n3 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 125.6k 90.8k 0.0k 1.2M 908.0k 0.0k nvme8n4 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 116.0k 64.0k 0.0k 1.1M 640.0k 0.0k nvme8n5 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 78.8k 119.6k 0.0k 788.0k 1.2M 0.0k nvme8n6 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 71.2k 120.4k 0.0k 712.0k 1.2M 0.0k nvme8n7 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 102.8k 68.4k 0.0k 1.0M 684.0k 0.0k nvme8n8 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 114.0k 112.8k 0.0k 1.1M 1.1M 0.0k nvme8n9 2024-03-25T09:30:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:19.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:19 smithi019 ceph-mon[29386]: pgmap v638: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.4 MiB/s wr, 496 op/s 2024-03-25T09:30:19.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:19.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:19.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:20.063 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:20.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 7/s 4/s 130 KiB/s 104 KiB/s 2.06 ms 384.66 us 2024-03-25T09:30:20.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 6/s 3/s 115 KiB/s 70 KiB/s 2.17 ms 324.72 us 2024-03-25T09:30:20.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 4/s 141 KiB/s 114 KiB/s 2.06 ms 319.57 us 2024-03-25T09:30:20.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 6/s 2/s 121 KiB/s 42 KiB/s 2.03 ms 309.85 us 2024-03-25T09:30:20.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 3/s 109 KiB/s 103 KiB/s 2.48 ms 402.84 us 2024-03-25T09:30:20.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 3/s 142 KiB/s 62 KiB/s 2.27 ms 397.61 us 2024-03-25T09:30:20.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 4/s 93 KiB/s 125 KiB/s 2.07 ms 378.87 us 2024-03-25T09:30:20.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 4/s 128 KiB/s 90 KiB/s 2.26 ms 421.22 us 2024-03-25T09:30:20.063 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 4/s 135 KiB/s 77 KiB/s 2.06 ms 300.49 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 3/s 122 KiB/s 85 KiB/s 2.18 ms 321.60 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 4/s 94 KiB/s 109 KiB/s 2.19 ms 425.31 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 4/s 82 KiB/s 82 KiB/s 2.12 ms 356.93 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 144 KiB/s 97 KiB/s 2.11 ms 306.48 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 5/s 143 KiB/s 120 KiB/s 2.21 ms 313.43 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 4/s 90 KiB/s 113 KiB/s 2.06 ms 351.91 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 4/s 107 KiB/s 98 KiB/s 2.49 ms 381.64 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 3/s 96 KiB/s 58 KiB/s 1.97 ms 366.63 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 110 KiB/s 102 KiB/s 2.02 ms 326.81 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 4/s 114 KiB/s 99 KiB/s 2.27 ms 347.12 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 4/s 113 KiB/s 88 KiB/s 2.30 ms 320.44 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 4/s 90 KiB/s 92 KiB/s 2.06 ms 359.65 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 106 KiB/s 98 KiB/s 2.41 ms 380.03 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 96 KiB/s 54 KiB/s 2.47 ms 316.49 us 2024-03-25T09:30:20.064 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 107 KiB/s 90 KiB/s 2.28 ms 341.67 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 96 KiB/s 79 KiB/s 2.18 ms 300.59 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 146 KiB/s 71 KiB/s 2.37 ms 406.63 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 3/s 75 KiB/s 74 KiB/s 1.91 ms 447.68 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 5/s 86 KiB/s 143 KiB/s 2.18 ms 335.37 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 6/s 97 KiB/s 138 KiB/s 2.30 ms 365.29 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 100 KiB/s 107 KiB/s 2.34 ms 333.62 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 117 KiB/s 74 KiB/s 2.03 ms 293.03 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 95 KiB/s 62 KiB/s 2.33 ms 316.17 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 4/s 82 KiB/s 108 KiB/s 1.84 ms 324.59 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 120 KiB/s 46 KiB/s 2.61 ms 309.28 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 3/s 80 KiB/s 85 KiB/s 2.29 ms 421.44 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 6/s 91 KiB/s 122 KiB/s 2.11 ms 286.12 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 5/s 85 KiB/s 112 KiB/s 2.31 ms 374.55 us 2024-03-25T09:30:20.065 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 5/s 75 KiB/s 94 KiB/s 2.57 ms 384.51 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 90 KiB/s 109 KiB/s 2.23 ms 348.96 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 3/s 98 KiB/s 95 KiB/s 2.05 ms 367.28 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 5/s 72 KiB/s 101 KiB/s 1.92 ms 304.96 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 5/s 79 KiB/s 125 KiB/s 2.45 ms 395.76 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 5/s 91 KiB/s 114 KiB/s 2.21 ms 302.90 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 6/s 94 KiB/s 140 KiB/s 2.11 ms 440.34 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 82 KiB/s 95 KiB/s 2.10 ms 428.90 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 5/s 74 KiB/s 102 KiB/s 2.06 ms 287.59 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 96 KiB/s 123 KiB/s 2.15 ms 319.65 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 5/s 70 KiB/s 112 KiB/s 2.18 ms 329.23 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 5/s 102 KiB/s 76 KiB/s 2.91 ms 310.32 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 71 KiB/s 82 KiB/s 2.20 ms 322.23 us 2024-03-25T09:30:20.066 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 78 KiB/s 120 KiB/s 2.21 ms 414.05 us 2024-03-25T09:30:20.067 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 4/s 71 KiB/s 76 KiB/s 2.24 ms 369.85 us 2024-03-25T09:30:20.067 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 5/s 72 KiB/s 134 KiB/s 1.94 ms 325.28 us 2024-03-25T09:30:20.067 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 84 KiB/s 94 KiB/s 2.09 ms 351.77 us 2024-03-25T09:30:20.067 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 6/s 68 KiB/s 143 KiB/s 1.93 ms 356.55 us 2024-03-25T09:30:20.067 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 5/s 72 KiB/s 100 KiB/s 2.41 ms 344.40 us 2024-03-25T09:30:20.067 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 5/s 74 KiB/s 96 KiB/s 2.44 ms 302.67 us 2024-03-25T09:30:20.067 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 5/s 71 KiB/s 123 KiB/s 2.40 ms 357.12 us 2024-03-25T09:30:20.067 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 5/s 66 KiB/s 118 KiB/s 1.86 ms 322.65 us 2024-03-25T09:30:20.067 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 2/s 6/s 72 KiB/s 131 KiB/s 2.30 ms 378.74 us 2024-03-25T09:30:20.067 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:20.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:19 smithi059 ceph-mon[32732]: pgmap v638: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.4 MiB/s wr, 496 op/s 2024-03-25T09:30:20.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:19 smithi040 ceph-mon[33094]: pgmap v638: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.4 MiB/s wr, 496 op/s 2024-03-25T09:30:20.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:20.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:20.857 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:21.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:20 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 532 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:20 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 532 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:20 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 532 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:21.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:21.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-mon[29386]: pgmap v639: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 619 op/s 2024-03-25T09:30:21.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:21.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:21.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:21 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:21 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:21 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:21 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:21 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:21 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:21 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:21 smithi059 ceph-mon[32732]: pgmap v639: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 619 op/s 2024-03-25T09:30:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:21 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:21 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:21 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:21 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:21 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:21 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:21 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:21 smithi040 ceph-mon[33094]: pgmap v639: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 619 op/s 2024-03-25T09:30:23.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:23.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:23.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:22.808+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:24.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:23 smithi019 ceph-mon[29386]: pgmap v640: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 541 op/s 2024-03-25T09:30:24.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:24.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:24.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:24.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:23 smithi059 ceph-mon[32732]: pgmap v640: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 541 op/s 2024-03-25T09:30:24.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:23 smithi040 ceph-mon[33094]: pgmap v640: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 541 op/s 2024-03-25T09:30:25.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:25.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:25.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:25.068 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:25.068 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 4/s 154 KiB/s 87 KiB/s 2.17 ms 305.08 us 2024-03-25T09:30:25.068 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 4/s 115 KiB/s 100 KiB/s 2.24 ms 313.56 us 2024-03-25T09:30:25.068 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 4/s 94 KiB/s 94 KiB/s 2.91 ms 396.60 us 2024-03-25T09:30:25.068 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 3/s 125 KiB/s 63 KiB/s 2.49 ms 352.77 us 2024-03-25T09:30:25.068 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 4/s 113 KiB/s 104 KiB/s 2.26 ms 330.20 us 2024-03-25T09:30:25.068 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 4/s 124 KiB/s 98 KiB/s 2.10 ms 334.83 us 2024-03-25T09:30:25.068 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 4/s 150 KiB/s 101 KiB/s 2.23 ms 365.59 us 2024-03-25T09:30:25.068 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 4/s 122 KiB/s 81 KiB/s 2.48 ms 272.11 us 2024-03-25T09:30:25.068 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 4/s 91 KiB/s 100 KiB/s 2.39 ms 339.73 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 4/s 110 KiB/s 98 KiB/s 2.32 ms 348.63 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 3/s 106 KiB/s 87 KiB/s 2.30 ms 311.70 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 3/s 123 KiB/s 73 KiB/s 2.11 ms 307.80 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 3/s 95 KiB/s 82 KiB/s 2.19 ms 425.14 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 90 KiB/s 71 KiB/s 2.20 ms 302.55 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 5/s 106 KiB/s 134 KiB/s 2.25 ms 312.58 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 89 KiB/s 132 KiB/s 2.30 ms 321.58 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 5/s 105 KiB/s 114 KiB/s 2.42 ms 332.58 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 3/s 114 KiB/s 79 KiB/s 2.20 ms 360.51 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 5/s 107 KiB/s 113 KiB/s 2.26 ms 371.04 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 5/s 108 KiB/s 136 KiB/s 2.10 ms 425.55 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 4/s 102 KiB/s 67 KiB/s 2.00 ms 296.05 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 80 KiB/s 106 KiB/s 2.01 ms 479.30 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 70 KiB/s 108 KiB/s 2.47 ms 347.87 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 4/s 106 KiB/s 98 KiB/s 1.97 ms 414.04 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 77 KiB/s 90 KiB/s 2.05 ms 369.89 us 2024-03-25T09:30:25.069 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 4/s 108 KiB/s 94 KiB/s 2.33 ms 350.80 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 5/s 80 KiB/s 132 KiB/s 2.01 ms 319.01 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 3/s 73 KiB/s 38 KiB/s 1.91 ms 293.92 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 5/s 107 KiB/s 95 KiB/s 2.00 ms 417.95 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 5/s 98 KiB/s 82 KiB/s 2.32 ms 338.41 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 102 KiB/s 114 KiB/s 2.18 ms 361.38 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 92 KiB/s 75 KiB/s 1.98 ms 297.37 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 109 KiB/s 130 KiB/s 2.03 ms 306.87 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 95 KiB/s 119 KiB/s 2.20 ms 311.27 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 102 KiB/s 112 KiB/s 2.24 ms 349.51 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 5/s 100 KiB/s 106 KiB/s 2.30 ms 375.35 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 89 KiB/s 103 KiB/s 2.09 ms 302.82 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 5/s 123 KiB/s 151 KiB/s 2.29 ms 458.33 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 58 KiB/s 86 KiB/s 2.44 ms 318.26 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 5/s 110 KiB/s 123 KiB/s 2.24 ms 394.23 us 2024-03-25T09:30:25.070 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 5/s 84 KiB/s 106 KiB/s 2.26 ms 361.42 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 106 KiB/s 99 KiB/s 2.53 ms 422.77 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 99 KiB/s 113 KiB/s 2.54 ms 349.12 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 3/s 99 KiB/s 79 KiB/s 2.02 ms 280.43 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 6/s 72 KiB/s 149 KiB/s 2.39 ms 332.52 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 98 KiB/s 95 KiB/s 2.18 ms 335.12 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 4/s 72 KiB/s 91 KiB/s 2.09 ms 298.74 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 6/s 68 KiB/s 108 KiB/s 2.24 ms 345.08 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 5/s 90 KiB/s 108 KiB/s 2.06 ms 427.30 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 6/s 55 KiB/s 129 KiB/s 2.07 ms 343.26 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 5/s 80 KiB/s 86 KiB/s 2.48 ms 324.46 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 3/s 64 KiB/s 69 KiB/s 2.08 ms 290.18 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 5/s 62 KiB/s 108 KiB/s 2.52 ms 409.40 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 6/s 74 KiB/s 158 KiB/s 2.55 ms 327.89 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 5/s 64 KiB/s 75 KiB/s 2.34 ms 410.37 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 5/s 68 KiB/s 106 KiB/s 2.20 ms 309.86 us 2024-03-25T09:30:25.071 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 4/s 78 KiB/s 108 KiB/s 1.99 ms 300.71 us 2024-03-25T09:30:25.072 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 6/s 42 KiB/s 102 KiB/s 2.08 ms 414.05 us 2024-03-25T09:30:25.072 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 4/s 56 KiB/s 102 KiB/s 1.87 ms 273.77 us 2024-03-25T09:30:25.072 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 2/s 5/s 49 KiB/s 90 KiB/s 2.07 ms 300.87 us 2024-03-25T09:30:25.072 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:26.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:25 smithi019 ceph-mon[29386]: pgmap v641: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 528 op/s 2024-03-25T09:30:26.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:25 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 537 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:26.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:26.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:26.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:25 smithi059 ceph-mon[32732]: pgmap v641: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 528 op/s 2024-03-25T09:30:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:25 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 537 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:26.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:25 smithi040 ceph-mon[33094]: pgmap v641: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 528 op/s 2024-03-25T09:30:26.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:25 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 537 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:26 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:26 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:26 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:26 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:26 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:27.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:26 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:27.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:26 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:27.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:27.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:27.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:27.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:26 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:27.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:26 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:27.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:26 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:27.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:26 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:27.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:26 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:27.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:26 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:27.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:26 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:26 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:26 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:26 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:26 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:26 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:26 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:26 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:28.060 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:27 smithi019 ceph-mon[29386]: pgmap v642: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 596 op/s 2024-03-25T09:30:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:28.061 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:28.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:27.808+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:28.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:27 smithi059 ceph-mon[32732]: pgmap v642: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 596 op/s 2024-03-25T09:30:28.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:27 smithi040 ceph-mon[33094]: pgmap v642: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 596 op/s 2024-03-25T09:30:29.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:29.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:29.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:29.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:30:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 70.0k 100.0k 0.0k 700.0k 1000.0k 0.0k nvme2n1 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 79.6k 106.4k 0.0k 796.0k 1.0M 0.0k nvme2n10 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 79.2k 98.0k 0.0k 792.0k 980.0k 0.0k nvme2n11 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 103.2k 86.4k 0.0k 1.0M 864.0k 0.0k nvme2n12 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 116.8k 90.0k 0.0k 1.1M 900.0k 0.0k nvme2n13 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 86.4k 120.4k 0.0k 864.0k 1.2M 0.0k nvme2n14 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 91.6k 74.4k 0.0k 916.0k 744.0k 0.0k nvme2n15 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 88.4k 87.6k 0.0k 884.0k 876.0k 0.0k nvme2n16 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 85.6k 98.8k 0.0k 856.0k 988.0k 0.0k nvme2n17 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 98.0k 93.6k 0.0k 980.0k 936.0k 0.0k nvme2n18 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 79.2k 117.2k 0.0k 792.0k 1.1M 0.0k nvme2n19 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 90.4k 92.8k 0.0k 904.0k 928.0k 0.0k nvme2n2 2024-03-25T09:30:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 61.2k 83.2k 0.0k 612.0k 832.0k 0.0k nvme2n20 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 80.4k 105.6k 0.0k 804.0k 1.0M 0.0k nvme2n3 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 77.2k 107.2k 0.0k 772.0k 1.0M 0.0k nvme2n4 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 90.0k 97.2k 0.0k 900.0k 972.0k 0.0k nvme2n5 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 100.8k 70.4k 0.0k 1008.0k 704.0k 0.0k nvme2n6 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 84.8k 83.2k 0.0k 848.0k 832.0k 0.0k nvme2n7 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 82.4k 77.2k 0.0k 824.0k 772.0k 0.0k nvme2n8 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 86.4k 86.8k 0.0k 864.0k 868.0k 0.0k nvme2n9 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 88.8k 88.0k 0.0k 888.0k 880.0k 0.0k nvme5n1 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 101.2k 77.2k 0.0k 1012.0k 772.0k 0.0k nvme5n10 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 85.2k 109.2k 0.0k 852.0k 1.1M 0.0k nvme5n11 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 89.6k 88.0k 0.0k 896.0k 880.0k 0.0k nvme5n12 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 90.8k 91.2k 0.0k 908.0k 912.0k 0.0k nvme5n13 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 93.6k 107.6k 0.0k 936.0k 1.1M 0.0k nvme5n14 2024-03-25T09:30:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 110.8k 75.2k 0.0k 1.1M 752.0k 0.0k nvme5n15 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 89.6k 75.2k 0.0k 896.0k 752.0k 0.0k nvme5n16 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 96.0k 89.2k 0.0k 960.0k 892.0k 0.0k nvme5n17 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 85.6k 110.0k 0.0k 856.0k 1.1M 0.0k nvme5n18 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 96.0k 78.4k 0.0k 960.0k 784.0k 0.0k nvme5n19 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 106.0k 84.8k 0.0k 1.0M 848.0k 0.0k nvme5n2 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 110.8k 108.4k 0.0k 1.1M 1.1M 0.0k nvme5n20 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 98.4k 100.8k 0.0k 984.0k 1008.0k 0.0k nvme5n3 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 102.8k 129.2k 0.0k 1.0M 1.3M 0.0k nvme5n4 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 78.8k 101.2k 0.0k 788.0k 1012.0k 0.0k nvme5n5 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 107.2k 81.6k 0.0k 1.0M 816.0k 0.0k nvme5n6 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 103.2k 74.8k 0.0k 1.0M 748.0k 0.0k nvme5n7 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 101.6k 104.4k 0.0k 1016.0k 1.0M 0.0k nvme5n8 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 78.4k 87.6k 0.0k 784.0k 876.0k 0.0k nvme5n9 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 74.0k 102.0k 0.0k 740.0k 1020.0k 0.0k nvme8n1 2024-03-25T09:30:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 87.2k 92.8k 0.0k 872.0k 928.0k 0.0k nvme8n10 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 88.4k 84.8k 0.0k 884.0k 848.0k 0.0k nvme8n11 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 96.8k 96.8k 0.0k 968.0k 968.0k 0.0k nvme8n12 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 91.6k 82.8k 0.0k 916.0k 828.0k 0.0k nvme8n13 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 91.2k 97.2k 0.0k 912.0k 972.0k 0.0k nvme8n14 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 76.4k 116.0k 0.0k 764.0k 1.1M 0.0k nvme8n15 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 108.0k 80.4k 0.0k 1.1M 804.0k 0.0k nvme8n16 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 91.2k 85.6k 0.0k 912.0k 856.0k 0.0k nvme8n17 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 91.6k 78.4k 0.0k 916.0k 784.0k 0.0k nvme8n18 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 80.0k 110.0k 0.0k 800.0k 1.1M 0.0k nvme8n19 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 91.2k 86.4k 0.0k 912.0k 864.0k 0.0k nvme8n2 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 85.2k 70.4k 0.0k 852.0k 704.0k 0.0k nvme8n20 2024-03-25T09:30:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 104.8k 94.0k 0.0k 1.0M 940.0k 0.0k nvme8n3 2024-03-25T09:30:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 94.8k 89.6k 0.0k 948.0k 896.0k 0.0k nvme8n4 2024-03-25T09:30:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 83.2k 103.6k 0.0k 832.0k 1.0M 0.0k nvme8n5 2024-03-25T09:30:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 93.6k 102.8k 0.0k 936.0k 1.0M 0.0k nvme8n6 2024-03-25T09:30:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 92.4k 82.4k 0.0k 924.0k 824.0k 0.0k nvme8n7 2024-03-25T09:30:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 78.4k 78.0k 0.0k 784.0k 780.0k 0.0k nvme8n8 2024-03-25T09:30:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 9.10 98.4k 65.6k 0.0k 984.0k 656.0k 0.0k nvme8n9 2024-03-25T09:30:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:30.072 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:30.072 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 6/s 4/s 114 KiB/s 82 KiB/s 2.09 ms 301.55 us 2024-03-25T09:30:30.072 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 4/s 127 KiB/s 115 KiB/s 2.18 ms 500.77 us 2024-03-25T09:30:30.072 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 4/s 107 KiB/s 78 KiB/s 2.24 ms 278.71 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 4/s 132 KiB/s 90 KiB/s 2.16 ms 431.31 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 3/s 122 KiB/s 87 KiB/s 2.42 ms 327.49 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 3/s 104 KiB/s 88 KiB/s 2.47 ms 351.20 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 3/s 114 KiB/s 79 KiB/s 1.95 ms 323.04 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 5/s 108 KiB/s 98 KiB/s 2.09 ms 355.62 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 4/s 110 KiB/s 70 KiB/s 2.06 ms 276.32 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 5/s 108 KiB/s 122 KiB/s 2.27 ms 313.51 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 4/s 109 KiB/s 96 KiB/s 2.09 ms 339.89 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 3/s 119 KiB/s 60 KiB/s 2.30 ms 276.73 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 4/s 115 KiB/s 65 KiB/s 2.67 ms 377.27 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 3/s 98 KiB/s 59 KiB/s 2.08 ms 501.15 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 4/s 108 KiB/s 75 KiB/s 2.30 ms 330.77 us 2024-03-25T09:30:30.073 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 3/s 92 KiB/s 61 KiB/s 2.30 ms 294.25 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 4/s 113 KiB/s 54 KiB/s 2.17 ms 364.93 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 4/s 86 KiB/s 68 KiB/s 2.31 ms 398.36 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 3/s 91 KiB/s 60 KiB/s 2.00 ms 452.54 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 3/s 99 KiB/s 62 KiB/s 2.29 ms 275.78 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 4/s 83 KiB/s 88 KiB/s 2.06 ms 314.18 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 5/s 105 KiB/s 106 KiB/s 2.15 ms 339.63 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 134 KiB/s 114 KiB/s 2.13 ms 345.83 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 5/s 118 KiB/s 105 KiB/s 2.08 ms 287.79 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 86 KiB/s 93 KiB/s 2.36 ms 346.51 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 82 KiB/s 106 KiB/s 2.19 ms 354.19 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 101 KiB/s 61 KiB/s 2.36 ms 396.72 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 5/s 70 KiB/s 84 KiB/s 2.43 ms 334.96 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 4/s 103 KiB/s 73 KiB/s 2.11 ms 369.16 us 2024-03-25T09:30:30.074 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 5/s 91 KiB/s 88 KiB/s 2.19 ms 335.82 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 102 KiB/s 101 KiB/s 2.22 ms 372.98 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 5/s 85 KiB/s 100 KiB/s 2.18 ms 306.84 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 5/s 90 KiB/s 93 KiB/s 2.61 ms 314.66 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 5/s 102 KiB/s 98 KiB/s 2.19 ms 320.83 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 66 KiB/s 97 KiB/s 2.29 ms 373.29 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 5/s 76 KiB/s 104 KiB/s 1.90 ms 310.23 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 82 KiB/s 109 KiB/s 2.17 ms 378.80 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 90 KiB/s 85 KiB/s 1.97 ms 294.06 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 84 KiB/s 87 KiB/s 2.47 ms 382.78 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 86 KiB/s 62 KiB/s 2.44 ms 318.80 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 5/s 94 KiB/s 98 KiB/s 2.10 ms 308.64 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 5/s 97 KiB/s 106 KiB/s 2.46 ms 284.31 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 4/s 91 KiB/s 106 KiB/s 2.05 ms 312.47 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 110 KiB/s 97 KiB/s 2.34 ms 324.96 us 2024-03-25T09:30:30.075 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 74 KiB/s 107 KiB/s 2.12 ms 355.57 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 5/s 67 KiB/s 76 KiB/s 1.96 ms 297.80 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 5/s 68 KiB/s 119 KiB/s 2.49 ms 346.15 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 5/s 76 KiB/s 110 KiB/s 1.99 ms 282.12 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 5/s 92 KiB/s 89 KiB/s 2.23 ms 367.78 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 78 KiB/s 104 KiB/s 2.25 ms 370.34 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 5/s 96 KiB/s 91 KiB/s 2.12 ms 313.22 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 5/s 106 KiB/s 125 KiB/s 2.55 ms 334.27 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 3/s 79 KiB/s 65 KiB/s 2.20 ms 492.07 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 58 KiB/s 90 KiB/s 3.11 ms 320.75 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 6/s 66 KiB/s 144 KiB/s 2.13 ms 408.37 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 5/s 74 KiB/s 126 KiB/s 2.46 ms 345.91 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 4/s 82 KiB/s 90 KiB/s 1.94 ms 318.76 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 5/s 97 KiB/s 113 KiB/s 2.09 ms 317.24 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 5/s 93 KiB/s 94 KiB/s 2.01 ms 361.94 us 2024-03-25T09:30:30.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 5/s 66 KiB/s 84 KiB/s 2.25 ms 301.28 us 2024-03-25T09:30:30.077 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:30.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:29 smithi019 ceph-mon[29386]: pgmap v643: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 488 op/s 2024-03-25T09:30:30.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:30.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:30.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:30.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:29 smithi059 ceph-mon[32732]: pgmap v643: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 488 op/s 2024-03-25T09:30:30.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:29 smithi040 ceph-mon[33094]: pgmap v643: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 488 op/s 2024-03-25T09:30:31.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:30 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 542 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:31.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:31.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:31.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:31.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:30 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 542 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:30 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 542 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:31 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:31 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:31 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:32.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:31 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:32.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:31 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:32.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:31 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:32.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:31 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:32.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:31 smithi040 ceph-mon[33094]: pgmap v644: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 614 op/s 2024-03-25T09:30:32.062 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:32.062 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:32.062 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:32.062 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:32.062 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:32.062 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:32.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:32.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:32.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-mon[29386]: pgmap v644: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 614 op/s 2024-03-25T09:30:32.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:32.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:32.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:31 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:32.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:31 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:32.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:31 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:32.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:31 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:32.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:31 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:32.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:31 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:32.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:31 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:32.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:31 smithi059 ceph-mon[32732]: pgmap v644: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 614 op/s 2024-03-25T09:30:33.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:33.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:33.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:32.808+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:34.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:33 smithi019 ceph-mon[29386]: pgmap v645: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 540 op/s 2024-03-25T09:30:34.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:34.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:34.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:34.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:33 smithi059 ceph-mon[32732]: pgmap v645: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 540 op/s 2024-03-25T09:30:34.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:33 smithi040 ceph-mon[33094]: pgmap v645: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 540 op/s 2024-03-25T09:30:35.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:35.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:35.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:35.076 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:35.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 6/s 4/s 123 KiB/s 66 KiB/s 2.43 ms 310.87 us 2024-03-25T09:30:35.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 3/s 149 KiB/s 45 KiB/s 2.25 ms 444.18 us 2024-03-25T09:30:35.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 3/s 114 KiB/s 61 KiB/s 2.29 ms 326.19 us 2024-03-25T09:30:35.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 3/s 109 KiB/s 64 KiB/s 2.05 ms 327.60 us 2024-03-25T09:30:35.076 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 6/s 85 KiB/s 107 KiB/s 1.94 ms 296.15 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 3/s 128 KiB/s 91 KiB/s 2.09 ms 306.61 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 4/s 103 KiB/s 81 KiB/s 2.08 ms 286.39 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 4/s 127 KiB/s 116 KiB/s 2.19 ms 514.85 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 4/s 110 KiB/s 94 KiB/s 2.27 ms 303.81 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 3/s 90 KiB/s 82 KiB/s 2.52 ms 338.29 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 5/s 95 KiB/s 83 KiB/s 1.96 ms 374.08 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 90 KiB/s 80 KiB/s 2.16 ms 387.16 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 102 KiB/s 74 KiB/s 1.89 ms 290.19 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 4/s 102 KiB/s 68 KiB/s 2.14 ms 280.41 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 4/s 103 KiB/s 87 KiB/s 2.27 ms 322.66 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 85 KiB/s 79 KiB/s 2.13 ms 329.13 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 5/s 114 KiB/s 118 KiB/s 2.25 ms 304.24 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 4/s 105 KiB/s 83 KiB/s 2.26 ms 308.86 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 4/s 78 KiB/s 90 KiB/s 2.31 ms 390.28 us 2024-03-25T09:30:35.077 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 4/s 87 KiB/s 69 KiB/s 2.33 ms 289.61 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 4/s 90 KiB/s 90 KiB/s 2.43 ms 348.58 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 5/s 90 KiB/s 116 KiB/s 2.75 ms 321.98 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 106 KiB/s 125 KiB/s 1.95 ms 293.30 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 106 KiB/s 90 KiB/s 2.02 ms 303.08 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 120 KiB/s 89 KiB/s 2.24 ms 310.66 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 106 KiB/s 95 KiB/s 2.29 ms 385.21 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 102 KiB/s 94 KiB/s 2.22 ms 322.99 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 4/s 101 KiB/s 70 KiB/s 2.02 ms 269.89 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 86 KiB/s 63 KiB/s 2.16 ms 277.68 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 74 KiB/s 101 KiB/s 2.34 ms 389.18 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 3/s 101 KiB/s 95 KiB/s 2.11 ms 318.55 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 5/s 93 KiB/s 112 KiB/s 1.98 ms 356.77 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 56 KiB/s 92 KiB/s 2.19 ms 353.84 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 3/s 108 KiB/s 91 KiB/s 2.05 ms 249.74 us 2024-03-25T09:30:35.078 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 5/s 77 KiB/s 102 KiB/s 2.40 ms 380.94 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 83 KiB/s 106 KiB/s 2.29 ms 386.24 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 5/s 94 KiB/s 97 KiB/s 2.02 ms 283.50 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 5/s 106 KiB/s 107 KiB/s 2.12 ms 388.36 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 5/s 102 KiB/s 113 KiB/s 2.19 ms 336.44 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 5/s 98 KiB/s 90 KiB/s 2.04 ms 379.28 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 103 KiB/s 69 KiB/s 2.26 ms 275.03 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 97 KiB/s 83 KiB/s 2.20 ms 302.12 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 5/s 95 KiB/s 119 KiB/s 2.25 ms 348.50 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 3/s 55 KiB/s 89 KiB/s 2.69 ms 312.83 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 74 KiB/s 55 KiB/s 2.31 ms 306.12 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 76 KiB/s 66 KiB/s 2.26 ms 332.69 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 5/s 91 KiB/s 130 KiB/s 2.23 ms 409.96 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 79 KiB/s 90 KiB/s 2.65 ms 307.29 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 78 KiB/s 99 KiB/s 2.31 ms 495.55 us 2024-03-25T09:30:35.079 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 2/s 66 KiB/s 51 KiB/s 2.05 ms 274.18 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 91 KiB/s 61 KiB/s 2.57 ms 323.18 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 5/s 88 KiB/s 84 KiB/s 2.63 ms 306.93 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 58 KiB/s 82 KiB/s 2.55 ms 445.80 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 5/s 76 KiB/s 69 KiB/s 2.14 ms 314.45 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 93 KiB/s 64 KiB/s 2.27 ms 297.53 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 5/s 50 KiB/s 100 KiB/s 2.06 ms 294.92 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 71 KiB/s 74 KiB/s 2.44 ms 333.45 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 5/s 65 KiB/s 110 KiB/s 2.41 ms 304.81 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 4/s 80 KiB/s 100 KiB/s 2.22 ms 325.47 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 2/s 5/s 63 KiB/s 103 KiB/s 2.13 ms 293.57 us 2024-03-25T09:30:35.080 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:35 smithi019 ceph-mon[29386]: pgmap v646: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 529 op/s 2024-03-25T09:30:36.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:35 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 547 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:36.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:36.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:36.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:35 smithi059 ceph-mon[32732]: pgmap v646: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 529 op/s 2024-03-25T09:30:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:35 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 547 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:35 smithi040 ceph-mon[33094]: pgmap v646: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 529 op/s 2024-03-25T09:30:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:35 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 547 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:37.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:37.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:37.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:37.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:37.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:37.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:37.014 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:30:37.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:37.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:37.015 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:36 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:36 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:36 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:36 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:37.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:36 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:36 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:36 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:37.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:36 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:30:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:36 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:36 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:36 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:36 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:36 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:36 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:36 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:36 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:30:38.059 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:37 smithi019 ceph-mon[29386]: pgmap v647: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.9 MiB/s wr, 601 op/s 2024-03-25T09:30:38.059 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:37 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:30:38.059 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:37 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:30:38.059 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:37 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:30:38.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:38.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:38.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:37.809+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:37 smithi059 ceph-mon[32732]: pgmap v647: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.9 MiB/s wr, 601 op/s 2024-03-25T09:30:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:37 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:30:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:37 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:30:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:37 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:30:38.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:37 smithi040 ceph-mon[33094]: pgmap v647: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.9 MiB/s wr, 601 op/s 2024-03-25T09:30:38.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:37 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:30:38.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:37 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:30:38.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:37 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:30:39.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:38 smithi040 ceph-mon[33094]: pgmap v648: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-03-25T09:30:39.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:38 smithi040 ceph-mon[33094]: pgmap v649: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 619 op/s 2024-03-25T09:30:39.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:39.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:39.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:39.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:38 smithi019 ceph-mon[29386]: pgmap v648: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-03-25T09:30:39.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:38 smithi019 ceph-mon[29386]: pgmap v649: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 619 op/s 2024-03-25T09:30:39.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:38 smithi059 ceph-mon[32732]: pgmap v648: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-03-25T09:30:39.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:38 smithi059 ceph-mon[32732]: pgmap v649: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 619 op/s 2024-03-25T09:30:39.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:39.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:30:39.680 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 137.2k 103.2k 0.0k 1.3M 1.0M 0.0k nvme2n1 2024-03-25T09:30:39.680 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 92.8k 106.8k 0.0k 928.0k 1.0M 0.0k nvme2n10 2024-03-25T09:30:39.680 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 96.4k 98.4k 0.0k 964.0k 984.0k 0.0k nvme2n11 2024-03-25T09:30:39.680 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 88.4k 111.6k 0.0k 884.0k 1.1M 0.0k nvme2n12 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 89.2k 142.0k 0.0k 892.0k 1.4M 0.0k nvme2n13 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 94.4k 66.8k 0.0k 944.0k 668.0k 0.0k nvme2n14 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 81.2k 105.2k 0.0k 812.0k 1.0M 0.0k nvme2n15 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 83.2k 84.4k 0.0k 832.0k 844.0k 0.0k nvme2n16 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 116.4k 69.2k 0.0k 1.1M 692.0k 0.0k nvme2n17 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 92.0k 122.8k 0.0k 920.0k 1.2M 0.0k nvme2n18 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 119.6k 82.0k 0.0k 1.2M 820.0k 0.0k nvme2n19 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 82.4k 89.2k 0.0k 824.0k 892.0k 0.0k nvme2n2 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 154.0k 127.6k 0.0k 1.5M 1.2M 0.0k nvme2n20 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 102.0k 91.2k 0.0k 1020.0k 912.0k 0.0k nvme2n3 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 132.4k 108.4k 0.0k 1.3M 1.1M 0.0k nvme2n4 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 84.4k 75.6k 0.0k 844.0k 756.0k 0.0k nvme2n5 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 112.8k 119.6k 0.0k 1.1M 1.2M 0.0k nvme2n6 2024-03-25T09:30:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 144.4k 127.2k 0.0k 1.4M 1.2M 0.0k nvme2n7 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 74.0k 79.6k 0.0k 740.0k 796.0k 0.0k nvme2n8 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 85.2k 83.2k 0.0k 852.0k 832.0k 0.0k nvme2n9 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 114.4k 132.0k 0.0k 1.1M 1.3M 0.0k nvme5n1 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 83.2k 93.2k 0.0k 832.0k 932.0k 0.0k nvme5n10 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 85.6k 89.6k 0.0k 856.0k 896.0k 0.0k nvme5n11 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 96.0k 96.4k 0.0k 960.0k 964.0k 0.0k nvme5n12 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 98.0k 87.6k 0.0k 980.0k 876.0k 0.0k nvme5n13 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 94.4k 104.8k 0.0k 944.0k 1.0M 0.0k nvme5n14 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 90.4k 102.0k 0.0k 904.0k 1020.0k 0.0k nvme5n15 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 80.0k 98.4k 0.0k 800.0k 984.0k 0.0k nvme5n16 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 102.8k 125.2k 0.0k 1.0M 1.2M 0.0k nvme5n17 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 74.4k 92.4k 0.0k 744.0k 924.0k 0.0k nvme5n18 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 84.4k 86.8k 0.0k 844.0k 868.0k 0.0k nvme5n19 2024-03-25T09:30:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 96.0k 123.6k 0.0k 960.0k 1.2M 0.0k nvme5n2 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 75.6k 98.0k 0.0k 756.0k 980.0k 0.0k nvme5n20 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 102.8k 88.0k 0.0k 1.0M 880.0k 0.0k nvme5n3 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 83.2k 108.4k 0.0k 832.0k 1.1M 0.0k nvme5n4 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 88.0k 78.0k 0.0k 880.0k 780.0k 0.0k nvme5n5 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 98.8k 75.6k 0.0k 988.0k 756.0k 0.0k nvme5n6 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 120.4k 118.4k 0.0k 1.2M 1.2M 0.0k nvme5n7 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 105.6k 72.0k 0.0k 1.0M 720.0k 0.0k nvme5n8 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 109.6k 86.8k 0.0k 1.1M 868.0k 0.0k nvme5n9 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 88.0k 61.6k 0.0k 880.0k 616.0k 0.0k nvme8n1 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 78.0k 84.8k 0.0k 780.0k 848.0k 0.0k nvme8n10 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 83.6k 70.4k 0.0k 836.0k 704.0k 0.0k nvme8n11 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 103.6k 95.2k 0.0k 1.0M 952.0k 0.0k nvme8n12 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 110.4k 105.6k 0.0k 1.1M 1.0M 0.0k nvme8n13 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 120.8k 94.0k 0.0k 1.2M 940.0k 0.0k nvme8n14 2024-03-25T09:30:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 90.4k 91.2k 0.0k 904.0k 912.0k 0.0k nvme8n15 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 140.4k 96.4k 0.0k 1.4M 964.0k 0.0k nvme8n16 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 113.6k 73.6k 0.0k 1.1M 736.0k 0.0k nvme8n17 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 66.4k 108.4k 0.0k 664.0k 1.1M 0.0k nvme8n18 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 105.6k 79.2k 0.0k 1.0M 792.0k 0.0k nvme8n19 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 91.6k 84.0k 0.0k 916.0k 840.0k 0.0k nvme8n2 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 76.4k 85.6k 0.0k 764.0k 856.0k 0.0k nvme8n20 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 103.2k 85.2k 0.0k 1.0M 852.0k 0.0k nvme8n3 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 72.8k 92.0k 0.0k 728.0k 920.0k 0.0k nvme8n4 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 84.4k 62.4k 0.0k 844.0k 624.0k 0.0k nvme8n5 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 80.4k 78.0k 0.0k 804.0k 780.0k 0.0k nvme8n6 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 77.6k 76.0k 0.0k 776.0k 760.0k 0.0k nvme8n7 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.20 79.2k 114.0k 0.0k 792.0k 1.1M 0.0k nvme8n8 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.30 84.0k 85.2k 0.0k 840.0k 852.0k 0.0k nvme8n9 2024-03-25T09:30:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:40.082 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:40.082 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 3/s 149 KiB/s 67 KiB/s 2.15 ms 379.04 us 2024-03-25T09:30:40.082 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 5/s 186 KiB/s 138 KiB/s 2.25 ms 352.84 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 6/s 4/s 146 KiB/s 83 KiB/s 2.22 ms 321.33 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 3/s 122 KiB/s 63 KiB/s 2.30 ms 302.62 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 5/s 119 KiB/s 96 KiB/s 1.98 ms 280.49 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 4/s 124 KiB/s 75 KiB/s 2.11 ms 388.02 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 3/s 90 KiB/s 70 KiB/s 2.20 ms 284.97 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 3/s 106 KiB/s 78 KiB/s 2.32 ms 312.09 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 138 KiB/s 74 KiB/s 2.58 ms 417.16 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 114 KiB/s 98 KiB/s 2.24 ms 320.20 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 3/s 88 KiB/s 70 KiB/s 2.07 ms 328.20 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 4/s 106 KiB/s 80 KiB/s 2.10 ms 348.32 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 5/s 103 KiB/s 82 KiB/s 2.73 ms 360.18 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 3/s 102 KiB/s 52 KiB/s 2.13 ms 560.28 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 4/s 86 KiB/s 68 KiB/s 2.30 ms 381.37 us 2024-03-25T09:30:40.083 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 3/s 95 KiB/s 58 KiB/s 2.12 ms 324.48 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 5/s 119 KiB/s 98 KiB/s 2.37 ms 279.82 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 5/s 98 KiB/s 75 KiB/s 2.70 ms 334.34 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 3/s 71 KiB/s 47 KiB/s 2.34 ms 346.06 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 110 KiB/s 66 KiB/s 2.26 ms 320.13 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 117 KiB/s 92 KiB/s 2.15 ms 322.80 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 99 KiB/s 119 KiB/s 2.50 ms 328.80 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 3/s 102 KiB/s 74 KiB/s 2.16 ms 411.26 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 5/s 72 KiB/s 75 KiB/s 2.18 ms 361.11 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 100 KiB/s 79 KiB/s 2.30 ms 433.43 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 81 KiB/s 87 KiB/s 1.98 ms 408.44 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 6/s 90 KiB/s 158 KiB/s 2.13 ms 402.16 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 5/s 87 KiB/s 126 KiB/s 2.57 ms 360.49 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 5/s 82 KiB/s 119 KiB/s 2.18 ms 443.14 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 80 KiB/s 107 KiB/s 2.27 ms 333.86 us 2024-03-25T09:30:40.084 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 6/s 70 KiB/s 102 KiB/s 2.08 ms 349.17 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 4/s 134 KiB/s 175 KiB/s 2.34 ms 385.76 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 3/s 86 KiB/s 70 KiB/s 2.20 ms 385.08 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 5/s 59 KiB/s 93 KiB/s 2.12 ms 335.13 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 5/s 66 KiB/s 78 KiB/s 2.08 ms 321.26 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 98 KiB/s 66 KiB/s 2.39 ms 309.71 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 5/s 82 KiB/s 76 KiB/s 2.34 ms 312.00 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 57 KiB/s 106 KiB/s 2.38 ms 351.98 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 108 KiB/s 136 KiB/s 2.58 ms 528.70 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 92 KiB/s 91 KiB/s 2.32 ms 363.56 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 95 KiB/s 86 KiB/s 2.06 ms 309.14 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 5/s 62 KiB/s 66 KiB/s 2.24 ms 331.24 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 6/s 88 KiB/s 123 KiB/s 2.12 ms 297.99 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 5/s 126 KiB/s 153 KiB/s 2.07 ms 360.65 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 5/s 55 KiB/s 109 KiB/s 1.99 ms 324.40 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 81 KiB/s 58 KiB/s 2.06 ms 278.46 us 2024-03-25T09:30:40.085 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 67 KiB/s 98 KiB/s 2.18 ms 307.43 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 78 KiB/s 121 KiB/s 2.31 ms 314.61 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 5/s 66 KiB/s 118 KiB/s 2.23 ms 333.03 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 74 KiB/s 101 KiB/s 2.31 ms 358.00 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 3/s 59 KiB/s 63 KiB/s 2.24 ms 272.73 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 5/s 56 KiB/s 120 KiB/s 2.20 ms 288.31 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 5/s 62 KiB/s 78 KiB/s 2.43 ms 338.45 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 73 KiB/s 63 KiB/s 2.33 ms 311.03 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 4/s 78 KiB/s 98 KiB/s 1.91 ms 326.86 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 5/s 63 KiB/s 109 KiB/s 2.22 ms 342.57 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 3/s 73 KiB/s 48 KiB/s 2.01 ms 318.10 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 2/s 3/s 62 KiB/s 64 KiB/s 2.32 ms 356.04 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 2/s 6/s 43 KiB/s 145 KiB/s 2.11 ms 341.45 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 2/s 5/s 43 KiB/s 122 KiB/s 2.37 ms 316.67 us 2024-03-25T09:30:40.086 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:40.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:41.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:40 smithi040 ceph-mon[33094]: pgmap v650: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 503 op/s 2024-03-25T09:30:41.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:40 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 552 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:41.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:41.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:41.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:41.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:40 smithi019 ceph-mon[29386]: pgmap v650: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 503 op/s 2024-03-25T09:30:41.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:40 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 552 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:40 smithi059 ceph-mon[32732]: pgmap v650: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 503 op/s 2024-03-25T09:30:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:40 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 552 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:42.059 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:41 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:42.059 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:41 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:42.060 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:41 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:42.060 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:41 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:42.060 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:41 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:42.060 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:41 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:42.060 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:41 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:42.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:42.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:42.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:41 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:41 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:41 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:41 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:42.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:41 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:42.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:41 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:42.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:41 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:41 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:41 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:41 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:41 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:41 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:41 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:41 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:43.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:42 smithi040 ceph-mon[33094]: pgmap v651: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 595 op/s 2024-03-25T09:30:43.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:43.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:43.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:43.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:42 smithi019 ceph-mon[29386]: pgmap v651: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 595 op/s 2024-03-25T09:30:43.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:42.809+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:43.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:42 smithi059 ceph-mon[32732]: pgmap v651: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 595 op/s 2024-03-25T09:30:44.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:44.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:44.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:45.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:44 smithi040 ceph-mon[33094]: pgmap v652: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 534 op/s 2024-03-25T09:30:45.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:45.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:45.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:45.086 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 7/s 4/s 141 KiB/s 110 KiB/s 2.27 ms 344.83 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 6/s 6/s 136 KiB/s 121 KiB/s 2.01 ms 482.26 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 6/s 5/s 147 KiB/s 126 KiB/s 2.12 ms 365.18 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 6/s 5/s 107 KiB/s 70 KiB/s 1.94 ms 277.92 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 6/s 2/s 115 KiB/s 39 KiB/s 2.81 ms 335.75 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 5/s 94 KiB/s 114 KiB/s 2.34 ms 358.49 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 170 KiB/s 123 KiB/s 2.36 ms 275.39 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 5/s 160 KiB/s 170 KiB/s 2.26 ms 411.29 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 5/s 141 KiB/s 139 KiB/s 2.35 ms 397.00 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 5/s 92 KiB/s 98 KiB/s 2.08 ms 351.05 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 3/s 180 KiB/s 117 KiB/s 2.65 ms 274.82 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 4/s 189 KiB/s 126 KiB/s 2.10 ms 439.18 us 2024-03-25T09:30:45.087 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 5/s 97 KiB/s 88 KiB/s 2.45 ms 347.82 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 98 KiB/s 74 KiB/s 2.08 ms 299.41 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 4/s 102 KiB/s 84 KiB/s 2.05 ms 457.40 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 4/s 83 KiB/s 77 KiB/s 2.47 ms 308.64 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 4/s 122 KiB/s 118 KiB/s 2.00 ms 349.42 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 82 KiB/s 93 KiB/s 2.31 ms 399.79 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 85 KiB/s 117 KiB/s 2.37 ms 352.13 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 97 KiB/s 84 KiB/s 2.66 ms 316.48 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 4/s 125 KiB/s 122 KiB/s 2.35 ms 338.82 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 159 KiB/s 140 KiB/s 3.12 ms 347.29 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 72 KiB/s 87 KiB/s 2.46 ms 412.16 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 158 KiB/s 142 KiB/s 2.54 ms 446.81 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 5/s 90 KiB/s 93 KiB/s 2.41 ms 320.45 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 4/s 87 KiB/s 98 KiB/s 2.71 ms 375.92 us 2024-03-25T09:30:45.088 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 74 KiB/s 120 KiB/s 2.28 ms 398.59 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 3/s 128 KiB/s 85 KiB/s 1.95 ms 291.63 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 101 KiB/s 86 KiB/s 2.33 ms 340.88 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 134 KiB/s 123 KiB/s 2.21 ms 286.31 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 89 KiB/s 87 KiB/s 2.19 ms 360.27 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 5/s 107 KiB/s 142 KiB/s 2.21 ms 396.19 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 97 KiB/s 92 KiB/s 2.30 ms 356.77 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 5/s 106 KiB/s 130 KiB/s 2.02 ms 332.11 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 126 KiB/s 162 KiB/s 2.16 ms 327.44 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 4/s 149 KiB/s 146 KiB/s 2.05 ms 297.26 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 74 KiB/s 94 KiB/s 2.21 ms 323.65 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 118 KiB/s 101 KiB/s 2.69 ms 424.29 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 5/s 153 KiB/s 186 KiB/s 2.45 ms 377.57 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 6/s 86 KiB/s 111 KiB/s 2.33 ms 385.13 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 6/s 75 KiB/s 110 KiB/s 2.73 ms 315.83 us 2024-03-25T09:30:45.089 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 5/s 81 KiB/s 125 KiB/s 2.26 ms 478.98 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 76 KiB/s 75 KiB/s 2.16 ms 312.18 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 5/s 55 KiB/s 128 KiB/s 2.37 ms 365.60 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 4/s 71 KiB/s 94 KiB/s 2.18 ms 391.19 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 5/s 136 KiB/s 144 KiB/s 2.13 ms 370.59 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 5/s 84 KiB/s 174 KiB/s 2.62 ms 372.86 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 6/s 119 KiB/s 149 KiB/s 2.30 ms 337.46 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 67 KiB/s 81 KiB/s 2.17 ms 317.23 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 5/s 70 KiB/s 99 KiB/s 2.49 ms 284.24 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 5/s 78 KiB/s 111 KiB/s 2.25 ms 359.08 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 5/s 69 KiB/s 110 KiB/s 2.11 ms 285.52 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 5/s 80 KiB/s 142 KiB/s 2.06 ms 325.16 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 60 KiB/s 87 KiB/s 2.25 ms 328.03 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 6/s 79 KiB/s 133 KiB/s 2.34 ms 396.40 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 3/s 52 KiB/s 49 KiB/s 2.24 ms 222.01 us 2024-03-25T09:30:45.090 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 43 KiB/s 70 KiB/s 2.26 ms 309.89 us 2024-03-25T09:30:45.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 2/s 4/s 66 KiB/s 108 KiB/s 2.31 ms 338.98 us 2024-03-25T09:30:45.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 2/s 6/s 41 KiB/s 110 KiB/s 2.44 ms 352.06 us 2024-03-25T09:30:45.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 2/s 4/s 49 KiB/s 70 KiB/s 2.39 ms 361.14 us 2024-03-25T09:30:45.091 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:45.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:44 smithi019 ceph-mon[29386]: pgmap v652: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 534 op/s 2024-03-25T09:30:45.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:44 smithi059 ceph-mon[32732]: pgmap v652: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 534 op/s 2024-03-25T09:30:46.059 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:45 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 557 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:46.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:46.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:46.060 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:46.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:45 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 557 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:45 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 557 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:47.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:46 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:47.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:46 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:47.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:46 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:47.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:46 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:47.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:46 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:47.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:46 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:47.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:46 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:47.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:46 smithi019 ceph-mon[29386]: pgmap v653: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 544 op/s 2024-03-25T09:30:47.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:47.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:47.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:47.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:47.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:47.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:47.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:47.165 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-mon[33094]: pgmap v653: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 544 op/s 2024-03-25T09:30:47.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:47.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:47.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:46 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:46 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:46 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:46 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:46 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:46 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:46 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:46 smithi059 ceph-mon[32732]: pgmap v653: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 544 op/s 2024-03-25T09:30:48.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:48.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:48.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:47.809+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:49.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:48 smithi019 ceph-mon[29386]: pgmap v654: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 546 op/s 2024-03-25T09:30:49.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:48 smithi059 ceph-mon[32732]: pgmap v654: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 546 op/s 2024-03-25T09:30:49.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:48 smithi040 ceph-mon[33094]: pgmap v654: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 546 op/s 2024-03-25T09:30:49.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:49.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:49.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:49.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:30:49.680 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 123.6k 171.6k 0.0k 1.2M 1.7M 0.0k nvme2n1 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 151.6k 114.0k 0.0k 1.5M 1.1M 0.0k nvme2n10 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 82.0k 64.8k 0.0k 820.0k 648.0k 0.0k nvme2n11 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 72.4k 67.2k 0.0k 724.0k 672.0k 0.0k nvme2n12 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 157.2k 156.8k 0.0k 1.5M 1.5M 0.0k nvme2n13 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 115.6k 93.2k 0.0k 1.1M 932.0k 0.0k nvme2n14 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 134.0k 150.8k 0.0k 1.3M 1.5M 0.0k nvme2n15 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 99.2k 92.0k 0.0k 992.0k 920.0k 0.0k nvme2n16 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 125.2k 83.6k 0.0k 1.2M 836.0k 0.0k nvme2n17 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 140.8k 125.2k 0.0k 1.4M 1.2M 0.0k nvme2n18 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 118.8k 127.2k 0.0k 1.2M 1.2M 0.0k nvme2n19 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 140.0k 122.8k 0.0k 1.4M 1.2M 0.0k nvme2n2 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 148.4k 144.8k 0.0k 1.4M 1.4M 0.0k nvme2n20 2024-03-25T09:30:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 142.8k 133.2k 0.0k 1.4M 1.3M 0.0k nvme2n3 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 117.2k 124.4k 0.0k 1.1M 1.2M 0.0k nvme2n4 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 118.0k 111.6k 0.0k 1.2M 1.1M 0.0k nvme2n5 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 164.8k 147.6k 0.0k 1.6M 1.4M 0.0k nvme2n6 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 124.8k 140.4k 0.0k 1.2M 1.4M 0.0k nvme2n7 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 98.0k 116.0k 0.0k 980.0k 1.1M 0.0k nvme2n8 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 146.0k 94.8k 0.0k 1.4M 948.0k 0.0k nvme2n9 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 110.4k 134.4k 0.0k 1.1M 1.3M 0.0k nvme5n1 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 88.4k 90.0k 0.0k 884.0k 900.0k 0.0k nvme5n10 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 151.2k 124.8k 0.0k 1.5M 1.2M 0.0k nvme5n11 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 98.0k 67.6k 0.0k 980.0k 676.0k 0.0k nvme5n12 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 122.0k 94.0k 0.0k 1.2M 940.0k 0.0k nvme5n13 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 67.2k 75.6k 0.0k 672.0k 756.0k 0.0k nvme5n14 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 81.2k 98.0k 0.0k 812.0k 980.0k 0.0k nvme5n15 2024-03-25T09:30:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 147.6k 136.8k 0.0k 1.4M 1.3M 0.0k nvme5n16 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 123.6k 153.2k 0.0k 1.2M 1.5M 0.0k nvme5n17 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 110.8k 91.2k 0.0k 1.1M 912.0k 0.0k nvme5n18 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 118.0k 86.8k 0.0k 1.2M 868.0k 0.0k nvme5n19 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 154.8k 116.4k 0.0k 1.5M 1.1M 0.0k nvme5n2 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 128.0k 104.4k 0.0k 1.2M 1.0M 0.0k nvme5n20 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 79.2k 80.8k 0.0k 792.0k 808.0k 0.0k nvme5n3 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 66.4k 105.6k 0.0k 664.0k 1.0M 0.0k nvme5n4 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 147.2k 147.2k 0.0k 1.4M 1.4M 0.0k nvme5n5 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 64.0k 119.6k 0.0k 640.0k 1.2M 0.0k nvme5n6 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 147.2k 135.2k 0.0k 1.4M 1.3M 0.0k nvme5n7 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 99.6k 110.0k 0.0k 996.0k 1.1M 0.0k nvme5n8 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 152.4k 125.2k 0.0k 1.5M 1.2M 0.0k nvme5n9 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 100.4k 84.4k 0.0k 1004.0k 844.0k 0.0k nvme8n1 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 160.4k 142.0k 0.0k 1.6M 1.4M 0.0k nvme8n10 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 123.2k 140.8k 0.0k 1.2M 1.4M 0.0k nvme8n11 2024-03-25T09:30:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 153.2k 170.8k 0.0k 1.5M 1.7M 0.0k nvme8n12 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 102.0k 68.0k 0.0k 1020.0k 680.0k 0.0k nvme8n13 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 148.4k 141.2k 0.0k 1.4M 1.4M 0.0k nvme8n14 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 87.2k 64.8k 0.0k 872.0k 648.0k 0.0k nvme8n15 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 153.6k 140.8k 0.0k 1.5M 1.4M 0.0k nvme8n16 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 115.2k 99.2k 0.0k 1.1M 992.0k 0.0k nvme8n17 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 99.6k 133.6k 0.0k 996.0k 1.3M 0.0k nvme8n18 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 109.2k 118.0k 0.0k 1.1M 1.2M 0.0k nvme8n19 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 140.0k 121.6k 0.0k 1.4M 1.2M 0.0k nvme8n2 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 138.4k 141.2k 0.0k 1.4M 1.4M 0.0k nvme8n20 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 69.2k 100.4k 0.0k 692.0k 1004.0k 0.0k nvme8n3 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 9.00 100.4k 105.2k 0.0k 1004.0k 1.0M 0.0k nvme8n4 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 83.2k 109.2k 0.0k 832.0k 1.1M 0.0k nvme8n5 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 140.0k 124.0k 0.0k 1.4M 1.2M 0.0k nvme8n6 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 135.2k 168.8k 0.0k 1.3M 1.6M 0.0k nvme8n7 2024-03-25T09:30:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 134.4k 158.4k 0.0k 1.3M 1.5M 0.0k nvme8n8 2024-03-25T09:30:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.90 79.2k 79.2k 0.0k 792.0k 792.0k 0.0k nvme8n9 2024-03-25T09:30:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:50.091 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:50.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 3/s 231 KiB/s 125 KiB/s 2.14 ms 440.94 us 2024-03-25T09:30:50.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 4/s 148 KiB/s 84 KiB/s 2.19 ms 337.47 us 2024-03-25T09:30:50.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 4/s 150 KiB/s 107 KiB/s 2.63 ms 356.18 us 2024-03-25T09:30:50.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 4/s 185 KiB/s 98 KiB/s 2.42 ms 324.58 us 2024-03-25T09:30:50.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 5/s 154 KiB/s 154 KiB/s 2.55 ms 389.51 us 2024-03-25T09:30:50.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 5/s 146 KiB/s 134 KiB/s 2.40 ms 348.45 us 2024-03-25T09:30:50.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 86 KiB/s 62 KiB/s 2.16 ms 312.15 us 2024-03-25T09:30:50.091 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 3/s 110 KiB/s 106 KiB/s 2.11 ms 318.32 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 5/s 159 KiB/s 155 KiB/s 2.40 ms 299.74 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 5/s 128 KiB/s 67 KiB/s 2.26 ms 272.14 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 4/s 184 KiB/s 130 KiB/s 2.18 ms 318.98 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 4/s 164 KiB/s 153 KiB/s 2.47 ms 412.91 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 3/s 159 KiB/s 131 KiB/s 2.08 ms 382.11 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 3/s 79 KiB/s 46 KiB/s 2.30 ms 309.84 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 5/s 107 KiB/s 122 KiB/s 2.21 ms 380.97 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 4/s 122 KiB/s 96 KiB/s 2.43 ms 354.77 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 4/s 168 KiB/s 134 KiB/s 2.28 ms 292.32 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 137 KiB/s 81 KiB/s 2.29 ms 372.16 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 4/s 187 KiB/s 116 KiB/s 2.05 ms 309.90 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 4/s 168 KiB/s 134 KiB/s 2.11 ms 493.66 us 2024-03-25T09:30:50.092 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 3/s 86 KiB/s 51 KiB/s 2.24 ms 361.12 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 102 KiB/s 69 KiB/s 2.46 ms 339.75 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 142 KiB/s 146 KiB/s 2.59 ms 375.85 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 141 KiB/s 147 KiB/s 3.06 ms 383.75 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 5/s 154 KiB/s 198 KiB/s 2.26 ms 354.40 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 82 KiB/s 67 KiB/s 2.39 ms 324.14 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 5/s 116 KiB/s 159 KiB/s 2.20 ms 433.32 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 83 KiB/s 67 KiB/s 2.33 ms 338.40 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 137 KiB/s 140 KiB/s 2.04 ms 313.12 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 71 KiB/s 76 KiB/s 2.07 ms 248.27 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 149 KiB/s 127 KiB/s 2.34 ms 399.91 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 4/s 162 KiB/s 174 KiB/s 2.04 ms 327.70 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 129 KiB/s 115 KiB/s 2.54 ms 398.70 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 5/s 116 KiB/s 137 KiB/s 2.30 ms 308.40 us 2024-03-25T09:30:50.093 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 3/s 132 KiB/s 95 KiB/s 2.36 ms 437.45 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 4/s 102 KiB/s 102 KiB/s 2.34 ms 325.14 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 171 KiB/s 181 KiB/s 2.02 ms 350.53 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 63 KiB/s 77 KiB/s 2.05 ms 302.69 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 74 KiB/s 94 KiB/s 2.74 ms 352.02 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 5/s 87 KiB/s 81 KiB/s 2.42 ms 261.33 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 67 KiB/s 99 KiB/s 2.32 ms 383.68 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 2/s 66 KiB/s 58 KiB/s 2.15 ms 344.54 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 5/s 118 KiB/s 138 KiB/s 2.18 ms 356.75 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 163 KiB/s 191 KiB/s 2.55 ms 312.81 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 5/s 53 KiB/s 102 KiB/s 2.43 ms 318.22 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 4/s 97 KiB/s 140 KiB/s 2.37 ms 418.19 us 2024-03-25T09:30:50.094 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 4/s 102 KiB/s 146 KiB/s 2.32 ms 294.07 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 152 KiB/s 146 KiB/s 2.18 ms 354.89 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 61 KiB/s 70 KiB/s 2.05 ms 292.73 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 5/s 62 KiB/s 112 KiB/s 2.34 ms 426.38 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 5/s 118 KiB/s 174 KiB/s 2.17 ms 322.34 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 114 KiB/s 162 KiB/s 2.58 ms 319.27 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 4/s 82 KiB/s 104 KiB/s 2.31 ms 371.86 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 5/s 62 KiB/s 110 KiB/s 2.60 ms 330.65 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 5/s 68 KiB/s 160 KiB/s 2.28 ms 348.21 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 102 KiB/s 122 KiB/s 2.05 ms 396.42 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 3/s 96 KiB/s 102 KiB/s 2.29 ms 454.59 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 2/s 5/s 63 KiB/s 177 KiB/s 2.45 ms 323.78 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 2/s 3/s 54 KiB/s 70 KiB/s 2.60 ms 316.79 us 2024-03-25T09:30:50.095 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 2/s 1/s 67 KiB/s 58 KiB/s 2.05 ms 322.29 us 2024-03-25T09:30:50.096 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:50.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:50.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:50.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:50 smithi019 ceph-mon[29386]: pgmap v655: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.0 MiB/s wr, 529 op/s 2024-03-25T09:30:51.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:50 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 562 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:50 smithi059 ceph-mon[32732]: pgmap v655: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.0 MiB/s wr, 529 op/s 2024-03-25T09:30:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:50 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 562 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:50 smithi040 ceph-mon[33094]: pgmap v655: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.0 MiB/s wr, 529 op/s 2024-03-25T09:30:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:50 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 562 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:51.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:51.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:51.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:51 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:51 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:52.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:51 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:52.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:51 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:52.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:51 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:52.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:51 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:52.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:51 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:52.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:52.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:52.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:52.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:51 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:52.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:51 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:52.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:51 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:52.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:51 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:52.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:51 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:52.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:51 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:52.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:51 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:51 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:51 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:51 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:51 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:51 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:51 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:52.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:51 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:53.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:52 smithi019 ceph-mon[29386]: pgmap v656: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.2 MiB/s wr, 594 op/s 2024-03-25T09:30:53.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:52 smithi040 ceph-mon[33094]: pgmap v656: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.2 MiB/s wr, 594 op/s 2024-03-25T09:30:53.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:53.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:53.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:52.810+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:52 smithi059 ceph-mon[32732]: pgmap v656: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.2 MiB/s wr, 594 op/s 2024-03-25T09:30:54.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:54.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:54.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:55.095 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 6/s 5/s 155 KiB/s 117 KiB/s 2.49 ms 325.80 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 4/s 174 KiB/s 146 KiB/s 2.67 ms 328.66 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 4/s 210 KiB/s 136 KiB/s 2.22 ms 383.10 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 146 KiB/s 134 KiB/s 2.38 ms 319.05 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 3/s 182 KiB/s 106 KiB/s 2.07 ms 446.38 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 3/s 165 KiB/s 65 KiB/s 2.38 ms 404.13 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 4/s 172 KiB/s 161 KiB/s 2.36 ms 452.93 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 3/s 158 KiB/s 111 KiB/s 2.62 ms 352.39 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 3/s 159 KiB/s 122 KiB/s 2.15 ms 360.46 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 4/s 139 KiB/s 142 KiB/s 2.44 ms 377.48 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 3/s 132 KiB/s 108 KiB/s 1.89 ms 297.83 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 4/s 110 KiB/s 100 KiB/s 2.02 ms 297.20 us 2024-03-25T09:30:55.096 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 5/s 94 KiB/s 135 KiB/s 2.19 ms 458.57 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 153 KiB/s 139 KiB/s 2.39 ms 392.32 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 128 KiB/s 125 KiB/s 2.44 ms 343.93 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 162 KiB/s 142 KiB/s 2.24 ms 299.36 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 142 KiB/s 126 KiB/s 2.17 ms 374.70 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 150 KiB/s 109 KiB/s 2.53 ms 334.44 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 3/s 141 KiB/s 139 KiB/s 2.41 ms 410.25 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 5/s 156 KiB/s 194 KiB/s 2.16 ms 418.85 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 158 KiB/s 164 KiB/s 2.14 ms 327.80 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 137 KiB/s 121 KiB/s 2.23 ms 423.54 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 3/s 117 KiB/s 126 KiB/s 2.20 ms 363.81 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 5/s 133 KiB/s 158 KiB/s 2.01 ms 474.25 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 3/s 142 KiB/s 132 KiB/s 2.38 ms 465.12 us 2024-03-25T09:30:55.097 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 6/s 86 KiB/s 193 KiB/s 2.35 ms 318.71 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 4/s 142 KiB/s 127 KiB/s 2.09 ms 306.11 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 158 KiB/s 195 KiB/s 2.64 ms 334.90 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 5/s 143 KiB/s 167 KiB/s 2.36 ms 364.72 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 144 KiB/s 134 KiB/s 2.20 ms 406.97 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 5/s 119 KiB/s 123 KiB/s 2.56 ms 337.06 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 147 KiB/s 121 KiB/s 2.34 ms 420.38 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 144 KiB/s 159 KiB/s 2.43 ms 323.58 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 3/s 99 KiB/s 90 KiB/s 2.15 ms 298.06 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 126 KiB/s 99 KiB/s 2.48 ms 339.30 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 135 KiB/s 114 KiB/s 2.98 ms 331.50 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 63 KiB/s 39 KiB/s 2.51 ms 278.73 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 82 KiB/s 115 KiB/s 2.23 ms 500.60 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 5/s 112 KiB/s 162 KiB/s 2.72 ms 371.74 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 5/s 118 KiB/s 172 KiB/s 2.42 ms 330.85 us 2024-03-25T09:30:55.098 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 3/s 88 KiB/s 61 KiB/s 2.14 ms 233.94 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 5/s 125 KiB/s 145 KiB/s 2.22 ms 377.08 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 4/s 82 KiB/s 102 KiB/s 2.30 ms 319.84 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 122 KiB/s 134 KiB/s 2.25 ms 389.29 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 50 KiB/s 66 KiB/s 2.97 ms 325.57 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 4/s 128 KiB/s 147 KiB/s 2.39 ms 385.20 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 4/s 149 KiB/s 123 KiB/s 2.39 ms 349.85 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 109 KiB/s 157 KiB/s 2.70 ms 426.57 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 5/s 88 KiB/s 158 KiB/s 2.04 ms 339.56 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 3/s 65 KiB/s 63 KiB/s 2.34 ms 371.45 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 87 KiB/s 166 KiB/s 1.98 ms 325.03 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 5/s 108 KiB/s 158 KiB/s 2.07 ms 324.62 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 122 KiB/s 148 KiB/s 2.47 ms 319.85 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 106 KiB/s 128 KiB/s 2.26 ms 324.31 us 2024-03-25T09:30:55.099 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 5/s 130 KiB/s 146 KiB/s 2.21 ms 308.51 us 2024-03-25T09:30:55.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 3/s 119 KiB/s 78 KiB/s 2.06 ms 340.50 us 2024-03-25T09:30:55.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 5/s 97 KiB/s 185 KiB/s 2.43 ms 393.46 us 2024-03-25T09:30:55.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 2/s 3/s 77 KiB/s 116 KiB/s 2.14 ms 325.70 us 2024-03-25T09:30:55.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 2/s 4/s 97 KiB/s 151 KiB/s 2.18 ms 295.62 us 2024-03-25T09:30:55.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 2/s 5/s 91 KiB/s 166 KiB/s 2.43 ms 311.94 us 2024-03-25T09:30:55.100 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:55.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:54 smithi019 ceph-mon[29386]: pgmap v657: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 471 op/s 2024-03-25T09:30:55.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:54 smithi059 ceph-mon[32732]: pgmap v657: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 471 op/s 2024-03-25T09:30:55.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:54 smithi040 ceph-mon[33094]: pgmap v657: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 471 op/s 2024-03-25T09:30:55.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:55.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:55.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:56.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:55 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 567 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:56.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:55 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 567 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:56.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:55 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 567 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:30:57.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:57.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-mon[33094]: { 2024-03-25T09:30:57.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:30:57.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:30:57.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:30:57.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:30:57.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:30:57.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-mon[33094]: pgmap v658: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.9 MiB/s wr, 594 op/s 2024-03-25T09:30:57.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:57.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:57.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:57.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:56 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:57.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:56 smithi059 ceph-mon[32732]: { 2024-03-25T09:30:57.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:56 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:30:57.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:56 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:30:57.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:56 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:30:57.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:56 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:30:57.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:56 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:30:57.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:56 smithi059 ceph-mon[32732]: pgmap v658: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.9 MiB/s wr, 594 op/s 2024-03-25T09:30:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:56 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:30:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:56 smithi019 ceph-mon[29386]: { 2024-03-25T09:30:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:56 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:30:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:56 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:30:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:56 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:30:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:56 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:30:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:56 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:30:57.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:56 smithi019 ceph-mon[29386]: pgmap v658: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.9 MiB/s wr, 594 op/s 2024-03-25T09:30:58.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:58.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:58.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:30:57.810+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:30:59.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:30:58 smithi059 ceph-mon[32732]: pgmap v659: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.4 MiB/s wr, 523 op/s 2024-03-25T09:30:59.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:30:58 smithi040 ceph-mon[33094]: pgmap v659: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.4 MiB/s wr, 523 op/s 2024-03-25T09:30:59.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:30:59.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:30:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:30:59.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:30:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:30:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:30:58 smithi019 ceph-mon[29386]: pgmap v659: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.4 MiB/s wr, 523 op/s 2024-03-25T09:30:59.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:30:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:30:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 108.4k 149.2k 0.0k 1.1M 1.5M 0.0k nvme2n1 2024-03-25T09:30:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 106.4k 136.0k 0.0k 1.0M 1.3M 0.0k nvme2n10 2024-03-25T09:30:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 96.0k 79.6k 0.0k 960.0k 796.0k 0.0k nvme2n11 2024-03-25T09:30:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 140.4k 142.0k 0.0k 1.4M 1.4M 0.0k nvme2n12 2024-03-25T09:30:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 149.6k 107.2k 0.0k 1.5M 1.0M 0.0k nvme2n13 2024-03-25T09:30:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 118.0k 173.6k 0.0k 1.2M 1.7M 0.0k nvme2n14 2024-03-25T09:30:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 139.2k 144.0k 0.0k 1.4M 1.4M 0.0k nvme2n15 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 150.4k 159.2k 0.0k 1.5M 1.6M 0.0k nvme2n16 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 128.4k 134.0k 0.0k 1.3M 1.3M 0.0k nvme2n17 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 146.8k 119.2k 0.0k 1.4M 1.2M 0.0k nvme2n18 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 163.2k 108.0k 0.0k 1.6M 1.1M 0.0k nvme2n19 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 145.2k 111.6k 0.0k 1.4M 1.1M 0.0k nvme2n2 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 94.4k 155.6k 0.0k 944.0k 1.5M 0.0k nvme2n20 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 108.0k 138.0k 0.0k 1.1M 1.3M 0.0k nvme2n3 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 100.4k 128.8k 0.0k 1004.0k 1.3M 0.0k nvme2n4 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 152.4k 117.6k 0.0k 1.5M 1.1M 0.0k nvme2n5 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 91.2k 158.8k 0.0k 912.0k 1.6M 0.0k nvme2n6 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 176.8k 115.6k 0.0k 1.7M 1.1M 0.0k nvme2n7 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 149.2k 114.0k 0.0k 1.5M 1.1M 0.0k nvme2n8 2024-03-25T09:30:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 118.8k 134.0k 0.0k 1.2M 1.3M 0.0k nvme2n9 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 134.0k 119.2k 0.0k 1.3M 1.2M 0.0k nvme5n1 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 125.6k 153.6k 0.0k 1.2M 1.5M 0.0k nvme5n10 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 149.2k 114.8k 0.0k 1.5M 1.1M 0.0k nvme5n11 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 113.2k 152.8k 0.0k 1.1M 1.5M 0.0k nvme5n12 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 157.2k 118.8k 0.0k 1.5M 1.2M 0.0k nvme5n13 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 143.6k 128.8k 0.0k 1.4M 1.3M 0.0k nvme5n14 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 124.8k 135.6k 0.0k 1.2M 1.3M 0.0k nvme5n15 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 126.8k 114.0k 0.0k 1.2M 1.1M 0.0k nvme5n16 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 110.0k 131.6k 0.0k 1.1M 1.3M 0.0k nvme5n17 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 136.0k 151.6k 0.0k 1.3M 1.5M 0.0k nvme5n18 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 122.8k 151.2k 0.0k 1.2M 1.5M 0.0k nvme5n19 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 111.2k 150.4k 0.0k 1.1M 1.5M 0.0k nvme5n2 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 100.0k 171.6k 0.0k 1000.0k 1.7M 0.0k nvme5n20 2024-03-25T09:30:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 160.8k 162.8k 0.0k 1.6M 1.6M 0.0k nvme5n3 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 114.8k 150.0k 0.0k 1.1M 1.5M 0.0k nvme5n4 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 176.8k 90.4k 0.0k 1.7M 904.0k 0.0k nvme5n5 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 128.8k 124.8k 0.0k 1.3M 1.2M 0.0k nvme5n6 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 148.8k 109.2k 0.0k 1.5M 1.1M 0.0k nvme5n7 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 126.0k 130.8k 0.0k 1.2M 1.3M 0.0k nvme5n8 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 111.6k 107.6k 0.0k 1.1M 1.1M 0.0k nvme5n9 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 153.6k 145.6k 0.0k 1.5M 1.4M 0.0k nvme8n1 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 150.0k 134.0k 0.0k 1.5M 1.3M 0.0k nvme8n10 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 108.8k 141.2k 0.0k 1.1M 1.4M 0.0k nvme8n11 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 142.4k 88.0k 0.0k 1.4M 880.0k 0.0k nvme8n12 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 126.0k 128.8k 0.0k 1.2M 1.3M 0.0k nvme8n13 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 124.8k 126.0k 0.0k 1.2M 1.2M 0.0k nvme8n14 2024-03-25T09:30:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 118.0k 126.4k 0.0k 1.2M 1.2M 0.0k nvme8n15 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 139.2k 136.0k 0.0k 1.4M 1.3M 0.0k nvme8n16 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 128.0k 140.8k 0.0k 1.2M 1.4M 0.0k nvme8n17 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 170.0k 121.2k 0.0k 1.7M 1.2M 0.0k nvme8n18 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 161.2k 136.8k 0.0k 1.6M 1.3M 0.0k nvme8n19 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 100.0k 168.4k 0.0k 1000.0k 1.6M 0.0k nvme8n2 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 123.6k 126.0k 0.0k 1.2M 1.2M 0.0k nvme8n20 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 98.8k 156.0k 0.0k 988.0k 1.5M 0.0k nvme8n3 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 174.8k 133.2k 0.0k 1.7M 1.3M 0.0k nvme8n4 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 134.4k 136.8k 0.0k 1.3M 1.3M 0.0k nvme8n5 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 150.0k 133.2k 0.0k 1.5M 1.3M 0.0k nvme8n6 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 93.6k 135.2k 0.0k 936.0k 1.3M 0.0k nvme8n7 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 134.8k 142.8k 0.0k 1.3M 1.4M 0.0k nvme8n8 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 163.6k 81.6k 0.0k 1.6M 816.0k 0.0k nvme8n9 2024-03-25T09:30:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:00.099 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:00.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 4/s 195 KiB/s 118 KiB/s 2.39 ms 330.22 us 2024-03-25T09:31:00.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 6/s 2/s 202 KiB/s 96 KiB/s 2.31 ms 417.80 us 2024-03-25T09:31:00.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 4/s 160 KiB/s 138 KiB/s 2.19 ms 409.62 us 2024-03-25T09:31:00.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 3/s 161 KiB/s 102 KiB/s 2.33 ms 404.84 us 2024-03-25T09:31:00.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 4/s 148 KiB/s 116 KiB/s 2.26 ms 339.21 us 2024-03-25T09:31:00.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 4/s 153 KiB/s 126 KiB/s 2.51 ms 338.85 us 2024-03-25T09:31:00.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 3/s 171 KiB/s 142 KiB/s 2.35 ms 371.85 us 2024-03-25T09:31:00.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 3/s 138 KiB/s 90 KiB/s 2.15 ms 248.80 us 2024-03-25T09:31:00.100 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 4/s 141 KiB/s 108 KiB/s 2.04 ms 318.18 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 3/s 126 KiB/s 94 KiB/s 2.45 ms 360.67 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 4/s 181 KiB/s 115 KiB/s 2.06 ms 315.87 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 3/s 134 KiB/s 125 KiB/s 2.15 ms 469.21 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 3/s 194 KiB/s 90 KiB/s 2.29 ms 328.44 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 3/s 172 KiB/s 88 KiB/s 2.62 ms 409.93 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 118 KiB/s 127 KiB/s 2.16 ms 388.19 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 134 KiB/s 126 KiB/s 2.30 ms 369.00 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 5/s 139 KiB/s 169 KiB/s 2.33 ms 308.83 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 3/s 162 KiB/s 102 KiB/s 2.53 ms 313.86 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 4/s 157 KiB/s 104 KiB/s 2.38 ms 292.62 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 5/s 138 KiB/s 143 KiB/s 2.09 ms 326.39 us 2024-03-25T09:31:00.101 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 142 KiB/s 138 KiB/s 2.33 ms 322.24 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 4/s 179 KiB/s 111 KiB/s 2.18 ms 290.60 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 147 KiB/s 176 KiB/s 2.43 ms 504.96 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 4/s 132 KiB/s 146 KiB/s 2.22 ms 286.97 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 128 KiB/s 105 KiB/s 2.07 ms 363.93 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 3/s 151 KiB/s 108 KiB/s 2.16 ms 340.55 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 184 KiB/s 131 KiB/s 2.34 ms 308.65 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 4/s 113 KiB/s 155 KiB/s 2.13 ms 494.40 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 138 KiB/s 123 KiB/s 2.08 ms 360.06 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 112 KiB/s 133 KiB/s 2.18 ms 340.29 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 4/s 131 KiB/s 126 KiB/s 2.47 ms 381.74 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 78 KiB/s 203 KiB/s 2.39 ms 401.52 us 2024-03-25T09:31:00.102 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 129 KiB/s 146 KiB/s 2.19 ms 333.71 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 120 KiB/s 147 KiB/s 2.32 ms 350.27 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 126 KiB/s 101 KiB/s 2.53 ms 284.06 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 5/s 144 KiB/s 147 KiB/s 2.12 ms 302.40 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 121 KiB/s 145 KiB/s 2.40 ms 388.56 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 3/s 111 KiB/s 94 KiB/s 2.49 ms 356.53 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 108 KiB/s 125 KiB/s 1.99 ms 288.33 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 4/s 130 KiB/s 169 KiB/s 2.29 ms 361.15 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 124 KiB/s 129 KiB/s 2.33 ms 333.63 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 5/s 86 KiB/s 169 KiB/s 2.36 ms 475.30 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 3/s 134 KiB/s 117 KiB/s 2.16 ms 295.82 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 93 KiB/s 138 KiB/s 2.96 ms 330.86 us 2024-03-25T09:31:00.103 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 134 KiB/s 170 KiB/s 2.40 ms 395.86 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 5/s 123 KiB/s 189 KiB/s 2.28 ms 351.51 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 3/s 142 KiB/s 82 KiB/s 2.58 ms 346.28 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 5/s 114 KiB/s 164 KiB/s 2.45 ms 354.62 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 4/s 93 KiB/s 152 KiB/s 2.16 ms 397.07 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 5/s 115 KiB/s 168 KiB/s 2.41 ms 369.26 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 83 KiB/s 102 KiB/s 2.07 ms 319.53 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 5/s 134 KiB/s 146 KiB/s 2.83 ms 365.13 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 3/s 118 KiB/s 98 KiB/s 2.22 ms 384.86 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 3/s 128 KiB/s 148 KiB/s 2.47 ms 330.06 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 5/s 93 KiB/s 171 KiB/s 2.20 ms 320.38 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 4/s 148 KiB/s 181 KiB/s 1.94 ms 349.87 us 2024-03-25T09:31:00.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 90 KiB/s 137 KiB/s 2.69 ms 490.22 us 2024-03-25T09:31:00.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 3/s 105 KiB/s 139 KiB/s 2.34 ms 322.40 us 2024-03-25T09:31:00.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 6/s 101 KiB/s 202 KiB/s 2.76 ms 343.62 us 2024-03-25T09:31:00.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 2/s 5/s 45 KiB/s 102 KiB/s 2.12 ms 357.96 us 2024-03-25T09:31:00.105 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:00.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:00.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:30:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:00.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:30:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:01.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:00 smithi059 ceph-mon[32732]: pgmap v660: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.3 MiB/s wr, 518 op/s 2024-03-25T09:31:01.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:00 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 572 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:00 smithi040 ceph-mon[33094]: pgmap v660: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.3 MiB/s wr, 518 op/s 2024-03-25T09:31:01.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:00 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 572 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:01.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:01.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:01.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:00 smithi019 ceph-mon[29386]: pgmap v660: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.3 MiB/s wr, 518 op/s 2024-03-25T09:31:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:00 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 572 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:01 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:01 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:01 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:01 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:01 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:02.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:01 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:02.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:01 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:01 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:01 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:01 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:01 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:01 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:01 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:02.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:01 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:02.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:01 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:02.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:01 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:02.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:01 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:02.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:01 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:02.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:01 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:02.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:01 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:02.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:01 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:02.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:02.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:02.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:03.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:02 smithi040 ceph-mon[33094]: pgmap v661: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.2 MiB/s wr, 574 op/s 2024-03-25T09:31:03.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:03.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:03.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:02.810+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:02 smithi059 ceph-mon[32732]: pgmap v661: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.2 MiB/s wr, 574 op/s 2024-03-25T09:31:03.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:02 smithi019 ceph-mon[29386]: pgmap v661: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.2 MiB/s wr, 574 op/s 2024-03-25T09:31:04.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:04.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:04.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:05.103 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 6/s 3/s 162 KiB/s 103 KiB/s 2.15 ms 362.11 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 3/s 208 KiB/s 101 KiB/s 2.49 ms 334.15 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 3/s 134 KiB/s 95 KiB/s 2.18 ms 339.13 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 3/s 134 KiB/s 92 KiB/s 2.60 ms 437.69 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 4/s 171 KiB/s 121 KiB/s 2.15 ms 298.22 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 4/s 198 KiB/s 120 KiB/s 2.33 ms 334.30 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 3/s 146 KiB/s 77 KiB/s 2.18 ms 336.70 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 3/s 127 KiB/s 94 KiB/s 2.36 ms 365.13 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 4/s 116 KiB/s 129 KiB/s 2.25 ms 390.18 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 3/s 162 KiB/s 114 KiB/s 2.98 ms 484.69 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 3/s 178 KiB/s 95 KiB/s 2.37 ms 352.86 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 4/s 169 KiB/s 114 KiB/s 2.33 ms 370.61 us 2024-03-25T09:31:05.104 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 4/s 155 KiB/s 90 KiB/s 2.41 ms 365.39 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 4/s 136 KiB/s 119 KiB/s 2.17 ms 348.12 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 4/s 154 KiB/s 89 KiB/s 2.67 ms 338.65 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 3/s 161 KiB/s 118 KiB/s 2.36 ms 343.65 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 4/s 110 KiB/s 78 KiB/s 2.24 ms 300.71 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 129 KiB/s 105 KiB/s 2.37 ms 316.31 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 109 KiB/s 106 KiB/s 2.78 ms 336.16 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 5/s 159 KiB/s 145 KiB/s 2.13 ms 372.97 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 119 KiB/s 138 KiB/s 2.62 ms 442.01 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 131 KiB/s 127 KiB/s 2.34 ms 405.71 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 5/s 146 KiB/s 138 KiB/s 2.37 ms 300.77 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 4/s 151 KiB/s 120 KiB/s 2.08 ms 321.15 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 3/s 125 KiB/s 72 KiB/s 2.07 ms 391.87 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 130 KiB/s 158 KiB/s 2.19 ms 360.87 us 2024-03-25T09:31:05.105 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 129 KiB/s 142 KiB/s 2.49 ms 412.18 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 143 KiB/s 181 KiB/s 2.51 ms 422.26 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 118 KiB/s 89 KiB/s 2.40 ms 311.10 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 120 KiB/s 84 KiB/s 2.25 ms 288.60 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 130 KiB/s 129 KiB/s 2.24 ms 341.84 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 5/s 123 KiB/s 149 KiB/s 2.25 ms 301.24 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 5/s 132 KiB/s 138 KiB/s 2.08 ms 380.80 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 4/s 118 KiB/s 117 KiB/s 2.10 ms 422.68 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 136 KiB/s 111 KiB/s 2.46 ms 381.05 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 128 KiB/s 130 KiB/s 2.35 ms 414.89 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 138 KiB/s 127 KiB/s 2.21 ms 386.61 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 5/s 135 KiB/s 179 KiB/s 2.58 ms 437.97 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 120 KiB/s 114 KiB/s 2.10 ms 384.82 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 114 KiB/s 109 KiB/s 2.60 ms 378.13 us 2024-03-25T09:31:05.106 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 151 KiB/s 134 KiB/s 2.04 ms 293.33 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 4/s 135 KiB/s 111 KiB/s 2.39 ms 375.77 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 3/s 144 KiB/s 114 KiB/s 2.61 ms 422.39 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 136 KiB/s 133 KiB/s 2.26 ms 314.96 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 6/s 142 KiB/s 234 KiB/s 2.36 ms 357.71 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 5/s 112 KiB/s 139 KiB/s 2.54 ms 349.78 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 109 KiB/s 169 KiB/s 2.45 ms 407.15 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 126 KiB/s 171 KiB/s 2.36 ms 339.22 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 4/s 102 KiB/s 144 KiB/s 2.11 ms 309.67 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 5/s 134 KiB/s 177 KiB/s 2.21 ms 317.95 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 4/s 123 KiB/s 150 KiB/s 2.15 ms 301.44 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 5/s 82 KiB/s 137 KiB/s 2.24 ms 362.99 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 4/s 109 KiB/s 116 KiB/s 2.42 ms 300.53 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 5/s 117 KiB/s 158 KiB/s 2.04 ms 373.72 us 2024-03-25T09:31:05.107 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 5/s 119 KiB/s 122 KiB/s 2.21 ms 310.38 us 2024-03-25T09:31:05.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 6/s 92 KiB/s 144 KiB/s 3.07 ms 365.49 us 2024-03-25T09:31:05.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 108 KiB/s 114 KiB/s 2.16 ms 315.89 us 2024-03-25T09:31:05.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 5/s 84 KiB/s 177 KiB/s 2.45 ms 389.81 us 2024-03-25T09:31:05.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 4/s 66 KiB/s 149 KiB/s 2.03 ms 522.21 us 2024-03-25T09:31:05.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 5/s 103 KiB/s 150 KiB/s 2.48 ms 402.27 us 2024-03-25T09:31:05.108 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:05.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:04 smithi059 ceph-mon[32732]: pgmap v662: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.7 MiB/s wr, 471 op/s 2024-03-25T09:31:05.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:04 smithi040 ceph-mon[33094]: pgmap v662: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.7 MiB/s wr, 471 op/s 2024-03-25T09:31:05.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:05.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:05.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:05.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:04 smithi019 ceph-mon[29386]: pgmap v662: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.7 MiB/s wr, 471 op/s 2024-03-25T09:31:06.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:05 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 577 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:06.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:05 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 577 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:06.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:05 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 577 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:06.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:06.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:06.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:07.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:07.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:07.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:07.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:07.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:07.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:07.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:07.164 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-mon[33094]: pgmap v663: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.4 MiB/s wr, 602 op/s 2024-03-25T09:31:07.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:07.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:07.165 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:07.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:06 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:07.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:06 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:07.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:06 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:07.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:06 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:07.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:06 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:07.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:06 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:07.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:06 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:07.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:06 smithi059 ceph-mon[32732]: pgmap v663: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.4 MiB/s wr, 602 op/s 2024-03-25T09:31:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:06 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:06 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:06 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:06 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:06 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:06 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:06 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:06 smithi019 ceph-mon[29386]: pgmap v663: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.4 MiB/s wr, 602 op/s 2024-03-25T09:31:08.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:07.809+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:08.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:08.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:08.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:09.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:08 smithi059 ceph-mon[32732]: pgmap v664: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.3 MiB/s wr, 530 op/s 2024-03-25T09:31:09.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:08 smithi040 ceph-mon[33094]: pgmap v664: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.3 MiB/s wr, 530 op/s 2024-03-25T09:31:09.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:09.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:09.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:09.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:08 smithi019 ceph-mon[29386]: pgmap v664: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.3 MiB/s wr, 530 op/s 2024-03-25T09:31:09.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:31:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 131.2k 101.6k 0.0k 1.3M 1016.0k 0.0k nvme2n1 2024-03-25T09:31:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 117.6k 123.6k 0.0k 1.1M 1.2M 0.0k nvme2n10 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 156.0k 133.6k 0.0k 1.5M 1.3M 0.0k nvme2n11 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 100.4k 118.4k 0.0k 1004.0k 1.2M 0.0k nvme2n12 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 117.6k 127.6k 0.0k 1.1M 1.2M 0.0k nvme2n13 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 120.0k 130.0k 0.0k 1.2M 1.3M 0.0k nvme2n14 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 86.4k 161.2k 0.0k 864.0k 1.6M 0.0k nvme2n15 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 128.0k 103.6k 0.0k 1.2M 1.0M 0.0k nvme2n16 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 121.2k 140.0k 0.0k 1.2M 1.4M 0.0k nvme2n17 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 115.6k 142.8k 0.0k 1.1M 1.4M 0.0k nvme2n18 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 132.4k 109.2k 0.0k 1.3M 1.1M 0.0k nvme2n19 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 129.2k 134.0k 0.0k 1.3M 1.3M 0.0k nvme2n2 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 114.0k 112.8k 0.0k 1.1M 1.1M 0.0k nvme2n20 2024-03-25T09:31:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 104.0k 125.6k 0.0k 1.0M 1.2M 0.0k nvme2n3 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 95.6k 114.0k 0.0k 956.0k 1.1M 0.0k nvme2n4 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 110.0k 139.6k 0.0k 1.1M 1.4M 0.0k nvme2n5 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 119.6k 116.0k 0.0k 1.2M 1.1M 0.0k nvme2n6 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 97.2k 144.4k 0.0k 972.0k 1.4M 0.0k nvme2n7 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 130.8k 147.2k 0.0k 1.3M 1.4M 0.0k nvme2n8 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 162.4k 90.0k 0.0k 1.6M 900.0k 0.0k nvme2n9 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 98.0k 113.6k 0.0k 980.0k 1.1M 0.0k nvme5n1 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 111.6k 126.4k 0.0k 1.1M 1.2M 0.0k nvme5n10 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 126.4k 115.6k 0.0k 1.2M 1.1M 0.0k nvme5n11 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 108.8k 171.6k 0.0k 1.1M 1.7M 0.0k nvme5n12 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 130.0k 112.8k 0.0k 1.3M 1.1M 0.0k nvme5n13 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 100.0k 127.2k 0.0k 1000.0k 1.2M 0.0k nvme5n14 2024-03-25T09:31:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 130.4k 98.0k 0.0k 1.3M 980.0k 0.0k nvme5n15 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 134.0k 83.2k 0.0k 1.3M 832.0k 0.0k nvme5n16 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 84.8k 103.2k 0.0k 848.0k 1.0M 0.0k nvme5n17 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 118.4k 128.0k 0.0k 1.2M 1.2M 0.0k nvme5n18 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 147.2k 109.2k 0.0k 1.4M 1.1M 0.0k nvme5n19 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 96.8k 110.0k 0.0k 968.0k 1.1M 0.0k nvme5n2 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 124.0k 122.8k 0.0k 1.2M 1.2M 0.0k nvme5n20 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 168.8k 130.4k 0.0k 1.6M 1.3M 0.0k nvme5n3 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 138.0k 122.8k 0.0k 1.3M 1.2M 0.0k nvme5n4 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 112.8k 111.6k 0.0k 1.1M 1.1M 0.0k nvme5n5 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 138.4k 137.6k 0.0k 1.4M 1.3M 0.0k nvme5n6 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 103.6k 118.4k 0.0k 1.0M 1.2M 0.0k nvme5n7 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 127.2k 104.8k 0.0k 1.2M 1.0M 0.0k nvme5n8 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 112.0k 94.0k 0.0k 1.1M 940.0k 0.0k nvme5n9 2024-03-25T09:31:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 99.6k 158.0k 0.0k 996.0k 1.5M 0.0k nvme8n1 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 98.8k 132.8k 0.0k 988.0k 1.3M 0.0k nvme8n10 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 112.0k 127.2k 0.0k 1.1M 1.2M 0.0k nvme8n11 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 119.2k 132.0k 0.0k 1.2M 1.3M 0.0k nvme8n12 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 122.4k 139.2k 0.0k 1.2M 1.4M 0.0k nvme8n13 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 113.2k 124.4k 0.0k 1.1M 1.2M 0.0k nvme8n14 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 114.0k 116.4k 0.0k 1.1M 1.1M 0.0k nvme8n15 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 123.6k 58.8k 0.0k 1.2M 588.0k 0.0k nvme8n16 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 104.0k 143.2k 0.0k 1.0M 1.4M 0.0k nvme8n17 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 112.8k 143.2k 0.0k 1.1M 1.4M 0.0k nvme8n18 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 129.2k 126.4k 0.0k 1.3M 1.2M 0.0k nvme8n19 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 148.0k 82.0k 0.0k 1.4M 820.0k 0.0k nvme8n2 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 147.2k 100.4k 0.0k 1.4M 1004.0k 0.0k nvme8n20 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 140.4k 112.8k 0.0k 1.4M 1.1M 0.0k nvme8n3 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 112.4k 136.4k 0.0k 1.1M 1.3M 0.0k nvme8n4 2024-03-25T09:31:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 149.2k 112.4k 0.0k 1.5M 1.1M 0.0k nvme8n5 2024-03-25T09:31:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 121.6k 120.0k 0.0k 1.2M 1.2M 0.0k nvme8n6 2024-03-25T09:31:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 112.4k 122.0k 0.0k 1.1M 1.2M 0.0k nvme8n7 2024-03-25T09:31:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 108.8k 101.2k 0.0k 1.1M 1012.0k 0.0k nvme8n8 2024-03-25T09:31:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 142.0k 114.8k 0.0k 1.4M 1.1M 0.0k nvme8n9 2024-03-25T09:31:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:10.107 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 6/s 4/s 169 KiB/s 118 KiB/s 2.52 ms 422.73 us 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 4/s 148 KiB/s 139 KiB/s 2.31 ms 352.31 us 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 3/s 146 KiB/s 102 KiB/s 2.56 ms 449.80 us 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 4/s 142 KiB/s 137 KiB/s 2.16 ms 458.60 us 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 4/s 148 KiB/s 94 KiB/s 2.38 ms 435.67 us 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 3/s 117 KiB/s 118 KiB/s 2.48 ms 388.38 us 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 3/s 136 KiB/s 87 KiB/s 2.57 ms 316.42 us 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 3/s 169 KiB/s 88 KiB/s 2.44 ms 300.69 us 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 3/s 76 KiB/s 102 KiB/s 2.26 ms 320.11 us 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 3/s 124 KiB/s 109 KiB/s 2.78 ms 355.97 us 2024-03-25T09:31:10.108 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 4/s 135 KiB/s 109 KiB/s 2.20 ms 382.55 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 5/s 144 KiB/s 118 KiB/s 2.08 ms 338.41 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 129 KiB/s 115 KiB/s 2.22 ms 318.32 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 156 KiB/s 147 KiB/s 2.34 ms 325.82 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 146 KiB/s 116 KiB/s 2.53 ms 304.36 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 122 KiB/s 124 KiB/s 2.18 ms 402.95 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 151 KiB/s 111 KiB/s 3.09 ms 440.97 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 5/s 122 KiB/s 147 KiB/s 2.10 ms 417.06 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 159 KiB/s 156 KiB/s 2.59 ms 361.92 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 119 KiB/s 128 KiB/s 2.41 ms 355.28 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 154 KiB/s 79 KiB/s 2.08 ms 296.22 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 132 KiB/s 138 KiB/s 2.24 ms 348.47 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 162 KiB/s 108 KiB/s 2.40 ms 520.20 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 3/s 95 KiB/s 94 KiB/s 2.23 ms 356.40 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 114 KiB/s 101 KiB/s 2.25 ms 333.38 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 109 KiB/s 106 KiB/s 2.24 ms 323.35 us 2024-03-25T09:31:10.109 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 5/s 102 KiB/s 134 KiB/s 2.66 ms 310.08 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 4/s 126 KiB/s 117 KiB/s 2.37 ms 326.11 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 122 KiB/s 94 KiB/s 2.36 ms 436.75 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 129 KiB/s 122 KiB/s 2.70 ms 445.70 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 126 KiB/s 106 KiB/s 2.39 ms 411.07 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 87 KiB/s 98 KiB/s 2.41 ms 303.27 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 118 KiB/s 112 KiB/s 2.45 ms 341.33 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 144 KiB/s 132 KiB/s 2.13 ms 382.48 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 102 KiB/s 115 KiB/s 2.60 ms 341.31 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 140 KiB/s 120 KiB/s 2.11 ms 338.67 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 3/s 150 KiB/s 133 KiB/s 2.40 ms 370.39 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 95 KiB/s 80 KiB/s 2.24 ms 296.19 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 69 KiB/s 158 KiB/s 2.67 ms 346.03 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 5/s 111 KiB/s 159 KiB/s 2.30 ms 346.94 us 2024-03-25T09:31:10.110 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 4/s 131 KiB/s 145 KiB/s 2.20 ms 400.64 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 2/s 145 KiB/s 105 KiB/s 2.13 ms 381.05 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 5/s 114 KiB/s 136 KiB/s 2.25 ms 323.60 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 4/s 113 KiB/s 147 KiB/s 2.34 ms 323.81 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 82 KiB/s 98 KiB/s 2.34 ms 319.98 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 3/s 97 KiB/s 90 KiB/s 2.48 ms 297.93 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 82 KiB/s 105 KiB/s 2.32 ms 344.24 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 126 KiB/s 93 KiB/s 2.22 ms 387.50 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 70 KiB/s 126 KiB/s 2.45 ms 334.07 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 3/s 82 KiB/s 84 KiB/s 2.55 ms 368.86 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 142 KiB/s 122 KiB/s 2.36 ms 327.31 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 100 KiB/s 108 KiB/s 2.40 ms 315.83 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 4/s 131 KiB/s 124 KiB/s 2.36 ms 314.05 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 4/s 126 KiB/s 142 KiB/s 2.39 ms 398.07 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 5/s 119 KiB/s 137 KiB/s 2.55 ms 341.92 us 2024-03-25T09:31:10.111 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 90 KiB/s 130 KiB/s 2.16 ms 419.64 us 2024-03-25T09:31:10.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 5/s 110 KiB/s 176 KiB/s 2.34 ms 395.73 us 2024-03-25T09:31:10.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 89 KiB/s 114 KiB/s 2.82 ms 322.95 us 2024-03-25T09:31:10.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 6/s 90 KiB/s 183 KiB/s 1.90 ms 336.75 us 2024-03-25T09:31:10.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 2/s 5/s 71 KiB/s 162 KiB/s 1.99 ms 379.18 us 2024-03-25T09:31:10.112 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:10.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:10.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:10.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:10 smithi059 ceph-mon[32732]: pgmap v665: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 522 op/s 2024-03-25T09:31:11.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:10 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 582 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:10 smithi040 ceph-mon[33094]: pgmap v665: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 522 op/s 2024-03-25T09:31:11.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:10 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 582 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:11.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:11.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:11.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:11.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:10 smithi019 ceph-mon[29386]: pgmap v665: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 522 op/s 2024-03-25T09:31:11.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:10 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 582 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:11 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:11 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:11 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:11 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:11 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:12.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:11 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:12.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:11 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:11 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:11 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:11 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:11 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:11 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:11 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:12.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:11 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:12.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:11 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:12.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:11 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:12.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:11 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:12.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:11 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:12.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:11 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:12.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:11 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:12.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:11 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:12.811+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:12 smithi059 ceph-mon[32732]: pgmap v666: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 582 op/s 2024-03-25T09:31:13.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:12 smithi040 ceph-mon[33094]: pgmap v666: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 582 op/s 2024-03-25T09:31:13.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:13.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:13.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:13.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:12 smithi019 ceph-mon[29386]: pgmap v666: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 582 op/s 2024-03-25T09:31:14.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:14.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:14.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:15.112 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:15.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 6/s 3/s 171 KiB/s 88 KiB/s 2.38 ms 299.97 us 2024-03-25T09:31:15.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 3/s 179 KiB/s 93 KiB/s 2.26 ms 331.48 us 2024-03-25T09:31:15.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 6/s 2/s 174 KiB/s 83 KiB/s 2.36 ms 349.52 us 2024-03-25T09:31:15.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 2/s 174 KiB/s 93 KiB/s 2.65 ms 364.14 us 2024-03-25T09:31:15.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 3/s 150 KiB/s 105 KiB/s 2.35 ms 335.35 us 2024-03-25T09:31:15.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 4/s 158 KiB/s 118 KiB/s 2.02 ms 293.03 us 2024-03-25T09:31:15.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 3/s 166 KiB/s 73 KiB/s 2.19 ms 320.72 us 2024-03-25T09:31:15.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 3/s 119 KiB/s 86 KiB/s 2.34 ms 306.07 us 2024-03-25T09:31:15.112 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 170 KiB/s 150 KiB/s 2.33 ms 389.63 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 3/s 119 KiB/s 86 KiB/s 2.17 ms 272.59 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 3/s 123 KiB/s 95 KiB/s 2.65 ms 416.83 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 3/s 133 KiB/s 88 KiB/s 2.03 ms 295.45 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 3/s 145 KiB/s 78 KiB/s 2.51 ms 330.16 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 4/s 111 KiB/s 102 KiB/s 2.22 ms 310.65 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 4/s 146 KiB/s 94 KiB/s 2.80 ms 313.70 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 4/s 111 KiB/s 130 KiB/s 2.13 ms 326.31 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 5/s 125 KiB/s 125 KiB/s 2.25 ms 321.60 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 4/s 120 KiB/s 94 KiB/s 2.43 ms 345.57 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 3/s 134 KiB/s 98 KiB/s 2.42 ms 521.09 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 131 KiB/s 97 KiB/s 2.58 ms 344.13 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 113 KiB/s 101 KiB/s 2.58 ms 310.08 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 3/s 130 KiB/s 89 KiB/s 1.97 ms 344.97 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 3/s 99 KiB/s 89 KiB/s 2.73 ms 333.53 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 3/s 128 KiB/s 90 KiB/s 2.32 ms 520.18 us 2024-03-25T09:31:15.113 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 4/s 118 KiB/s 104 KiB/s 2.22 ms 399.54 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 5/s 104 KiB/s 138 KiB/s 2.61 ms 381.77 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 110 KiB/s 126 KiB/s 2.15 ms 295.35 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 3/s 114 KiB/s 82 KiB/s 2.05 ms 292.23 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 3/s 118 KiB/s 75 KiB/s 2.26 ms 350.98 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 5/s 101 KiB/s 143 KiB/s 2.36 ms 449.68 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 142 KiB/s 142 KiB/s 2.40 ms 389.28 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 142 KiB/s 116 KiB/s 2.33 ms 317.38 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 125 KiB/s 92 KiB/s 2.35 ms 306.63 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 2/s 130 KiB/s 57 KiB/s 2.42 ms 286.00 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 4/s 95 KiB/s 118 KiB/s 2.02 ms 314.10 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 5/s 102 KiB/s 174 KiB/s 2.40 ms 471.92 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 134 KiB/s 125 KiB/s 2.35 ms 381.86 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 4/s 115 KiB/s 135 KiB/s 2.28 ms 387.05 us 2024-03-25T09:31:15.114 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 141 KiB/s 108 KiB/s 2.24 ms 317.99 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 126 KiB/s 77 KiB/s 2.25 ms 360.14 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 3/s 77 KiB/s 101 KiB/s 2.11 ms 386.00 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 102 KiB/s 113 KiB/s 2.30 ms 324.19 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 4/s 117 KiB/s 117 KiB/s 2.47 ms 402.11 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 5/s 107 KiB/s 114 KiB/s 2.23 ms 362.68 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 77 KiB/s 140 KiB/s 2.10 ms 334.32 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 117 KiB/s 118 KiB/s 2.03 ms 387.47 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 3/s 83 KiB/s 98 KiB/s 2.42 ms 434.49 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 96 KiB/s 105 KiB/s 3.08 ms 326.42 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 5/s 88 KiB/s 166 KiB/s 2.39 ms 320.20 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 4/s 100 KiB/s 122 KiB/s 2.24 ms 305.67 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 4/s 86 KiB/s 100 KiB/s 2.32 ms 292.08 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 92 KiB/s 116 KiB/s 2.25 ms 373.90 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 58 KiB/s 102 KiB/s 2.28 ms 423.81 us 2024-03-25T09:31:15.115 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 5/s 50 KiB/s 110 KiB/s 2.47 ms 331.89 us 2024-03-25T09:31:15.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 5/s 105 KiB/s 109 KiB/s 2.31 ms 393.15 us 2024-03-25T09:31:15.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 6/s 98 KiB/s 186 KiB/s 2.59 ms 386.05 us 2024-03-25T09:31:15.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 5/s 101 KiB/s 142 KiB/s 2.75 ms 414.03 us 2024-03-25T09:31:15.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 6/s 98 KiB/s 169 KiB/s 2.42 ms 309.71 us 2024-03-25T09:31:15.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 74 KiB/s 127 KiB/s 2.61 ms 351.56 us 2024-03-25T09:31:15.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 2/s 5/s 62 KiB/s 140 KiB/s 2.14 ms 306.32 us 2024-03-25T09:31:15.116 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:15.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:14 smithi059 ceph-mon[32732]: pgmap v667: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.3 MiB/s wr, 478 op/s 2024-03-25T09:31:15.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:14 smithi040 ceph-mon[33094]: pgmap v667: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.3 MiB/s wr, 478 op/s 2024-03-25T09:31:15.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:15.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:15.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:15.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:14 smithi019 ceph-mon[29386]: pgmap v667: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.3 MiB/s wr, 478 op/s 2024-03-25T09:31:16.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:15 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 587 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:16.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:15 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 587 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:16.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:15 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 587 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:16.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:16.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:16.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:16 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:16 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:16 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:16 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:16 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:16 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:16 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:17.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:16 smithi059 ceph-mon[32732]: pgmap v668: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.6 MiB/s rd, 7.8 MiB/s wr, 594 op/s 2024-03-25T09:31:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:17.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-mon[33094]: pgmap v668: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.6 MiB/s rd, 7.8 MiB/s wr, 594 op/s 2024-03-25T09:31:17.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:17.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:17.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:16 smithi019 ceph-mon[29386]: pgmap v668: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.6 MiB/s rd, 7.8 MiB/s wr, 594 op/s 2024-03-25T09:31:18.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:17.811+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:18.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:18.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:18.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:19.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:18 smithi059 ceph-mon[32732]: pgmap v669: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 512 op/s 2024-03-25T09:31:19.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:18 smithi040 ceph-mon[33094]: pgmap v669: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 512 op/s 2024-03-25T09:31:19.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:19.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:19.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:19.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:18 smithi019 ceph-mon[29386]: pgmap v669: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 512 op/s 2024-03-25T09:31:19.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:31:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 106.4k 108.0k 0.0k 1.0M 1.1M 0.0k nvme2n1 2024-03-25T09:31:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 126.4k 101.2k 0.0k 1.2M 1012.0k 0.0k nvme2n10 2024-03-25T09:31:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 112.0k 142.8k 0.0k 1.1M 1.4M 0.0k nvme2n11 2024-03-25T09:31:19.680 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 113.6k 101.2k 0.0k 1.1M 1012.0k 0.0k nvme2n12 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 108.0k 102.8k 0.0k 1.1M 1.0M 0.0k nvme2n13 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 116.8k 104.4k 0.0k 1.1M 1.0M 0.0k nvme2n14 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 94.0k 126.4k 0.0k 940.0k 1.2M 0.0k nvme2n15 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 107.6k 116.8k 0.0k 1.1M 1.1M 0.0k nvme2n16 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 123.6k 110.0k 0.0k 1.2M 1.1M 0.0k nvme2n17 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 112.8k 103.2k 0.0k 1.1M 1.0M 0.0k nvme2n18 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 92.8k 106.0k 0.0k 928.0k 1.0M 0.0k nvme2n19 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 124.8k 88.8k 0.0k 1.2M 888.0k 0.0k nvme2n2 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 98.0k 97.2k 0.0k 980.0k 972.0k 0.0k nvme2n20 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 116.8k 108.4k 0.0k 1.1M 1.1M 0.0k nvme2n3 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 79.6k 128.8k 0.0k 796.0k 1.3M 0.0k nvme2n4 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 105.2k 120.0k 0.0k 1.0M 1.2M 0.0k nvme2n5 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 104.8k 87.2k 0.0k 1.0M 872.0k 0.0k nvme2n6 2024-03-25T09:31:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 115.6k 90.4k 0.0k 1.1M 904.0k 0.0k nvme2n7 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 140.8k 109.6k 0.0k 1.4M 1.1M 0.0k nvme2n8 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 89.2k 120.8k 0.0k 892.0k 1.2M 0.0k nvme2n9 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 90.0k 135.6k 0.0k 900.0k 1.3M 0.0k nvme5n1 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 119.6k 98.0k 0.0k 1.2M 980.0k 0.0k nvme5n10 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 125.2k 106.4k 0.0k 1.2M 1.0M 0.0k nvme5n11 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 112.0k 127.2k 0.0k 1.1M 1.2M 0.0k nvme5n12 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 113.6k 133.6k 0.0k 1.1M 1.3M 0.0k nvme5n13 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 104.8k 136.0k 0.0k 1.0M 1.3M 0.0k nvme5n14 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 131.2k 118.4k 0.0k 1.3M 1.2M 0.0k nvme5n15 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 93.2k 107.2k 0.0k 932.0k 1.0M 0.0k nvme5n16 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 86.0k 118.4k 0.0k 860.0k 1.2M 0.0k nvme5n17 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 100.0k 132.0k 0.0k 1000.0k 1.3M 0.0k nvme5n18 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 114.4k 90.8k 0.0k 1.1M 908.0k 0.0k nvme5n19 2024-03-25T09:31:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 97.2k 118.8k 0.0k 972.0k 1.2M 0.0k nvme5n2 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 140.0k 98.4k 0.0k 1.4M 984.0k 0.0k nvme5n20 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 124.8k 115.6k 0.0k 1.2M 1.1M 0.0k nvme5n3 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 94.4k 126.8k 0.0k 944.0k 1.2M 0.0k nvme5n4 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 101.2k 105.6k 0.0k 1012.0k 1.0M 0.0k nvme5n5 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 85.6k 162.4k 0.0k 856.0k 1.6M 0.0k nvme5n6 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 114.4k 88.4k 0.0k 1.1M 884.0k 0.0k nvme5n7 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 86.8k 142.8k 0.0k 868.0k 1.4M 0.0k nvme5n8 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 119.6k 110.8k 0.0k 1.2M 1.1M 0.0k nvme5n9 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 160.8k 94.0k 0.0k 1.6M 940.0k 0.0k nvme8n1 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 118.8k 84.0k 0.0k 1.2M 840.0k 0.0k nvme8n10 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 124.4k 112.8k 0.0k 1.2M 1.1M 0.0k nvme8n11 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 96.4k 135.2k 0.0k 964.0k 1.3M 0.0k nvme8n12 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 122.8k 98.8k 0.0k 1.2M 988.0k 0.0k nvme8n13 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 102.4k 118.4k 0.0k 1.0M 1.2M 0.0k nvme8n14 2024-03-25T09:31:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 129.2k 119.6k 0.0k 1.3M 1.2M 0.0k nvme8n15 2024-03-25T09:31:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 102.8k 93.2k 0.0k 1.0M 932.0k 0.0k nvme8n16 2024-03-25T09:31:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 124.8k 113.6k 0.0k 1.2M 1.1M 0.0k nvme8n17 2024-03-25T09:31:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 130.0k 109.2k 0.0k 1.3M 1.1M 0.0k nvme8n18 2024-03-25T09:31:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 115.2k 83.6k 0.0k 1.1M 836.0k 0.0k nvme8n19 2024-03-25T09:31:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 112.8k 73.2k 0.0k 1.1M 732.0k 0.0k nvme8n2 2024-03-25T09:31:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 106.0k 83.2k 0.0k 1.0M 832.0k 0.0k nvme8n20 2024-03-25T09:31:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 116.0k 112.0k 0.0k 1.1M 1.1M 0.0k nvme8n3 2024-03-25T09:31:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 134.4k 109.2k 0.0k 1.3M 1.1M 0.0k nvme8n4 2024-03-25T09:31:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 122.8k 94.8k 0.0k 1.2M 948.0k 0.0k nvme8n5 2024-03-25T09:31:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 94.4k 132.4k 0.0k 944.0k 1.3M 0.0k nvme8n6 2024-03-25T09:31:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 88.0k 107.6k 0.0k 880.0k 1.1M 0.0k nvme8n7 2024-03-25T09:31:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.80 106.4k 112.0k 0.0k 1.0M 1.1M 0.0k nvme8n8 2024-03-25T09:31:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.70 116.8k 133.6k 0.0k 1.1M 1.3M 0.0k nvme8n9 2024-03-25T09:31:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:20.116 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:20.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 2/s 170 KiB/s 73 KiB/s 2.44 ms 332.28 us 2024-03-25T09:31:20.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 6/s 3/s 170 KiB/s 87 KiB/s 2.38 ms 342.73 us 2024-03-25T09:31:20.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 3/s 159 KiB/s 91 KiB/s 2.14 ms 369.10 us 2024-03-25T09:31:20.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 3/s 125 KiB/s 81 KiB/s 2.15 ms 308.21 us 2024-03-25T09:31:20.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 2/s 128 KiB/s 72 KiB/s 2.21 ms 358.31 us 2024-03-25T09:31:20.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 4/s 114 KiB/s 116 KiB/s 2.26 ms 366.72 us 2024-03-25T09:31:20.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 160 KiB/s 133 KiB/s 2.71 ms 344.38 us 2024-03-25T09:31:20.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 4/s 153 KiB/s 123 KiB/s 2.56 ms 375.81 us 2024-03-25T09:31:20.116 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 4/s 150 KiB/s 70 KiB/s 2.08 ms 305.95 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 3/s 142 KiB/s 98 KiB/s 2.26 ms 312.08 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 3/s 112 KiB/s 77 KiB/s 2.49 ms 320.37 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 4/s 157 KiB/s 104 KiB/s 2.21 ms 298.72 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 114 KiB/s 125 KiB/s 2.33 ms 353.98 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 3/s 118 KiB/s 102 KiB/s 2.66 ms 345.45 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 4/s 146 KiB/s 117 KiB/s 2.19 ms 490.14 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 110 KiB/s 86 KiB/s 2.24 ms 365.51 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 102 KiB/s 114 KiB/s 2.04 ms 299.69 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 2/s 86 KiB/s 66 KiB/s 2.77 ms 280.07 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 126 KiB/s 116 KiB/s 2.42 ms 451.95 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 103 KiB/s 100 KiB/s 2.19 ms 347.90 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 130 KiB/s 141 KiB/s 2.34 ms 341.90 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 110 KiB/s 87 KiB/s 2.06 ms 346.23 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 4/s 122 KiB/s 125 KiB/s 2.25 ms 365.71 us 2024-03-25T09:31:20.117 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 5/s 123 KiB/s 146 KiB/s 2.44 ms 331.42 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 138 KiB/s 86 KiB/s 2.35 ms 334.39 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 107 KiB/s 92 KiB/s 2.83 ms 356.75 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 97 KiB/s 114 KiB/s 1.99 ms 334.28 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 131 KiB/s 104 KiB/s 2.45 ms 490.62 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 5/s 114 KiB/s 145 KiB/s 2.33 ms 391.07 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 5/s 102 KiB/s 117 KiB/s 1.97 ms 315.93 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 118 KiB/s 98 KiB/s 2.53 ms 297.47 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 134 KiB/s 130 KiB/s 2.48 ms 329.82 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 134 KiB/s 122 KiB/s 2.29 ms 297.47 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 99 KiB/s 102 KiB/s 2.15 ms 377.45 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 5/s 86 KiB/s 137 KiB/s 2.36 ms 322.16 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 108 KiB/s 102 KiB/s 2.05 ms 340.59 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 5/s 79 KiB/s 138 KiB/s 2.45 ms 389.07 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 118 KiB/s 86 KiB/s 2.31 ms 321.11 us 2024-03-25T09:31:20.118 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 4/s 106 KiB/s 114 KiB/s 2.25 ms 313.32 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 5/s 96 KiB/s 130 KiB/s 2.30 ms 361.15 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 109 KiB/s 119 KiB/s 2.53 ms 336.58 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 99 KiB/s 125 KiB/s 2.54 ms 312.44 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 70 KiB/s 124 KiB/s 2.15 ms 277.20 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 3/s 105 KiB/s 110 KiB/s 2.26 ms 322.61 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 3/s 93 KiB/s 94 KiB/s 2.48 ms 395.24 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 5/s 92 KiB/s 136 KiB/s 2.79 ms 455.89 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 99 KiB/s 110 KiB/s 2.67 ms 340.71 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 109 KiB/s 101 KiB/s 2.44 ms 308.78 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 5/s 81 KiB/s 119 KiB/s 2.28 ms 359.57 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 4/s 83 KiB/s 118 KiB/s 2.46 ms 327.20 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 3/s 102 KiB/s 73 KiB/s 2.38 ms 288.98 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 5/s 71 KiB/s 114 KiB/s 3.02 ms 322.49 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 90 KiB/s 109 KiB/s 2.32 ms 339.21 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 5/s 88 KiB/s 141 KiB/s 2.07 ms 316.93 us 2024-03-25T09:31:20.119 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 6/s 82 KiB/s 216 KiB/s 2.54 ms 405.72 us 2024-03-25T09:31:20.120 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 88 KiB/s 121 KiB/s 2.30 ms 464.07 us 2024-03-25T09:31:20.120 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 4/s 80 KiB/s 82 KiB/s 2.30 ms 329.11 us 2024-03-25T09:31:20.120 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 5/s 91 KiB/s 154 KiB/s 2.13 ms 369.43 us 2024-03-25T09:31:20.120 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 5/s 69 KiB/s 149 KiB/s 2.21 ms 347.57 us 2024-03-25T09:31:20.120 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 2/s 6/s 91 KiB/s 160 KiB/s 2.45 ms 383.96 us 2024-03-25T09:31:20.120 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:20.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:20.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:20.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:20 smithi059 ceph-mon[32732]: pgmap v670: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 506 op/s 2024-03-25T09:31:21.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:20 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 592 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:20 smithi040 ceph-mon[33094]: pgmap v670: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 506 op/s 2024-03-25T09:31:21.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:20 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 592 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:21.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:21.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:21.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:21.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:20 smithi019 ceph-mon[29386]: pgmap v670: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 506 op/s 2024-03-25T09:31:21.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:20 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 592 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:21 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:21 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:21 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:21 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:21 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:21 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:22.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:21 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:21 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:21 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:21 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:21 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:21 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:21 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:22.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:21 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:22.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:21 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:22.400 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:21 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:22.400 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:21 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:22.400 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:21 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:22.400 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:21 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:22.400 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:21 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:22.400 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:21 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:22.401 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:22.401 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:22.401 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:22.811+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:22 smithi059 ceph-mon[32732]: pgmap v671: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 571 op/s 2024-03-25T09:31:23.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:22 smithi040 ceph-mon[33094]: pgmap v671: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 571 op/s 2024-03-25T09:31:23.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:23.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:23.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:23.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:22 smithi019 ceph-mon[29386]: pgmap v671: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 571 op/s 2024-03-25T09:31:24.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:24.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:24.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:25.121 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:25.121 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 6/s 4/s 182 KiB/s 92 KiB/s 2.24 ms 341.18 us 2024-03-25T09:31:25.121 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 6/s 3/s 178 KiB/s 84 KiB/s 2.18 ms 344.90 us 2024-03-25T09:31:25.121 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 2/s 140 KiB/s 59 KiB/s 2.09 ms 410.50 us 2024-03-25T09:31:25.121 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 3/s 150 KiB/s 62 KiB/s 2.70 ms 288.46 us 2024-03-25T09:31:25.121 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 3/s 151 KiB/s 93 KiB/s 2.49 ms 334.77 us 2024-03-25T09:31:25.121 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 3/s 125 KiB/s 94 KiB/s 2.77 ms 337.55 us 2024-03-25T09:31:25.121 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 3/s 141 KiB/s 103 KiB/s 2.46 ms 313.35 us 2024-03-25T09:31:25.121 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 3/s 132 KiB/s 87 KiB/s 2.27 ms 402.83 us 2024-03-25T09:31:25.121 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 3/s 118 KiB/s 87 KiB/s 2.81 ms 301.10 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 3/s 139 KiB/s 82 KiB/s 2.26 ms 348.69 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 4/s 125 KiB/s 91 KiB/s 2.54 ms 359.67 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 4/s 169 KiB/s 109 KiB/s 2.15 ms 356.23 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 3/s 122 KiB/s 82 KiB/s 2.35 ms 314.23 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 4/s 166 KiB/s 82 KiB/s 2.16 ms 379.51 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 3/s 100 KiB/s 90 KiB/s 2.29 ms 316.81 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 4/s 122 KiB/s 101 KiB/s 2.37 ms 324.42 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 119 KiB/s 67 KiB/s 2.52 ms 341.05 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 110 KiB/s 113 KiB/s 2.71 ms 357.74 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 93 KiB/s 99 KiB/s 2.17 ms 302.84 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 133 KiB/s 81 KiB/s 2.44 ms 342.94 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 3/s 106 KiB/s 124 KiB/s 2.56 ms 425.44 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 121 KiB/s 94 KiB/s 2.51 ms 330.48 us 2024-03-25T09:31:25.122 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 4/s 83 KiB/s 96 KiB/s 2.23 ms 294.80 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 92 KiB/s 119 KiB/s 2.60 ms 433.71 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 94 KiB/s 103 KiB/s 2.48 ms 317.52 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 5/s 98 KiB/s 105 KiB/s 2.29 ms 393.44 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 114 KiB/s 97 KiB/s 2.31 ms 270.66 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 3/s 109 KiB/s 85 KiB/s 2.34 ms 313.59 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 135 KiB/s 123 KiB/s 2.38 ms 345.94 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 5/s 85 KiB/s 136 KiB/s 2.23 ms 372.21 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 3/s 90 KiB/s 106 KiB/s 2.59 ms 590.25 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 108 KiB/s 123 KiB/s 2.32 ms 354.95 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 103 KiB/s 106 KiB/s 2.30 ms 314.89 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 5/s 100 KiB/s 134 KiB/s 2.25 ms 465.90 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 98 KiB/s 102 KiB/s 2.53 ms 439.44 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 103 KiB/s 101 KiB/s 2.43 ms 420.73 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 75 KiB/s 85 KiB/s 2.61 ms 324.50 us 2024-03-25T09:31:25.123 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 113 KiB/s 119 KiB/s 2.13 ms 320.98 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 82 KiB/s 112 KiB/s 2.41 ms 397.50 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 3/s 82 KiB/s 77 KiB/s 2.23 ms 339.03 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 109 KiB/s 98 KiB/s 3.16 ms 319.15 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 4/s 100 KiB/s 109 KiB/s 2.52 ms 379.50 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 5/s 94 KiB/s 125 KiB/s 2.83 ms 324.86 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 133 KiB/s 136 KiB/s 2.78 ms 337.66 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 5/s 60 KiB/s 134 KiB/s 2.46 ms 307.36 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 4/s 101 KiB/s 121 KiB/s 2.55 ms 344.18 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 82 KiB/s 102 KiB/s 2.20 ms 316.46 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 5/s 66 KiB/s 135 KiB/s 2.13 ms 343.58 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 5/s 77 KiB/s 119 KiB/s 2.45 ms 455.19 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 5/s 103 KiB/s 138 KiB/s 2.42 ms 397.92 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 5/s 48 KiB/s 95 KiB/s 2.04 ms 364.10 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 4/s 57 KiB/s 120 KiB/s 2.02 ms 292.10 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 91 KiB/s 139 KiB/s 2.36 ms 511.47 us 2024-03-25T09:31:25.124 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 5/s 96 KiB/s 110 KiB/s 2.20 ms 317.79 us 2024-03-25T09:31:25.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 81 KiB/s 111 KiB/s 2.20 ms 294.56 us 2024-03-25T09:31:25.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 77 KiB/s 142 KiB/s 2.72 ms 436.78 us 2024-03-25T09:31:25.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 5/s 105 KiB/s 133 KiB/s 2.35 ms 323.56 us 2024-03-25T09:31:25.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 2/s 5/s 68 KiB/s 124 KiB/s 2.44 ms 432.08 us 2024-03-25T09:31:25.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 2/s 5/s 82 KiB/s 152 KiB/s 2.21 ms 439.01 us 2024-03-25T09:31:25.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 2/s 5/s 74 KiB/s 170 KiB/s 2.16 ms 296.60 us 2024-03-25T09:31:25.125 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:25.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:24 smithi059 ceph-mon[32732]: pgmap v672: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 469 op/s 2024-03-25T09:31:25.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:24 smithi040 ceph-mon[33094]: pgmap v672: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 469 op/s 2024-03-25T09:31:25.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:25.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:25.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:25.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:24 smithi019 ceph-mon[29386]: pgmap v672: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 469 op/s 2024-03-25T09:31:26.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:25 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 597 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:26.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:25 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 597 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:26.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:25 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 597 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:26.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:26.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:26.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:26 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:26 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:26 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:26 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:26 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:26 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:26 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:27.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:26 smithi059 ceph-mon[32732]: pgmap v673: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 584 op/s 2024-03-25T09:31:27.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:26 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:27.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:26 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:27.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:26 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:27.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:26 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:27.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:26 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:27.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:26 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:27.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:26 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:27.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:26 smithi040 ceph-mon[33094]: pgmap v673: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 584 op/s 2024-03-25T09:31:27.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:27.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:27.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:27.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:26 smithi019 ceph-mon[29386]: pgmap v673: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 584 op/s 2024-03-25T09:31:28.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:27.812+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:28.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:28.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:28.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:29.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:28 smithi059 ceph-mon[32732]: pgmap v674: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.2 MiB/s wr, 514 op/s 2024-03-25T09:31:29.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:28 smithi040 ceph-mon[33094]: pgmap v674: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.2 MiB/s wr, 514 op/s 2024-03-25T09:31:29.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:29.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:29.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:29.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:28 smithi019 ceph-mon[29386]: pgmap v674: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.2 MiB/s wr, 514 op/s 2024-03-25T09:31:29.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:31:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 106.8k 100.4k 0.0k 1.0M 1004.0k 0.0k nvme2n1 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 95.6k 106.8k 0.0k 956.0k 1.0M 0.0k nvme2n10 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 103.2k 118.0k 0.0k 1.0M 1.2M 0.0k nvme2n11 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 128.0k 76.0k 0.0k 1.2M 760.0k 0.0k nvme2n12 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 77.2k 113.6k 0.0k 772.0k 1.1M 0.0k nvme2n13 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 110.0k 86.0k 0.0k 1.1M 860.0k 0.0k nvme2n14 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 96.8k 100.8k 0.0k 968.0k 1008.0k 0.0k nvme2n15 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 104.4k 103.6k 0.0k 1.0M 1.0M 0.0k nvme2n16 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 81.6k 128.8k 0.0k 816.0k 1.3M 0.0k nvme2n17 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 102.4k 79.6k 0.0k 1.0M 796.0k 0.0k nvme2n18 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 95.2k 93.6k 0.0k 952.0k 936.0k 0.0k nvme2n19 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 93.2k 100.4k 0.0k 932.0k 1004.0k 0.0k nvme2n2 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 105.2k 76.0k 0.0k 1.0M 760.0k 0.0k nvme2n20 2024-03-25T09:31:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 115.6k 106.4k 0.0k 1.1M 1.0M 0.0k nvme2n3 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 85.2k 81.6k 0.0k 852.0k 816.0k 0.0k nvme2n4 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 86.4k 105.2k 0.0k 864.0k 1.0M 0.0k nvme2n5 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 118.0k 54.8k 0.0k 1.2M 548.0k 0.0k nvme2n6 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 84.4k 109.6k 0.0k 844.0k 1.1M 0.0k nvme2n7 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 96.0k 106.8k 0.0k 960.0k 1.0M 0.0k nvme2n8 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 107.6k 100.0k 0.0k 1.1M 1000.0k 0.0k nvme2n9 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 82.4k 108.0k 0.0k 824.0k 1.1M 0.0k nvme5n1 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 91.6k 113.2k 0.0k 916.0k 1.1M 0.0k nvme5n10 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 70.8k 107.6k 0.0k 708.0k 1.1M 0.0k nvme5n11 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 93.2k 128.8k 0.0k 932.0k 1.3M 0.0k nvme5n12 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 102.8k 109.6k 0.0k 1.0M 1.1M 0.0k nvme5n13 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 124.4k 121.2k 0.0k 1.2M 1.2M 0.0k nvme5n14 2024-03-25T09:31:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 110.4k 97.6k 0.0k 1.1M 976.0k 0.0k nvme5n15 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 76.4k 98.4k 0.0k 764.0k 984.0k 0.0k nvme5n16 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 97.2k 97.2k 0.0k 972.0k 972.0k 0.0k nvme5n17 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 90.8k 110.4k 0.0k 908.0k 1.1M 0.0k nvme5n18 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 124.0k 103.6k 0.0k 1.2M 1.0M 0.0k nvme5n19 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 88.4k 124.8k 0.0k 884.0k 1.2M 0.0k nvme5n2 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 74.4k 96.4k 0.0k 744.0k 964.0k 0.0k nvme5n20 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 116.0k 106.0k 0.0k 1.1M 1.0M 0.0k nvme5n3 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 124.4k 103.2k 0.0k 1.2M 1.0M 0.0k nvme5n4 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 71.2k 103.2k 0.0k 712.0k 1.0M 0.0k nvme5n5 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 112.0k 90.4k 0.0k 1.1M 904.0k 0.0k nvme5n6 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 88.8k 114.0k 0.0k 888.0k 1.1M 0.0k nvme5n7 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 100.4k 110.0k 0.0k 1004.0k 1.1M 0.0k nvme5n8 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 116.4k 88.8k 0.0k 1.1M 888.0k 0.0k nvme5n9 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 85.6k 123.6k 0.0k 856.0k 1.2M 0.0k nvme8n1 2024-03-25T09:31:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 83.6k 118.4k 0.0k 836.0k 1.2M 0.0k nvme8n10 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 93.2k 99.2k 0.0k 932.0k 992.0k 0.0k nvme8n11 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 80.8k 118.0k 0.0k 808.0k 1.2M 0.0k nvme8n12 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 100.0k 91.2k 0.0k 1000.0k 912.0k 0.0k nvme8n13 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 111.6k 107.6k 0.0k 1.1M 1.1M 0.0k nvme8n14 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 136.0k 92.4k 0.0k 1.3M 924.0k 0.0k nvme8n15 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 99.2k 98.8k 0.0k 992.0k 988.0k 0.0k nvme8n16 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 84.4k 132.0k 0.0k 844.0k 1.3M 0.0k nvme8n17 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 86.0k 128.0k 0.0k 860.0k 1.2M 0.0k nvme8n18 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 105.6k 87.2k 0.0k 1.0M 872.0k 0.0k nvme8n19 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 85.6k 123.2k 0.0k 856.0k 1.2M 0.0k nvme8n2 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 109.6k 76.0k 0.0k 1.1M 760.0k 0.0k nvme8n20 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 117.2k 114.8k 0.0k 1.1M 1.1M 0.0k nvme8n3 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 89.6k 128.0k 0.0k 896.0k 1.2M 0.0k nvme8n4 2024-03-25T09:31:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 96.8k 108.0k 0.0k 968.0k 1.1M 0.0k nvme8n5 2024-03-25T09:31:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 100.4k 100.0k 0.0k 1004.0k 1000.0k 0.0k nvme8n6 2024-03-25T09:31:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 97.2k 69.2k 0.0k 972.0k 692.0k 0.0k nvme8n7 2024-03-25T09:31:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 102.8k 103.2k 0.0k 1.0M 1.0M 0.0k nvme8n8 2024-03-25T09:31:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 106.4k 105.6k 0.0k 1.0M 1.0M 0.0k nvme8n9 2024-03-25T09:31:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:30.124 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 3/s 121 KiB/s 94 KiB/s 2.27 ms 326.85 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 4/s 138 KiB/s 95 KiB/s 2.57 ms 431.10 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 2/s 131 KiB/s 62 KiB/s 2.38 ms 541.94 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 4/s 129 KiB/s 103 KiB/s 3.26 ms 369.27 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 3/s 132 KiB/s 70 KiB/s 2.37 ms 415.12 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 2/s 122 KiB/s 71 KiB/s 2.13 ms 306.41 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 4/s 126 KiB/s 107 KiB/s 2.21 ms 342.39 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 4/s 135 KiB/s 110 KiB/s 2.78 ms 348.92 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 3/s 122 KiB/s 91 KiB/s 2.51 ms 373.28 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 3/s 138 KiB/s 87 KiB/s 2.56 ms 588.58 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 2/s 92 KiB/s 62 KiB/s 2.70 ms 465.60 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 3/s 137 KiB/s 92 KiB/s 2.17 ms 345.93 us 2024-03-25T09:31:30.125 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 3/s 139 KiB/s 66 KiB/s 2.32 ms 369.15 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 3/s 101 KiB/s 57 KiB/s 2.64 ms 312.17 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 4/s 132 KiB/s 109 KiB/s 2.12 ms 367.62 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 106 KiB/s 95 KiB/s 2.69 ms 390.31 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 123 KiB/s 78 KiB/s 2.89 ms 309.10 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 85 KiB/s 90 KiB/s 2.18 ms 317.77 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 110 KiB/s 138 KiB/s 2.39 ms 364.51 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 5/s 105 KiB/s 115 KiB/s 2.26 ms 330.08 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 78 KiB/s 102 KiB/s 2.30 ms 358.52 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 107 KiB/s 104 KiB/s 2.42 ms 320.55 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 91 KiB/s 78 KiB/s 2.36 ms 314.90 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 122 KiB/s 102 KiB/s 2.38 ms 329.84 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 93 KiB/s 58 KiB/s 2.30 ms 288.99 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 5/s 119 KiB/s 138 KiB/s 2.71 ms 316.73 us 2024-03-25T09:31:30.126 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 88 KiB/s 124 KiB/s 2.22 ms 324.42 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 5/s 116 KiB/s 117 KiB/s 2.35 ms 329.09 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 104 KiB/s 84 KiB/s 2.35 ms 268.37 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 5/s 104 KiB/s 120 KiB/s 2.41 ms 328.77 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 4/s 98 KiB/s 100 KiB/s 2.19 ms 352.88 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 114 KiB/s 113 KiB/s 2.72 ms 398.25 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 61 KiB/s 100 KiB/s 2.67 ms 432.68 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 114 KiB/s 98 KiB/s 2.37 ms 513.68 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 3/s 134 KiB/s 71 KiB/s 2.14 ms 297.70 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 5/s 102 KiB/s 150 KiB/s 2.20 ms 346.33 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 86 KiB/s 117 KiB/s 2.24 ms 430.33 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 5/s 92 KiB/s 111 KiB/s 2.64 ms 377.74 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 5/s 86 KiB/s 93 KiB/s 2.14 ms 316.88 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 102 KiB/s 97 KiB/s 2.40 ms 327.82 us 2024-03-25T09:31:30.127 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 86 KiB/s 110 KiB/s 2.76 ms 377.70 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 5/s 102 KiB/s 104 KiB/s 2.33 ms 346.45 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 5/s 88 KiB/s 114 KiB/s 2.05 ms 290.98 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 82 KiB/s 110 KiB/s 2.15 ms 323.01 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 102 KiB/s 86 KiB/s 2.62 ms 307.88 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 5/s 70 KiB/s 97 KiB/s 2.53 ms 323.73 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 115 KiB/s 122 KiB/s 2.43 ms 391.54 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 95 KiB/s 80 KiB/s 2.50 ms 332.31 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 116 KiB/s 84 KiB/s 2.32 ms 443.97 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 5/s 103 KiB/s 103 KiB/s 2.35 ms 299.39 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 97 KiB/s 95 KiB/s 2.41 ms 364.22 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 3/s 90 KiB/s 47 KiB/s 2.79 ms 311.27 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 4/s 99 KiB/s 91 KiB/s 2.43 ms 417.31 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 5/s 105 KiB/s 106 KiB/s 2.46 ms 317.95 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 91 KiB/s 126 KiB/s 2.26 ms 399.18 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 4/s 105 KiB/s 90 KiB/s 2.80 ms 294.54 us 2024-03-25T09:31:30.128 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 5/s 98 KiB/s 100 KiB/s 2.05 ms 328.22 us 2024-03-25T09:31:30.129 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 90 KiB/s 150 KiB/s 2.28 ms 361.62 us 2024-03-25T09:31:30.129 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 5/s 50 KiB/s 162 KiB/s 2.30 ms 355.12 us 2024-03-25T09:31:30.129 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 5/s 94 KiB/s 97 KiB/s 2.23 ms 352.48 us 2024-03-25T09:31:30.129 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:30.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:30.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:30.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:30 smithi059 ceph-mon[32732]: pgmap v675: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 506 op/s 2024-03-25T09:31:31.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:30 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 602 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:30 smithi040 ceph-mon[33094]: pgmap v675: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 506 op/s 2024-03-25T09:31:31.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:30 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 602 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:31.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:31.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:31.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:30 smithi019 ceph-mon[29386]: pgmap v675: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 506 op/s 2024-03-25T09:31:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:30 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 602 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:32.262 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:31 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:32.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:31 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:32.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:31 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:32.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:31 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:32.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:31 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:32.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:31 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:32.263 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:31 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:32.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:31 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:32.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:31 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:32.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:31 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:32.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:31 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:32.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:31 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:32.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:31 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:32.264 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:31 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:32.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:31 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:32.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:31 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:32.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:31 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:32.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:31 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:32.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:31 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:32.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:31 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:32.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:31 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:32.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:32.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:32.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:32.812+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:32 smithi059 ceph-mon[32732]: pgmap v676: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.6 MiB/s wr, 561 op/s 2024-03-25T09:31:33.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:32 smithi040 ceph-mon[33094]: pgmap v676: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.6 MiB/s wr, 561 op/s 2024-03-25T09:31:33.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:33.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:33.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:33.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:32 smithi019 ceph-mon[29386]: pgmap v676: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.6 MiB/s wr, 561 op/s 2024-03-25T09:31:34.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:34.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:34.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:35.130 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:35.130 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 6/s 3/s 145 KiB/s 79 KiB/s 2.66 ms 377.06 us 2024-03-25T09:31:35.130 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 3/s 124 KiB/s 92 KiB/s 2.44 ms 323.70 us 2024-03-25T09:31:35.130 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 3/s 130 KiB/s 78 KiB/s 2.25 ms 307.35 us 2024-03-25T09:31:35.130 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 3/s 114 KiB/s 102 KiB/s 2.43 ms 353.28 us 2024-03-25T09:31:35.130 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 3/s 124 KiB/s 81 KiB/s 2.34 ms 318.66 us 2024-03-25T09:31:35.130 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 3/s 105 KiB/s 58 KiB/s 2.73 ms 315.98 us 2024-03-25T09:31:35.130 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 4/s 130 KiB/s 86 KiB/s 2.43 ms 428.49 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 3/s 134 KiB/s 78 KiB/s 2.49 ms 332.27 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 3/s 127 KiB/s 61 KiB/s 2.24 ms 333.77 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 4/s 131 KiB/s 82 KiB/s 2.29 ms 282.49 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 3/s 106 KiB/s 113 KiB/s 2.24 ms 323.89 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 3/s 143 KiB/s 99 KiB/s 2.60 ms 329.69 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 2/s 82 KiB/s 64 KiB/s 2.52 ms 373.08 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 3/s 91 KiB/s 88 KiB/s 2.20 ms 328.19 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 102 KiB/s 106 KiB/s 2.41 ms 295.05 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 119 KiB/s 79 KiB/s 2.70 ms 310.50 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 3/s 129 KiB/s 66 KiB/s 2.28 ms 359.18 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 106 KiB/s 78 KiB/s 2.71 ms 332.35 us 2024-03-25T09:31:35.131 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 115 KiB/s 70 KiB/s 2.42 ms 314.78 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 94 KiB/s 85 KiB/s 2.37 ms 400.17 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 117 KiB/s 100 KiB/s 2.55 ms 320.39 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 109 KiB/s 88 KiB/s 2.53 ms 348.13 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 95 KiB/s 79 KiB/s 2.28 ms 332.57 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 91 KiB/s 97 KiB/s 2.06 ms 305.48 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 86 KiB/s 84 KiB/s 2.10 ms 406.74 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 5/s 122 KiB/s 108 KiB/s 2.63 ms 337.51 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 107 KiB/s 119 KiB/s 2.26 ms 378.11 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 77 KiB/s 111 KiB/s 2.38 ms 452.93 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 3/s 99 KiB/s 78 KiB/s 2.24 ms 300.82 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 5/s 98 KiB/s 155 KiB/s 2.29 ms 322.13 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 86 KiB/s 80 KiB/s 2.14 ms 397.03 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 4/s 91 KiB/s 110 KiB/s 2.07 ms 385.57 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 3/s 76 KiB/s 71 KiB/s 2.74 ms 335.81 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 97 KiB/s 64 KiB/s 2.37 ms 273.74 us 2024-03-25T09:31:35.132 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 4/s 71 KiB/s 94 KiB/s 2.31 ms 401.71 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 90 KiB/s 92 KiB/s 2.48 ms 372.33 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 61 KiB/s 95 KiB/s 2.18 ms 318.95 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 4/s 87 KiB/s 82 KiB/s 2.62 ms 319.65 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 4/s 84 KiB/s 102 KiB/s 2.48 ms 395.89 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 6/s 86 KiB/s 130 KiB/s 2.30 ms 328.33 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 4/s 74 KiB/s 80 KiB/s 2.66 ms 321.93 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 90 KiB/s 77 KiB/s 2.95 ms 397.32 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 4/s 64 KiB/s 93 KiB/s 2.29 ms 350.54 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 101 KiB/s 107 KiB/s 2.43 ms 295.70 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 100 KiB/s 124 KiB/s 2.41 ms 315.58 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 5/s 65 KiB/s 106 KiB/s 2.36 ms 380.99 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 82 KiB/s 90 KiB/s 2.73 ms 427.74 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 82 KiB/s 87 KiB/s 2.41 ms 485.15 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 57 KiB/s 132 KiB/s 2.86 ms 412.29 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 5/s 90 KiB/s 126 KiB/s 2.39 ms 351.82 us 2024-03-25T09:31:35.133 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 4/s 82 KiB/s 110 KiB/s 2.85 ms 379.88 us 2024-03-25T09:31:35.134 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 4/s 66 KiB/s 105 KiB/s 2.62 ms 343.72 us 2024-03-25T09:31:35.134 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 45 KiB/s 118 KiB/s 3.10 ms 406.11 us 2024-03-25T09:31:35.134 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 4/s 62 KiB/s 101 KiB/s 2.14 ms 313.82 us 2024-03-25T09:31:35.134 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 5/s 76 KiB/s 122 KiB/s 2.69 ms 342.70 us 2024-03-25T09:31:35.134 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 5/s 79 KiB/s 130 KiB/s 2.62 ms 325.01 us 2024-03-25T09:31:35.134 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 4/s 64 KiB/s 129 KiB/s 2.53 ms 376.88 us 2024-03-25T09:31:35.134 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 5/s 62 KiB/s 139 KiB/s 2.12 ms 361.64 us 2024-03-25T09:31:35.134 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 2/s 4/s 69 KiB/s 120 KiB/s 2.06 ms 306.52 us 2024-03-25T09:31:35.134 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 2/s 7/s 38 KiB/s 132 KiB/s 2.97 ms 409.16 us 2024-03-25T09:31:35.134 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:35.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:34 smithi059 ceph-mon[32732]: pgmap v677: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 458 op/s 2024-03-25T09:31:35.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:34 smithi040 ceph-mon[33094]: pgmap v677: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 458 op/s 2024-03-25T09:31:35.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:35.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:35.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:35.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:34 smithi019 ceph-mon[29386]: pgmap v677: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 458 op/s 2024-03-25T09:31:36.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:35 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 607 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:36.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:35 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 607 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:36.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:35 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 607 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:36.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:36.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:36.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:36 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:36 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:36 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:36 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:36 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:36 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:36 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:37.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:36 smithi059 ceph-mon[32732]: pgmap v678: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.4 MiB/s wr, 572 op/s 2024-03-25T09:31:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:36 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:36 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:36 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:36 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:36 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:36 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:36 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:37.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:36 smithi040 ceph-mon[33094]: pgmap v678: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.4 MiB/s wr, 572 op/s 2024-03-25T09:31:37.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:37.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:37.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:37.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:36 smithi019 ceph-mon[29386]: pgmap v678: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.4 MiB/s wr, 572 op/s 2024-03-25T09:31:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:37.812+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:37 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:31:38.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:37 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:31:38.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:37 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:31:38.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:38.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:38.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:39.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:38 smithi059 ceph-mon[32732]: pgmap v679: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 505 op/s 2024-03-25T09:31:39.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:31:39.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:38 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:31:39.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:38 smithi040 ceph-mon[33094]: pgmap v679: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 505 op/s 2024-03-25T09:31:39.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:31:39.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:38 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:31:39.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:39.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:39.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:39.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:38 smithi019 ceph-mon[29386]: pgmap v679: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 505 op/s 2024-03-25T09:31:39.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:31:39.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:38 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:31:39.671 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 95.6k 96.0k 0.0k 956.0k 960.0k 0.0k nvme2n1 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 95.2k 87.6k 0.0k 952.0k 876.0k 0.0k nvme2n10 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 72.4k 97.6k 0.0k 724.0k 976.0k 0.0k nvme2n11 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 76.0k 96.4k 0.0k 760.0k 964.0k 0.0k nvme2n12 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 82.8k 76.8k 0.0k 828.0k 768.0k 0.0k nvme2n13 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 86.0k 89.2k 0.0k 860.0k 892.0k 0.0k nvme2n14 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 114.4k 95.6k 0.0k 1.1M 956.0k 0.0k nvme2n15 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 74.4k 118.8k 0.0k 744.0k 1.2M 0.0k nvme2n16 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 87.6k 95.2k 0.0k 876.0k 952.0k 0.0k nvme2n17 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 91.2k 95.6k 0.0k 912.0k 956.0k 0.0k nvme2n18 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 102.8k 79.6k 0.0k 1.0M 796.0k 0.0k nvme2n19 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 56.8k 87.6k 0.0k 568.0k 876.0k 0.0k nvme2n2 2024-03-25T09:31:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 80.0k 92.0k 0.0k 800.0k 920.0k 0.0k nvme2n20 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 86.0k 92.0k 0.0k 860.0k 920.0k 0.0k nvme2n3 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 93.6k 95.6k 0.0k 936.0k 956.0k 0.0k nvme2n4 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 72.4k 94.8k 0.0k 724.0k 948.0k 0.0k nvme2n5 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 102.4k 93.2k 0.0k 1.0M 932.0k 0.0k nvme2n6 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 84.8k 74.0k 0.0k 848.0k 740.0k 0.0k nvme2n7 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 84.4k 103.2k 0.0k 844.0k 1.0M 0.0k nvme2n8 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 86.0k 104.4k 0.0k 860.0k 1.0M 0.0k nvme2n9 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 91.2k 98.4k 0.0k 912.0k 984.0k 0.0k nvme5n1 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 106.0k 104.0k 0.0k 1.0M 1.0M 0.0k nvme5n10 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 49.2k 129.2k 0.0k 492.0k 1.3M 0.0k nvme5n11 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 112.0k 92.8k 0.0k 1.1M 928.0k 0.0k nvme5n12 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 96.4k 103.6k 0.0k 964.0k 1.0M 0.0k nvme5n13 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 117.2k 95.2k 0.0k 1.1M 952.0k 0.0k nvme5n14 2024-03-25T09:31:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 84.8k 82.0k 0.0k 848.0k 820.0k 0.0k nvme5n15 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 105.2k 76.4k 0.0k 1.0M 764.0k 0.0k nvme5n16 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 92.4k 83.6k 0.0k 924.0k 836.0k 0.0k nvme5n17 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 89.2k 95.2k 0.0k 892.0k 952.0k 0.0k nvme5n18 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 81.2k 90.8k 0.0k 812.0k 908.0k 0.0k nvme5n19 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 90.4k 90.0k 0.0k 904.0k 900.0k 0.0k nvme5n2 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 96.0k 86.4k 0.0k 960.0k 864.0k 0.0k nvme5n20 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 70.8k 120.0k 0.0k 708.0k 1.2M 0.0k nvme5n3 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 118.4k 102.4k 0.0k 1.2M 1.0M 0.0k nvme5n4 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 83.2k 91.2k 0.0k 832.0k 912.0k 0.0k nvme5n5 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 85.2k 99.2k 0.0k 852.0k 992.0k 0.0k nvme5n6 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 111.2k 60.4k 0.0k 1.1M 604.0k 0.0k nvme5n7 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 103.6k 79.6k 0.0k 1.0M 796.0k 0.0k nvme5n8 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 69.2k 92.4k 0.0k 692.0k 924.0k 0.0k nvme5n9 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 104.4k 62.0k 0.0k 1.0M 620.0k 0.0k nvme8n1 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 95.2k 78.0k 0.0k 952.0k 780.0k 0.0k nvme8n10 2024-03-25T09:31:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 89.6k 104.0k 0.0k 896.0k 1.0M 0.0k nvme8n11 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 107.6k 79.2k 0.0k 1.1M 792.0k 0.0k nvme8n12 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 111.2k 94.4k 0.0k 1.1M 944.0k 0.0k nvme8n13 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 67.2k 77.6k 0.0k 672.0k 776.0k 0.0k nvme8n14 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 92.4k 87.2k 0.0k 924.0k 872.0k 0.0k nvme8n15 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 134.4k 59.2k 0.0k 1.3M 592.0k 0.0k nvme8n16 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 92.4k 92.8k 0.0k 924.0k 928.0k 0.0k nvme8n17 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 81.2k 110.0k 0.0k 812.0k 1.1M 0.0k nvme8n18 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 108.0k 77.2k 0.0k 1.1M 772.0k 0.0k nvme8n19 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 89.2k 96.8k 0.0k 892.0k 968.0k 0.0k nvme8n2 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 99.6k 101.2k 0.0k 996.0k 1012.0k 0.0k nvme8n20 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 123.2k 97.6k 0.0k 1.2M 976.0k 0.0k nvme8n3 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 124.8k 80.0k 0.0k 1.2M 800.0k 0.0k nvme8n4 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 98.0k 88.8k 0.0k 980.0k 888.0k 0.0k nvme8n5 2024-03-25T09:31:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 87.6k 86.4k 0.0k 876.0k 864.0k 0.0k nvme8n6 2024-03-25T09:31:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 103.6k 87.2k 0.0k 1.0M 872.0k 0.0k nvme8n7 2024-03-25T09:31:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 85.2k 89.6k 0.0k 852.0k 896.0k 0.0k nvme8n8 2024-03-25T09:31:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 83.6k 114.8k 0.0k 836.0k 1.1M 0.0k nvme8n9 2024-03-25T09:31:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:40.135 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:40.135 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 2/s 117 KiB/s 43 KiB/s 2.77 ms 278.39 us 2024-03-25T09:31:40.135 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 3/s 123 KiB/s 52 KiB/s 2.50 ms 329.92 us 2024-03-25T09:31:40.135 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 3/s 125 KiB/s 110 KiB/s 2.41 ms 358.07 us 2024-03-25T09:31:40.135 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 4/s 112 KiB/s 104 KiB/s 2.43 ms 463.36 us 2024-03-25T09:31:40.135 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 4/s 104 KiB/s 119 KiB/s 2.44 ms 310.76 us 2024-03-25T09:31:40.135 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 4/s 86 KiB/s 122 KiB/s 2.15 ms 311.18 us 2024-03-25T09:31:40.135 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 5/s 3/s 106 KiB/s 68 KiB/s 2.73 ms 316.58 us 2024-03-25T09:31:40.135 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 3/s 106 KiB/s 61 KiB/s 2.46 ms 304.26 us 2024-03-25T09:31:40.135 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 4/s 115 KiB/s 126 KiB/s 2.05 ms 341.02 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 3/s 133 KiB/s 57 KiB/s 2.48 ms 293.26 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 4/s 119 KiB/s 89 KiB/s 2.31 ms 386.42 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 132 KiB/s 76 KiB/s 2.04 ms 338.44 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 4/s 89 KiB/s 100 KiB/s 2.11 ms 324.75 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 2/s 98 KiB/s 70 KiB/s 2.24 ms 318.82 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 5/s 129 KiB/s 98 KiB/s 2.47 ms 328.38 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 3/s 94 KiB/s 80 KiB/s 2.37 ms 329.23 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 3/s 113 KiB/s 82 KiB/s 2.93 ms 355.66 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 5/s 84 KiB/s 82 KiB/s 2.52 ms 293.41 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 4/s 86 KiB/s 86 KiB/s 2.14 ms 332.91 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 77 KiB/s 110 KiB/s 2.32 ms 492.44 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 91 KiB/s 88 KiB/s 2.13 ms 371.20 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 122 KiB/s 94 KiB/s 2.61 ms 373.09 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 4/s 113 KiB/s 108 KiB/s 2.27 ms 317.59 us 2024-03-25T09:31:40.136 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 3/s 83 KiB/s 60 KiB/s 2.23 ms 374.45 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 3/s 83 KiB/s 94 KiB/s 2.67 ms 327.08 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 110 KiB/s 106 KiB/s 2.34 ms 338.46 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 126 KiB/s 98 KiB/s 2.44 ms 341.96 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 87 KiB/s 83 KiB/s 2.29 ms 315.84 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 116 KiB/s 78 KiB/s 2.43 ms 427.26 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 5/s 87 KiB/s 78 KiB/s 2.30 ms 508.80 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 82 KiB/s 76 KiB/s 2.78 ms 360.71 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 3/s 83 KiB/s 101 KiB/s 3.39 ms 408.97 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 3/s 94 KiB/s 71 KiB/s 2.42 ms 295.12 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 83 KiB/s 94 KiB/s 2.37 ms 312.41 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 91 KiB/s 94 KiB/s 2.72 ms 323.56 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 3/s 101 KiB/s 90 KiB/s 2.92 ms 324.95 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 5/s 91 KiB/s 110 KiB/s 2.46 ms 339.17 us 2024-03-25T09:31:40.137 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 57 KiB/s 59 KiB/s 2.37 ms 331.06 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 3/s 96 KiB/s 64 KiB/s 2.47 ms 284.03 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 4/s 82 KiB/s 84 KiB/s 2.43 ms 431.98 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 97 KiB/s 91 KiB/s 2.45 ms 313.57 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 3/s 65 KiB/s 84 KiB/s 2.30 ms 336.81 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 87 KiB/s 82 KiB/s 2.57 ms 304.68 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 3/s 98 KiB/s 83 KiB/s 2.74 ms 369.46 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 5/s 77 KiB/s 108 KiB/s 2.52 ms 433.86 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 75 KiB/s 113 KiB/s 2.58 ms 323.24 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 5/s 90 KiB/s 110 KiB/s 2.28 ms 411.19 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 5/s 78 KiB/s 87 KiB/s 2.35 ms 316.25 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 107 KiB/s 65 KiB/s 2.34 ms 329.21 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 79 KiB/s 125 KiB/s 2.61 ms 338.38 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 91 KiB/s 108 KiB/s 2.44 ms 342.43 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 86 KiB/s 94 KiB/s 2.27 ms 356.35 us 2024-03-25T09:31:40.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 79 KiB/s 59 KiB/s 2.45 ms 435.19 us 2024-03-25T09:31:40.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 108 KiB/s 110 KiB/s 2.29 ms 438.47 us 2024-03-25T09:31:40.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 5/s 75 KiB/s 122 KiB/s 2.29 ms 312.58 us 2024-03-25T09:31:40.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 5/s 74 KiB/s 102 KiB/s 2.26 ms 351.64 us 2024-03-25T09:31:40.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 5/s 97 KiB/s 95 KiB/s 2.66 ms 354.73 us 2024-03-25T09:31:40.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 54 KiB/s 116 KiB/s 2.73 ms 430.80 us 2024-03-25T09:31:40.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 2/s 6/s 55 KiB/s 159 KiB/s 2.62 ms 437.48 us 2024-03-25T09:31:40.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 2/s 5/s 53 KiB/s 110 KiB/s 2.35 ms 355.68 us 2024-03-25T09:31:40.139 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:31:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:31:40.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:39 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:31:40.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:31:40.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:31:40.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:39 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:31:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:31:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:31:40.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:39 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:31:40.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:40.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:40.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:40 smithi059 ceph-mon[32732]: pgmap v680: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 471 op/s 2024-03-25T09:31:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:40 smithi059 ceph-mon[32732]: pgmap v681: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 488 op/s 2024-03-25T09:31:41.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:40 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 612 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:40 smithi040 ceph-mon[33094]: pgmap v680: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 471 op/s 2024-03-25T09:31:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:40 smithi040 ceph-mon[33094]: pgmap v681: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 488 op/s 2024-03-25T09:31:41.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:40 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 612 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:41.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:41.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:41.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:41.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:40 smithi019 ceph-mon[29386]: pgmap v680: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 471 op/s 2024-03-25T09:31:41.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:40 smithi019 ceph-mon[29386]: pgmap v681: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 488 op/s 2024-03-25T09:31:41.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:40 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 612 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:41 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:41 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:41 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:41 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:41 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:41 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:42.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:41 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:41 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:41 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:41 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:41 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:41 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:41 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:42.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:41 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:42.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:41 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:42.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:41 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:42.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:41 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:42.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:41 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:42.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:41 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:42.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:41 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:42.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:41 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:42.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:42.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:42.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:43.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:42.812+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:43.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:42 smithi059 ceph-mon[32732]: pgmap v682: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 484 op/s 2024-03-25T09:31:43.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:42 smithi040 ceph-mon[33094]: pgmap v682: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 484 op/s 2024-03-25T09:31:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:43.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:42 smithi019 ceph-mon[29386]: pgmap v682: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 484 op/s 2024-03-25T09:31:44.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:44.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:44.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:45.138 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:45.138 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 4/s 104 KiB/s 98 KiB/s 2.81 ms 339.77 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 5/s 3/s 102 KiB/s 89 KiB/s 2.59 ms 324.43 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 2/s 118 KiB/s 41 KiB/s 2.60 ms 294.25 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 4/s 132 KiB/s 82 KiB/s 2.35 ms 354.18 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 4/s 110 KiB/s 84 KiB/s 2.68 ms 418.97 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 3/s 103 KiB/s 70 KiB/s 2.56 ms 326.10 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 3/s 86 KiB/s 78 KiB/s 2.19 ms 333.93 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 3/s 89 KiB/s 73 KiB/s 2.42 ms 318.16 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 3/s 105 KiB/s 72 KiB/s 2.54 ms 401.45 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 3/s 110 KiB/s 85 KiB/s 2.85 ms 339.34 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 100 KiB/s 70 KiB/s 2.36 ms 346.33 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 114 KiB/s 85 KiB/s 2.79 ms 367.99 us 2024-03-25T09:31:45.139 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 109 KiB/s 91 KiB/s 2.86 ms 322.10 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 3/s 93 KiB/s 84 KiB/s 2.55 ms 335.90 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 92 KiB/s 107 KiB/s 2.20 ms 308.43 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 114 KiB/s 76 KiB/s 2.37 ms 308.77 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 74 KiB/s 66 KiB/s 3.11 ms 379.57 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 106 KiB/s 111 KiB/s 2.55 ms 295.70 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 80 KiB/s 94 KiB/s 2.73 ms 308.48 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 75 KiB/s 78 KiB/s 2.52 ms 340.94 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 78 KiB/s 114 KiB/s 2.39 ms 305.25 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 98 KiB/s 118 KiB/s 2.93 ms 329.99 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 5/s 101 KiB/s 123 KiB/s 2.45 ms 385.88 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 102 KiB/s 46 KiB/s 2.51 ms 342.28 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 3/s 96 KiB/s 60 KiB/s 2.27 ms 321.98 us 2024-03-25T09:31:45.140 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 97 KiB/s 112 KiB/s 2.57 ms 344.43 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 97 KiB/s 93 KiB/s 2.59 ms 335.94 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 5/s 69 KiB/s 102 KiB/s 2.67 ms 328.03 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 101 KiB/s 91 KiB/s 2.96 ms 418.20 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 79 KiB/s 102 KiB/s 2.50 ms 318.26 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 4/s 90 KiB/s 96 KiB/s 2.67 ms 396.73 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 98 KiB/s 106 KiB/s 2.27 ms 357.78 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 99 KiB/s 121 KiB/s 2.74 ms 338.25 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 4/s 101 KiB/s 85 KiB/s 2.47 ms 332.90 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 5/s 94 KiB/s 146 KiB/s 2.31 ms 349.43 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 80 KiB/s 85 KiB/s 2.63 ms 290.17 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 95 KiB/s 82 KiB/s 2.39 ms 365.83 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 92 KiB/s 86 KiB/s 2.35 ms 277.32 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 85 KiB/s 80 KiB/s 2.52 ms 328.20 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 90 KiB/s 79 KiB/s 2.35 ms 393.80 us 2024-03-25T09:31:45.141 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 75 KiB/s 87 KiB/s 2.50 ms 393.71 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 4/s 78 KiB/s 76 KiB/s 2.37 ms 303.64 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 3/s 70 KiB/s 81 KiB/s 2.70 ms 343.96 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 78 KiB/s 112 KiB/s 2.30 ms 441.67 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 4/s 84 KiB/s 82 KiB/s 2.70 ms 406.89 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 4/s 65 KiB/s 93 KiB/s 2.30 ms 324.56 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 5/s 98 KiB/s 134 KiB/s 2.35 ms 379.24 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 3/s 81 KiB/s 83 KiB/s 2.36 ms 285.52 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 3/s 75 KiB/s 86 KiB/s 2.28 ms 402.85 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 4/s 78 KiB/s 114 KiB/s 2.32 ms 333.48 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 61 KiB/s 100 KiB/s 2.34 ms 406.22 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 89 KiB/s 87 KiB/s 2.31 ms 352.95 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 5/s 85 KiB/s 149 KiB/s 2.77 ms 367.41 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 4/s 70 KiB/s 79 KiB/s 2.22 ms 355.79 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 4/s 64 KiB/s 120 KiB/s 2.07 ms 322.50 us 2024-03-25T09:31:45.142 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 6/s 90 KiB/s 158 KiB/s 2.24 ms 325.03 us 2024-03-25T09:31:45.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 4/s 59 KiB/s 106 KiB/s 2.84 ms 427.09 us 2024-03-25T09:31:45.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 4/s 93 KiB/s 65 KiB/s 2.68 ms 342.84 us 2024-03-25T09:31:45.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 3/s 69 KiB/s 86 KiB/s 2.30 ms 413.73 us 2024-03-25T09:31:45.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 2/s 5/s 38 KiB/s 126 KiB/s 2.73 ms 374.56 us 2024-03-25T09:31:45.143 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:45.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:44 smithi059 ceph-mon[32732]: pgmap v683: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 545 op/s 2024-03-25T09:31:45.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:44 smithi040 ceph-mon[33094]: pgmap v683: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 545 op/s 2024-03-25T09:31:45.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:45.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:45.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:45.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:44 smithi019 ceph-mon[29386]: pgmap v683: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 545 op/s 2024-03-25T09:31:46.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:45 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 617 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:46.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:45 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 617 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:46.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:45 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 617 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:46.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:46.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:46.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:47 smithi059 ceph-mon[32732]: pgmap v684: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 449 op/s 2024-03-25T09:31:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:47 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:47 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:47 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:47 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:47 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:47 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:47.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:47 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:47.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-mon[33094]: pgmap v684: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 449 op/s 2024-03-25T09:31:47.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:47.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:47.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:47.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:47.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:47.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:47.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:47.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:47.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:47.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:47.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:47 smithi019 ceph-mon[29386]: pgmap v684: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 449 op/s 2024-03-25T09:31:47.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:47 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:47.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:47 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:47.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:47 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:47.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:47 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:47.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:47 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:47.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:47 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:47.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:47 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:47.813+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:48.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:48.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:48.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:49.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:49 smithi059 ceph-mon[32732]: pgmap v685: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.0 MiB/s wr, 514 op/s 2024-03-25T09:31:49.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:49 smithi040 ceph-mon[33094]: pgmap v685: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.0 MiB/s wr, 514 op/s 2024-03-25T09:31:49.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:49.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:49.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:49.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:49 smithi019 ceph-mon[29386]: pgmap v685: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.0 MiB/s wr, 514 op/s 2024-03-25T09:31:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:31:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 100.8k 56.0k 0.0k 1008.0k 560.0k 0.0k nvme2n1 2024-03-25T09:31:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 64.4k 94.4k 0.0k 644.0k 944.0k 0.0k nvme2n10 2024-03-25T09:31:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 93.6k 82.4k 0.0k 936.0k 824.0k 0.0k nvme2n11 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 81.6k 94.4k 0.0k 816.0k 944.0k 0.0k nvme2n12 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 56.8k 86.8k 0.0k 568.0k 868.0k 0.0k nvme2n13 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 101.2k 71.6k 0.0k 1012.0k 716.0k 0.0k nvme2n14 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 81.6k 86.8k 0.0k 816.0k 868.0k 0.0k nvme2n15 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 93.2k 66.4k 0.0k 932.0k 664.0k 0.0k nvme2n16 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 98.8k 93.2k 0.0k 988.0k 932.0k 0.0k nvme2n17 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 84.8k 60.4k 0.0k 848.0k 604.0k 0.0k nvme2n18 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 95.2k 97.2k 0.0k 952.0k 972.0k 0.0k nvme2n19 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 82.0k 107.6k 0.0k 820.0k 1.1M 0.0k nvme2n2 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 95.6k 67.6k 0.0k 956.0k 676.0k 0.0k nvme2n20 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 87.6k 84.8k 0.0k 876.0k 848.0k 0.0k nvme2n3 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 73.6k 81.2k 0.0k 736.0k 812.0k 0.0k nvme2n4 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 73.6k 106.8k 0.0k 736.0k 1.0M 0.0k nvme2n5 2024-03-25T09:31:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 105.2k 54.4k 0.0k 1.0M 544.0k 0.0k nvme2n6 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 90.0k 69.2k 0.0k 900.0k 692.0k 0.0k nvme2n7 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 90.0k 71.6k 0.0k 900.0k 716.0k 0.0k nvme2n8 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 83.6k 80.8k 0.0k 836.0k 808.0k 0.0k nvme2n9 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 54.8k 95.6k 0.0k 548.0k 956.0k 0.0k nvme5n1 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 60.0k 90.8k 0.0k 600.0k 908.0k 0.0k nvme5n10 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 84.4k 74.0k 0.0k 844.0k 740.0k 0.0k nvme5n11 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 71.2k 97.6k 0.0k 712.0k 976.0k 0.0k nvme5n12 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 112.8k 85.6k 0.0k 1.1M 856.0k 0.0k nvme5n13 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 80.0k 84.4k 0.0k 800.0k 844.0k 0.0k nvme5n14 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 77.6k 83.6k 0.0k 776.0k 836.0k 0.0k nvme5n15 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 100.8k 90.4k 0.0k 1008.0k 904.0k 0.0k nvme5n16 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 72.8k 105.2k 0.0k 728.0k 1.0M 0.0k nvme5n17 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 89.2k 75.2k 0.0k 892.0k 752.0k 0.0k nvme5n18 2024-03-25T09:31:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 75.2k 66.0k 0.0k 752.0k 660.0k 0.0k nvme5n19 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 70.4k 89.2k 0.0k 704.0k 892.0k 0.0k nvme5n2 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 80.4k 111.2k 0.0k 804.0k 1.1M 0.0k nvme5n20 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 83.2k 82.0k 0.0k 832.0k 820.0k 0.0k nvme5n3 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 73.6k 108.0k 0.0k 736.0k 1.1M 0.0k nvme5n4 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 103.2k 63.6k 0.0k 1.0M 636.0k 0.0k nvme5n5 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 80.8k 105.6k 0.0k 808.0k 1.0M 0.0k nvme5n6 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 60.8k 76.4k 0.0k 608.0k 764.0k 0.0k nvme5n7 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 87.6k 88.0k 0.0k 876.0k 880.0k 0.0k nvme5n8 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 84.4k 96.4k 0.0k 844.0k 964.0k 0.0k nvme5n9 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 92.0k 82.0k 0.0k 920.0k 820.0k 0.0k nvme8n1 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 71.6k 91.6k 0.0k 716.0k 916.0k 0.0k nvme8n10 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 74.4k 70.8k 0.0k 744.0k 708.0k 0.0k nvme8n11 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 88.8k 83.6k 0.0k 888.0k 836.0k 0.0k nvme8n12 2024-03-25T09:31:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 99.2k 95.6k 0.0k 992.0k 956.0k 0.0k nvme8n13 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 78.8k 100.4k 0.0k 788.0k 1004.0k 0.0k nvme8n14 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 119.6k 91.2k 0.0k 1.2M 912.0k 0.0k nvme8n15 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.60 89.6k 71.6k 0.0k 896.0k 716.0k 0.0k nvme8n16 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 94.4k 98.8k 0.0k 944.0k 988.0k 0.0k nvme8n17 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 90.8k 78.0k 0.0k 908.0k 780.0k 0.0k nvme8n18 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 87.6k 76.4k 0.0k 876.0k 764.0k 0.0k nvme8n19 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 93.6k 93.6k 0.0k 936.0k 936.0k 0.0k nvme8n2 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 91.6k 68.8k 0.0k 916.0k 688.0k 0.0k nvme8n20 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 98.8k 94.4k 0.0k 988.0k 944.0k 0.0k nvme8n3 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 78.0k 101.6k 0.0k 780.0k 1016.0k 0.0k nvme8n4 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 95.6k 94.0k 0.0k 956.0k 940.0k 0.0k nvme8n5 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 85.2k 94.8k 0.0k 852.0k 948.0k 0.0k nvme8n6 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 98.0k 68.0k 0.0k 980.0k 680.0k 0.0k nvme8n7 2024-03-25T09:31:49.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 96.8k 68.0k 0.0k 968.0k 680.0k 0.0k nvme8n8 2024-03-25T09:31:49.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.50 83.6k 98.8k 0.0k 836.0k 988.0k 0.0k nvme8n9 2024-03-25T09:31:49.688 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 6/s 3/s 138 KiB/s 68 KiB/s 2.26 ms 355.45 us 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 6/s 3/s 111 KiB/s 65 KiB/s 2.47 ms 313.01 us 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 3/s 116 KiB/s 93 KiB/s 2.38 ms 339.28 us 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 4/s 118 KiB/s 68 KiB/s 2.19 ms 308.93 us 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 4/s 92 KiB/s 79 KiB/s 2.34 ms 325.91 us 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 3/s 81 KiB/s 63 KiB/s 2.49 ms 335.08 us 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 3/s 118 KiB/s 82 KiB/s 2.46 ms 390.31 us 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 3/s 81 KiB/s 88 KiB/s 2.03 ms 337.64 us 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 5/s 92 KiB/s 140 KiB/s 2.40 ms 365.04 us 2024-03-25T09:31:50.143 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 4/s 128 KiB/s 54 KiB/s 2.30 ms 289.33 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 3/s 102 KiB/s 64 KiB/s 2.47 ms 332.33 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 4/s 110 KiB/s 117 KiB/s 2.45 ms 434.48 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 5/s 98 KiB/s 121 KiB/s 2.56 ms 368.83 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 113 KiB/s 98 KiB/s 2.22 ms 374.53 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 78 KiB/s 96 KiB/s 2.71 ms 355.56 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 5/s 101 KiB/s 105 KiB/s 2.56 ms 381.25 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 102 KiB/s 54 KiB/s 2.39 ms 365.54 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 3/s 106 KiB/s 84 KiB/s 2.21 ms 282.68 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 3/s 76 KiB/s 56 KiB/s 2.42 ms 550.25 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 102 KiB/s 76 KiB/s 2.38 ms 301.35 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 73 KiB/s 102 KiB/s 2.16 ms 347.44 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 4/s 82 KiB/s 68 KiB/s 2.43 ms 314.09 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 3/s 98 KiB/s 78 KiB/s 2.28 ms 409.75 us 2024-03-25T09:31:50.144 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 98 KiB/s 98 KiB/s 2.62 ms 389.24 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 89 KiB/s 88 KiB/s 2.74 ms 404.66 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 111 KiB/s 70 KiB/s 2.56 ms 298.87 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 103 KiB/s 76 KiB/s 2.56 ms 402.32 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 74 KiB/s 90 KiB/s 2.31 ms 315.61 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 3/s 71 KiB/s 71 KiB/s 2.54 ms 302.05 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 98 KiB/s 66 KiB/s 3.05 ms 401.81 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 94 KiB/s 90 KiB/s 2.26 ms 341.57 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 74 KiB/s 71 KiB/s 2.10 ms 397.17 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 78 KiB/s 90 KiB/s 2.71 ms 311.91 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 89 KiB/s 67 KiB/s 2.98 ms 301.72 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 90 KiB/s 72 KiB/s 2.43 ms 331.81 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 84 KiB/s 122 KiB/s 2.39 ms 361.56 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 3/s 82 KiB/s 62 KiB/s 2.47 ms 322.63 us 2024-03-25T09:31:50.145 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 74 KiB/s 74 KiB/s 2.75 ms 308.16 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 5/s 65 KiB/s 121 KiB/s 2.44 ms 385.93 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 59 KiB/s 96 KiB/s 2.52 ms 322.56 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 74 KiB/s 120 KiB/s 3.08 ms 391.75 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 66 KiB/s 107 KiB/s 2.20 ms 339.29 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 5/s 98 KiB/s 87 KiB/s 2.88 ms 366.75 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 3/s 62 KiB/s 71 KiB/s 3.44 ms 382.70 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 5/s 83 KiB/s 80 KiB/s 2.36 ms 504.07 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 3/s 70 KiB/s 67 KiB/s 2.38 ms 310.72 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 3/s 68 KiB/s 59 KiB/s 2.36 ms 454.26 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 3/s 79 KiB/s 69 KiB/s 2.63 ms 289.24 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 61 KiB/s 116 KiB/s 2.20 ms 346.17 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 4/s 85 KiB/s 114 KiB/s 2.41 ms 513.40 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 5/s 69 KiB/s 114 KiB/s 2.19 ms 328.34 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 3/s 72 KiB/s 88 KiB/s 2.40 ms 438.82 us 2024-03-25T09:31:50.146 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 76 KiB/s 103 KiB/s 2.56 ms 356.33 us 2024-03-25T09:31:50.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 4/s 57 KiB/s 107 KiB/s 2.41 ms 337.59 us 2024-03-25T09:31:50.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 3/s 66 KiB/s 52 KiB/s 3.34 ms 415.78 us 2024-03-25T09:31:50.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 4/s 58 KiB/s 79 KiB/s 2.37 ms 339.88 us 2024-03-25T09:31:50.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 58 KiB/s 118 KiB/s 2.49 ms 361.42 us 2024-03-25T09:31:50.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 5/s 50 KiB/s 90 KiB/s 2.12 ms 362.78 us 2024-03-25T09:31:50.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 2/s 4/s 34 KiB/s 82 KiB/s 2.97 ms 388.87 us 2024-03-25T09:31:50.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 2/s 3/s 35 KiB/s 85 KiB/s 2.51 ms 317.09 us 2024-03-25T09:31:50.147 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:50.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:50.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:50.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:51 smithi059 ceph-mon[32732]: pgmap v686: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 519 op/s 2024-03-25T09:31:51.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:51 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 622 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:51 smithi040 ceph-mon[33094]: pgmap v686: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 519 op/s 2024-03-25T09:31:51.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:51 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 622 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:51.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:51.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:51.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:51.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:51 smithi019 ceph-mon[29386]: pgmap v686: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 519 op/s 2024-03-25T09:31:51.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:51 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 622 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:52.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:52 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:52.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:52 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:52.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:52 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:52.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:52 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:52.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:52 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:52.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:52 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:52.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:52 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:52.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:52.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:52.311 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:52 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:52 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:52 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:52 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:52 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:52 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:52.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:52 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:52 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:52 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:52 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:52 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:52 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:52 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:52.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:52 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:52.813+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:53 smithi059 ceph-mon[32732]: pgmap v687: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.4 MiB/s wr, 552 op/s 2024-03-25T09:31:53.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:53 smithi040 ceph-mon[33094]: pgmap v687: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.4 MiB/s wr, 552 op/s 2024-03-25T09:31:53.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:53.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:53.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:53.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:53 smithi019 ceph-mon[29386]: pgmap v687: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.4 MiB/s wr, 552 op/s 2024-03-25T09:31:54.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:54.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:54.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:55.146 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 6/s 2/s 114 KiB/s 42 KiB/s 2.36 ms 336.41 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 6/s 3/s 113 KiB/s 64 KiB/s 2.58 ms 292.49 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 4/s 124 KiB/s 80 KiB/s 2.68 ms 330.92 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 3/s 111 KiB/s 53 KiB/s 2.74 ms 326.63 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 3/s 100 KiB/s 66 KiB/s 2.24 ms 315.00 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 3/s 98 KiB/s 41 KiB/s 2.43 ms 296.86 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 2/s 66 KiB/s 54 KiB/s 2.26 ms 290.27 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 3/s 87 KiB/s 49 KiB/s 2.25 ms 398.29 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 4/s 110 KiB/s 79 KiB/s 3.03 ms 329.67 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 3/s 92 KiB/s 53 KiB/s 2.46 ms 320.78 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 134 KiB/s 76 KiB/s 2.53 ms 314.42 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 3/s 85 KiB/s 76 KiB/s 2.17 ms 387.59 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 3/s 74 KiB/s 54 KiB/s 2.50 ms 311.90 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 104 KiB/s 93 KiB/s 2.55 ms 395.62 us 2024-03-25T09:31:55.147 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 4/s 90 KiB/s 110 KiB/s 2.78 ms 386.90 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 3/s 139 KiB/s 43 KiB/s 2.38 ms 305.47 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 99 KiB/s 68 KiB/s 2.29 ms 315.21 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 113 KiB/s 77 KiB/s 3.06 ms 380.55 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 94 KiB/s 71 KiB/s 2.73 ms 394.29 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 91 KiB/s 86 KiB/s 2.59 ms 435.51 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 71 KiB/s 65 KiB/s 2.98 ms 341.22 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 70 KiB/s 73 KiB/s 2.91 ms 336.91 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 92 KiB/s 111 KiB/s 2.40 ms 316.20 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 91 KiB/s 74 KiB/s 2.50 ms 478.40 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 79 KiB/s 112 KiB/s 2.57 ms 312.17 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 3/s 101 KiB/s 62 KiB/s 2.59 ms 321.95 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 3/s 91 KiB/s 54 KiB/s 2.41 ms 288.79 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 91 KiB/s 92 KiB/s 2.49 ms 445.38 us 2024-03-25T09:31:55.148 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 3/s 83 KiB/s 83 KiB/s 2.35 ms 370.17 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 82 KiB/s 98 KiB/s 2.54 ms 350.98 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 3/s 59 KiB/s 72 KiB/s 2.14 ms 425.15 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 86 KiB/s 94 KiB/s 2.77 ms 351.19 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 98 KiB/s 58 KiB/s 2.66 ms 346.58 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 4/s 80 KiB/s 63 KiB/s 2.55 ms 467.32 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 4/s 82 KiB/s 74 KiB/s 2.42 ms 394.48 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 3/s 78 KiB/s 66 KiB/s 2.35 ms 292.49 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 3/s 75 KiB/s 66 KiB/s 2.69 ms 352.85 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 57 KiB/s 106 KiB/s 2.69 ms 338.52 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 94 KiB/s 86 KiB/s 2.62 ms 353.97 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 63 KiB/s 66 KiB/s 2.46 ms 402.71 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 3/s 48 KiB/s 62 KiB/s 2.56 ms 365.26 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 65 KiB/s 70 KiB/s 3.57 ms 300.65 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 71 KiB/s 82 KiB/s 2.59 ms 319.18 us 2024-03-25T09:31:55.149 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 3/s 63 KiB/s 54 KiB/s 2.31 ms 289.07 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 4/s 100 KiB/s 110 KiB/s 2.48 ms 394.41 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 4/s 54 KiB/s 88 KiB/s 2.59 ms 337.28 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 4/s 86 KiB/s 67 KiB/s 2.19 ms 298.57 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 54 KiB/s 89 KiB/s 2.57 ms 370.54 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 4/s 72 KiB/s 86 KiB/s 2.50 ms 403.80 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 66 KiB/s 78 KiB/s 2.39 ms 340.04 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 4/s 53 KiB/s 90 KiB/s 2.20 ms 324.78 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 5/s 78 KiB/s 99 KiB/s 2.39 ms 320.02 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 4/s 54 KiB/s 89 KiB/s 2.59 ms 314.79 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 5/s 66 KiB/s 83 KiB/s 2.29 ms 318.66 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 60 KiB/s 114 KiB/s 2.18 ms 329.95 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 44 KiB/s 86 KiB/s 2.57 ms 393.37 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 5/s 67 KiB/s 127 KiB/s 2.20 ms 390.77 us 2024-03-25T09:31:55.150 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 65 KiB/s 97 KiB/s 2.44 ms 321.98 us 2024-03-25T09:31:55.151 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 2/s 4/s 55 KiB/s 87 KiB/s 2.61 ms 312.61 us 2024-03-25T09:31:55.151 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 2/s 5/s 28 KiB/s 92 KiB/s 2.16 ms 354.55 us 2024-03-25T09:31:55.151 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:55.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:55 smithi019 ceph-mon[29386]: pgmap v688: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.8 MiB/s wr, 502 op/s 2024-03-25T09:31:55.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:55 smithi059 ceph-mon[32732]: pgmap v688: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.8 MiB/s wr, 502 op/s 2024-03-25T09:31:55.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:55 smithi040 ceph-mon[33094]: pgmap v688: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.8 MiB/s wr, 502 op/s 2024-03-25T09:31:55.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:55.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:55.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:56.309 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:56 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 627 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:56.309 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:56.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:56.310 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:56.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:56 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 627 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:56 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 627 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:31:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:57 smithi019 ceph-mon[29386]: pgmap v689: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 490 op/s 2024-03-25T09:31:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:57 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:57 smithi019 ceph-mon[29386]: { 2024-03-25T09:31:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:57 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:31:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:57 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:31:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:57 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:31:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:57 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:31:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:57 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:31:57.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-mon[33094]: pgmap v689: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 490 op/s 2024-03-25T09:31:57.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:57.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-mon[33094]: { 2024-03-25T09:31:57.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:31:57.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:31:57.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:31:57.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:31:57.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:31:57.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:57.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:57.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:57 smithi059 ceph-mon[32732]: pgmap v689: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 490 op/s 2024-03-25T09:31:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:57 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:31:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:57 smithi059 ceph-mon[32732]: { 2024-03-25T09:31:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:57 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:31:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:57 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:31:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:57 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:31:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:57 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:31:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:57 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:31:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:31:57.814+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:31:58.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:58.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:31:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:58.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:31:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:31:59 smithi019 ceph-mon[29386]: pgmap v690: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 543 op/s 2024-03-25T09:31:59.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:31:59 smithi059 ceph-mon[32732]: pgmap v690: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 543 op/s 2024-03-25T09:31:59.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:31:59 smithi040 ceph-mon[33094]: pgmap v690: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 543 op/s 2024-03-25T09:31:59.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:31:59.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:31:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:31:59.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:31:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:31:59.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:31:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:31:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 88.8k 114.8k 0.0k 888.0k 1.1M 0.0k nvme2n1 2024-03-25T09:31:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 68.4k 62.0k 0.0k 684.0k 620.0k 0.0k nvme2n10 2024-03-25T09:31:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 87.6k 87.6k 0.0k 876.0k 876.0k 0.0k nvme2n11 2024-03-25T09:31:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 80.0k 80.0k 0.0k 800.0k 800.0k 0.0k nvme2n12 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 72.0k 72.4k 0.0k 720.0k 724.0k 0.0k nvme2n13 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 72.0k 92.0k 0.0k 720.0k 920.0k 0.0k nvme2n14 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 76.0k 71.6k 0.0k 760.0k 716.0k 0.0k nvme2n15 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 79.6k 84.4k 0.0k 796.0k 844.0k 0.0k nvme2n16 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 88.8k 85.6k 0.0k 888.0k 856.0k 0.0k nvme2n17 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 69.2k 93.6k 0.0k 692.0k 936.0k 0.0k nvme2n18 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 82.0k 73.2k 0.0k 820.0k 732.0k 0.0k nvme2n19 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 78.4k 78.0k 0.0k 784.0k 780.0k 0.0k nvme2n2 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 113.6k 121.2k 0.0k 1.1M 1.2M 0.0k nvme2n20 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 95.2k 62.0k 0.0k 952.0k 620.0k 0.0k nvme2n3 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 92.4k 66.8k 0.0k 924.0k 668.0k 0.0k nvme2n4 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 79.2k 78.4k 0.0k 792.0k 784.0k 0.0k nvme2n5 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 88.8k 78.8k 0.0k 888.0k 788.0k 0.0k nvme2n6 2024-03-25T09:31:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 123.6k 130.4k 0.0k 1.2M 1.3M 0.0k nvme2n7 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 70.8k 86.4k 0.0k 708.0k 864.0k 0.0k nvme2n8 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 47.2k 120.0k 0.0k 472.0k 1.2M 0.0k nvme2n9 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 112.8k 100.4k 0.0k 1.1M 1004.0k 0.0k nvme5n1 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 59.6k 88.8k 0.0k 596.0k 888.0k 0.0k nvme5n10 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 85.2k 79.6k 0.0k 852.0k 796.0k 0.0k nvme5n11 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 68.0k 90.8k 0.0k 680.0k 908.0k 0.0k nvme5n12 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 96.4k 80.0k 0.0k 964.0k 800.0k 0.0k nvme5n13 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 88.4k 90.0k 0.0k 884.0k 900.0k 0.0k nvme5n14 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 92.4k 78.8k 0.0k 924.0k 788.0k 0.0k nvme5n15 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 87.6k 80.4k 0.0k 876.0k 804.0k 0.0k nvme5n16 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 58.0k 79.6k 0.0k 580.0k 796.0k 0.0k nvme5n17 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 70.0k 88.8k 0.0k 700.0k 888.0k 0.0k nvme5n18 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 98.8k 88.0k 0.0k 988.0k 880.0k 0.0k nvme5n19 2024-03-25T09:31:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 69.6k 77.6k 0.0k 696.0k 776.0k 0.0k nvme5n2 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 81.2k 85.6k 0.0k 812.0k 856.0k 0.0k nvme5n20 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 77.2k 88.4k 0.0k 772.0k 884.0k 0.0k nvme5n3 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 91.2k 68.0k 0.0k 912.0k 680.0k 0.0k nvme5n4 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 81.2k 74.4k 0.0k 812.0k 744.0k 0.0k nvme5n5 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 54.4k 92.8k 0.0k 544.0k 928.0k 0.0k nvme5n6 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 89.6k 70.4k 0.0k 896.0k 704.0k 0.0k nvme5n7 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 75.2k 74.8k 0.0k 752.0k 748.0k 0.0k nvme5n8 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 63.6k 86.4k 0.0k 636.0k 864.0k 0.0k nvme5n9 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 90.8k 85.2k 0.0k 908.0k 852.0k 0.0k nvme8n1 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 88.8k 68.8k 0.0k 888.0k 688.0k 0.0k nvme8n10 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 87.2k 97.6k 0.0k 872.0k 976.0k 0.0k nvme8n11 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 96.8k 88.0k 0.0k 968.0k 880.0k 0.0k nvme8n12 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 86.4k 78.4k 0.0k 864.0k 784.0k 0.0k nvme8n13 2024-03-25T09:31:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 109.2k 87.2k 0.0k 1.1M 872.0k 0.0k nvme8n14 2024-03-25T09:31:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 65.2k 112.4k 0.0k 652.0k 1.1M 0.0k nvme8n15 2024-03-25T09:31:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 125.6k 74.0k 0.0k 1.2M 740.0k 0.0k nvme8n16 2024-03-25T09:31:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 64.8k 70.0k 0.0k 648.0k 700.0k 0.0k nvme8n17 2024-03-25T09:31:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 58.8k 88.4k 0.0k 588.0k 884.0k 0.0k nvme8n18 2024-03-25T09:31:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 86.4k 90.8k 0.0k 864.0k 908.0k 0.0k nvme8n19 2024-03-25T09:31:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 78.8k 80.8k 0.0k 788.0k 808.0k 0.0k nvme8n2 2024-03-25T09:31:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 64.0k 86.0k 0.0k 640.0k 860.0k 0.0k nvme8n20 2024-03-25T09:31:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 75.2k 92.0k 0.0k 752.0k 920.0k 0.0k nvme8n3 2024-03-25T09:31:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 87.2k 92.0k 0.0k 872.0k 920.0k 0.0k nvme8n4 2024-03-25T09:31:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 91.6k 68.4k 0.0k 916.0k 684.0k 0.0k nvme8n5 2024-03-25T09:31:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 94.4k 72.4k 0.0k 944.0k 724.0k 0.0k nvme8n6 2024-03-25T09:31:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 78.0k 89.2k 0.0k 780.0k 892.0k 0.0k nvme8n7 2024-03-25T09:31:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 70.0k 75.6k 0.0k 700.0k 756.0k 0.0k nvme8n8 2024-03-25T09:31:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 72.0k 77.6k 0.0k 720.0k 776.0k 0.0k nvme8n9 2024-03-25T09:31:59.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:00.152 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 3/s 170 KiB/s 139 KiB/s 2.94 ms 320.70 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 5/s 134 KiB/s 117 KiB/s 2.48 ms 312.04 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 3/s 130 KiB/s 50 KiB/s 2.68 ms 239.23 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 5/s 98 KiB/s 118 KiB/s 3.09 ms 427.63 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 5/s 106 KiB/s 102 KiB/s 2.13 ms 300.79 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 3/s 125 KiB/s 69 KiB/s 2.24 ms 355.94 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 3/s 81 KiB/s 71 KiB/s 2.11 ms 352.53 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 4/s 86 KiB/s 90 KiB/s 2.49 ms 303.13 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 5/s 90 KiB/s 133 KiB/s 2.37 ms 284.83 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 4/s 98 KiB/s 95 KiB/s 2.51 ms 285.21 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 4/s 94 KiB/s 97 KiB/s 2.45 ms 315.86 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 3/s 84 KiB/s 54 KiB/s 2.44 ms 311.76 us 2024-03-25T09:32:00.153 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 3/s 73 KiB/s 50 KiB/s 2.45 ms 317.36 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 4/s 83 KiB/s 78 KiB/s 2.32 ms 306.54 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 3/s 112 KiB/s 59 KiB/s 2.52 ms 335.35 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 4/s 78 KiB/s 85 KiB/s 2.92 ms 489.15 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 5/s 77 KiB/s 97 KiB/s 2.87 ms 329.15 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 78 KiB/s 56 KiB/s 2.48 ms 492.75 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 3/s 115 KiB/s 61 KiB/s 2.24 ms 333.14 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 110 KiB/s 64 KiB/s 2.50 ms 307.94 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 3/s 98 KiB/s 36 KiB/s 2.53 ms 426.35 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 87 KiB/s 62 KiB/s 2.98 ms 346.77 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 3/s 85 KiB/s 72 KiB/s 2.30 ms 320.18 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 2/s 114 KiB/s 42 KiB/s 2.40 ms 283.36 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 78 KiB/s 74 KiB/s 2.52 ms 320.22 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 3/s 73 KiB/s 47 KiB/s 2.49 ms 351.53 us 2024-03-25T09:32:00.154 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 106 KiB/s 82 KiB/s 2.58 ms 393.36 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 95 KiB/s 89 KiB/s 2.54 ms 338.00 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 2/s 106 KiB/s 47 KiB/s 2.57 ms 319.35 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 2/s 87 KiB/s 50 KiB/s 2.39 ms 332.21 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 102 KiB/s 77 KiB/s 2.47 ms 436.62 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 65 KiB/s 77 KiB/s 2.64 ms 313.11 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 55 KiB/s 79 KiB/s 2.71 ms 477.78 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 4/s 68 KiB/s 101 KiB/s 2.48 ms 302.64 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 4/s 90 KiB/s 74 KiB/s 2.35 ms 347.29 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 3/s 99 KiB/s 62 KiB/s 2.43 ms 335.21 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 72 KiB/s 82 KiB/s 2.30 ms 334.93 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 98 KiB/s 60 KiB/s 2.34 ms 312.92 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 3/s 95 KiB/s 49 KiB/s 2.37 ms 303.41 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 70 KiB/s 88 KiB/s 2.82 ms 349.16 us 2024-03-25T09:32:00.155 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 4/s 77 KiB/s 93 KiB/s 2.62 ms 339.26 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 58 KiB/s 54 KiB/s 3.02 ms 382.68 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 3/s 81 KiB/s 76 KiB/s 2.62 ms 354.82 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 3/s 82 KiB/s 86 KiB/s 2.84 ms 381.12 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 71 KiB/s 66 KiB/s 2.59 ms 342.50 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 3/s 74 KiB/s 79 KiB/s 3.02 ms 342.24 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 4/s 109 KiB/s 126 KiB/s 2.40 ms 300.52 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 4/s 111 KiB/s 95 KiB/s 2.64 ms 294.37 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 3/s 86 KiB/s 61 KiB/s 2.37 ms 313.94 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 3/s 62 KiB/s 78 KiB/s 1.95 ms 331.23 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 4/s 66 KiB/s 98 KiB/s 2.69 ms 337.67 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 4/s 95 KiB/s 88 KiB/s 2.61 ms 334.67 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 75 KiB/s 82 KiB/s 3.02 ms 326.61 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 5/s 74 KiB/s 94 KiB/s 2.38 ms 319.62 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 3/s 86 KiB/s 86 KiB/s 2.62 ms 413.80 us 2024-03-25T09:32:00.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 3/s 36 KiB/s 65 KiB/s 2.13 ms 469.77 us 2024-03-25T09:32:00.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 83 KiB/s 120 KiB/s 2.39 ms 366.81 us 2024-03-25T09:32:00.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 3/s 46 KiB/s 57 KiB/s 2.38 ms 376.33 us 2024-03-25T09:32:00.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 52 KiB/s 110 KiB/s 2.97 ms 448.20 us 2024-03-25T09:32:00.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 58 KiB/s 103 KiB/s 2.99 ms 326.57 us 2024-03-25T09:32:00.157 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:00.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:00.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:00.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:01 smithi019 ceph-mon[29386]: pgmap v691: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 469 op/s 2024-03-25T09:32:01.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:01 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 632 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:01.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:01 smithi059 ceph-mon[32732]: pgmap v691: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 469 op/s 2024-03-25T09:32:01.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:01 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 632 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:01.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:01 smithi040 ceph-mon[33094]: pgmap v691: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 469 op/s 2024-03-25T09:32:01.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:01 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 632 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:01.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:01.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:01.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:02.292 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:02 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:02.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:02 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:02.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:02 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:02.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:02 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:02.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:02 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:02.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:02 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:02.294 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:02 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:02 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:02 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:02 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:02 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:02 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:02 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:02.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:02 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:02 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:02 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:02 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:02 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:02 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:02 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:02.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:02 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:02.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:02.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:02.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:02.814+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:03 smithi059 ceph-mon[32732]: pgmap v692: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 539 op/s 2024-03-25T09:32:03.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:03 smithi019 ceph-mon[29386]: pgmap v692: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 539 op/s 2024-03-25T09:32:03.415 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:03 smithi040 ceph-mon[33094]: pgmap v692: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 539 op/s 2024-03-25T09:32:03.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:03.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:03.416 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:04.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:04.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:04.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:05.156 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:05.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 6/s 4/s 154 KiB/s 106 KiB/s 2.42 ms 480.92 us 2024-03-25T09:32:05.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 6/s 3/s 122 KiB/s 66 KiB/s 2.42 ms 379.56 us 2024-03-25T09:32:05.156 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 90 KiB/s 110 KiB/s 2.93 ms 328.65 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 133 KiB/s 74 KiB/s 2.23 ms 287.37 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 3/s 123 KiB/s 43 KiB/s 2.36 ms 297.26 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 5/s 79 KiB/s 96 KiB/s 2.48 ms 323.58 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 3/s 106 KiB/s 82 KiB/s 2.44 ms 336.39 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 3/s 106 KiB/s 59 KiB/s 2.36 ms 482.58 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 4/s 90 KiB/s 99 KiB/s 2.49 ms 303.94 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 4/s 77 KiB/s 92 KiB/s 2.33 ms 386.77 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 3/s 88 KiB/s 59 KiB/s 2.47 ms 381.51 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 149 KiB/s 159 KiB/s 2.47 ms 361.62 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 3/s 93 KiB/s 71 KiB/s 2.96 ms 524.15 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 4/s 101 KiB/s 82 KiB/s 3.05 ms 292.37 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 97 KiB/s 54 KiB/s 2.33 ms 304.68 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 95 KiB/s 80 KiB/s 2.41 ms 416.54 us 2024-03-25T09:32:05.157 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 87 KiB/s 84 KiB/s 2.83 ms 420.03 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 69 KiB/s 66 KiB/s 2.56 ms 340.77 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 5/s 89 KiB/s 110 KiB/s 2.21 ms 405.46 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 74 KiB/s 71 KiB/s 2.59 ms 279.60 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 3/s 97 KiB/s 56 KiB/s 2.39 ms 279.43 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 86 KiB/s 108 KiB/s 2.73 ms 409.66 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 3/s 152 KiB/s 104 KiB/s 2.15 ms 360.50 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 4/s 75 KiB/s 70 KiB/s 2.39 ms 303.73 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 138 KiB/s 148 KiB/s 2.26 ms 334.53 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 2/s 142 KiB/s 65 KiB/s 2.17 ms 345.40 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 95 KiB/s 71 KiB/s 2.57 ms 370.73 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 74 KiB/s 102 KiB/s 2.93 ms 344.71 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 3/s 86 KiB/s 73 KiB/s 2.39 ms 451.93 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 5/s 81 KiB/s 100 KiB/s 2.26 ms 317.26 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 85 KiB/s 78 KiB/s 2.87 ms 360.44 us 2024-03-25T09:32:05.158 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 4/s 128 KiB/s 143 KiB/s 2.30 ms 347.84 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 72 KiB/s 118 KiB/s 2.33 ms 346.31 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 4/s 100 KiB/s 88 KiB/s 2.32 ms 281.75 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 82 KiB/s 90 KiB/s 2.40 ms 358.39 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 5/s 51 KiB/s 90 KiB/s 2.45 ms 301.10 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 66 KiB/s 106 KiB/s 2.67 ms 408.86 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 2/s 90 KiB/s 61 KiB/s 2.29 ms 319.07 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 78 KiB/s 98 KiB/s 2.92 ms 517.00 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 2/s 93 KiB/s 59 KiB/s 3.02 ms 326.02 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 4/s 73 KiB/s 85 KiB/s 2.34 ms 315.39 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 3/s 60 KiB/s 56 KiB/s 2.53 ms 428.63 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 4/s 68 KiB/s 71 KiB/s 2.44 ms 318.37 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 3/s 71 KiB/s 71 KiB/s 2.81 ms 316.86 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 3/s 78 KiB/s 63 KiB/s 2.47 ms 394.95 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 5/s 55 KiB/s 76 KiB/s 2.43 ms 344.66 us 2024-03-25T09:32:05.159 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 3/s 81 KiB/s 76 KiB/s 2.20 ms 345.06 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 3/s 50 KiB/s 74 KiB/s 2.31 ms 300.00 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 4/s 66 KiB/s 90 KiB/s 2.65 ms 344.01 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 5/s 108 KiB/s 129 KiB/s 2.97 ms 422.35 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 5/s 56 KiB/s 85 KiB/s 2.57 ms 363.34 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 46 KiB/s 74 KiB/s 2.41 ms 319.83 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 5/s 54 KiB/s 104 KiB/s 2.38 ms 334.34 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 3/s 59 KiB/s 62 KiB/s 2.64 ms 314.64 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 4/s 60 KiB/s 166 KiB/s 2.77 ms 334.98 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 3/s 77 KiB/s 92 KiB/s 3.22 ms 424.92 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 2/s 4/s 58 KiB/s 89 KiB/s 2.51 ms 464.23 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 2/s 6/s 51 KiB/s 119 KiB/s 2.53 ms 428.08 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 2/s 5/s 99 KiB/s 192 KiB/s 3.02 ms 373.95 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 2/s 4/s 52 KiB/s 83 KiB/s 2.74 ms 415.31 us 2024-03-25T09:32:05.160 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:05.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:05 smithi019 ceph-mon[29386]: pgmap v693: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 498 op/s 2024-03-25T09:32:05.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:05 smithi059 ceph-mon[32732]: pgmap v693: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 498 op/s 2024-03-25T09:32:05.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:05 smithi040 ceph-mon[33094]: pgmap v693: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 498 op/s 2024-03-25T09:32:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:06.316 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:06 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 637 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:06.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:06 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 637 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:06.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:06 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 637 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:06.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:06.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:06.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:07 smithi019 ceph-mon[29386]: pgmap v694: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.9 MiB/s wr, 492 op/s 2024-03-25T09:32:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:07 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:07 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:07 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:07 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:07 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:07.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:07 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:07.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:07 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:07.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-mon[33094]: pgmap v694: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.9 MiB/s wr, 492 op/s 2024-03-25T09:32:07.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:07.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:07.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:07.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:07.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:07.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:07.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:07.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:07.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:07.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:07 smithi059 ceph-mon[32732]: pgmap v694: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.9 MiB/s wr, 492 op/s 2024-03-25T09:32:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:07 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:07 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:07 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:07 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:07 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:07 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:07.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:07 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:08.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:07.814+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:08.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:08.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:08.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:09.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:09 smithi019 ceph-mon[29386]: pgmap v695: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 557 op/s 2024-03-25T09:32:09.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:09 smithi059 ceph-mon[32732]: pgmap v695: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 557 op/s 2024-03-25T09:32:09.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:09 smithi040 ceph-mon[33094]: pgmap v695: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 557 op/s 2024-03-25T09:32:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:09.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 122.4k 117.2k 0.0k 1.2M 1.1M 0.0k nvme2n1 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 142.0k 84.4k 0.0k 1.4M 844.0k 0.0k nvme2n10 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 70.0k 106.4k 0.0k 700.0k 1.0M 0.0k nvme2n11 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 80.4k 81.2k 0.0k 804.0k 812.0k 0.0k nvme2n12 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 110.0k 104.8k 0.0k 1.1M 1.0M 0.0k nvme2n13 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 78.4k 72.4k 0.0k 784.0k 724.0k 0.0k nvme2n14 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 149.6k 126.0k 0.0k 1.5M 1.2M 0.0k nvme2n15 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 75.2k 74.0k 0.0k 752.0k 740.0k 0.0k nvme2n16 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.40 125.2k 104.8k 0.0k 1.2M 1.0M 0.0k nvme2n17 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.40 132.4k 138.8k 0.0k 1.3M 1.4M 0.0k nvme2n18 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.40 77.2k 74.0k 0.0k 772.0k 740.0k 0.0k nvme2n19 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 85.2k 106.8k 0.0k 852.0k 1.0M 0.0k nvme2n2 2024-03-25T09:32:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 98.4k 160.8k 0.0k 984.0k 1.6M 0.0k nvme2n20 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 97.2k 92.4k 0.0k 972.0k 924.0k 0.0k nvme2n3 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 114.8k 106.4k 0.0k 1.1M 1.0M 0.0k nvme2n4 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 64.8k 65.6k 0.0k 648.0k 656.0k 0.0k nvme2n5 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 136.4k 116.8k 0.0k 1.3M 1.1M 0.0k nvme2n6 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 133.6k 116.0k 0.0k 1.3M 1.1M 0.0k nvme2n7 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 92.8k 73.2k 0.0k 928.0k 732.0k 0.0k nvme2n8 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 129.2k 106.0k 0.0k 1.3M 1.0M 0.0k nvme2n9 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 173.6k 118.0k 0.0k 1.7M 1.2M 0.0k nvme5n1 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 70.0k 84.0k 0.0k 700.0k 840.0k 0.0k nvme5n10 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 84.4k 118.8k 0.0k 844.0k 1.2M 0.0k nvme5n11 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 94.8k 67.2k 0.0k 948.0k 672.0k 0.0k nvme5n12 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 93.6k 101.2k 0.0k 936.0k 1012.0k 0.0k nvme5n13 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 74.8k 76.8k 0.0k 748.0k 768.0k 0.0k nvme5n14 2024-03-25T09:32:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 69.6k 79.2k 0.0k 696.0k 792.0k 0.0k nvme5n15 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 94.8k 144.0k 0.0k 948.0k 1.4M 0.0k nvme5n16 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 94.0k 148.8k 0.0k 940.0k 1.5M 0.0k nvme5n17 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.40 79.2k 82.8k 0.0k 792.0k 828.0k 0.0k nvme5n18 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.40 70.8k 75.2k 0.0k 708.0k 752.0k 0.0k nvme5n19 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 120.8k 102.4k 0.0k 1.2M 1.0M 0.0k nvme5n2 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.40 96.4k 93.2k 0.0k 964.0k 932.0k 0.0k nvme5n20 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 64.0k 74.8k 0.0k 640.0k 748.0k 0.0k nvme5n3 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 72.8k 86.8k 0.0k 728.0k 868.0k 0.0k nvme5n4 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 99.2k 98.8k 0.0k 992.0k 988.0k 0.0k nvme5n5 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 72.4k 74.8k 0.0k 724.0k 748.0k 0.0k nvme5n6 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 148.0k 99.2k 0.0k 1.4M 992.0k 0.0k nvme5n7 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 65.2k 75.2k 0.0k 652.0k 752.0k 0.0k nvme5n8 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 67.2k 104.4k 0.0k 672.0k 1.0M 0.0k nvme5n9 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 74.4k 90.0k 0.0k 744.0k 900.0k 0.0k nvme8n1 2024-03-25T09:32:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 97.6k 127.2k 0.0k 976.0k 1.2M 0.0k nvme8n10 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 95.2k 96.8k 0.0k 952.0k 968.0k 0.0k nvme8n11 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 116.0k 143.2k 0.0k 1.1M 1.4M 0.0k nvme8n12 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 56.8k 97.6k 0.0k 568.0k 976.0k 0.0k nvme8n13 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 132.8k 146.0k 0.0k 1.3M 1.4M 0.0k nvme8n14 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 83.2k 88.0k 0.0k 832.0k 880.0k 0.0k nvme8n15 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 128.8k 125.6k 0.0k 1.3M 1.2M 0.0k nvme8n16 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.40 70.0k 86.4k 0.0k 700.0k 864.0k 0.0k nvme8n17 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.40 91.2k 91.6k 0.0k 912.0k 916.0k 0.0k nvme8n18 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.40 124.4k 68.8k 0.0k 1.2M 688.0k 0.0k nvme8n19 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 74.0k 124.0k 0.0k 740.0k 1.2M 0.0k nvme8n2 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 84.0k 82.0k 0.0k 840.0k 820.0k 0.0k nvme8n20 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 76.0k 79.2k 0.0k 760.0k 792.0k 0.0k nvme8n3 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 117.6k 98.8k 0.0k 1.1M 988.0k 0.0k nvme8n4 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 91.2k 76.0k 0.0k 912.0k 760.0k 0.0k nvme8n5 2024-03-25T09:32:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 116.0k 132.8k 0.0k 1.1M 1.3M 0.0k nvme8n6 2024-03-25T09:32:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 122.4k 102.8k 0.0k 1.2M 1.0M 0.0k nvme8n7 2024-03-25T09:32:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 123.6k 130.0k 0.0k 1.2M 1.3M 0.0k nvme8n8 2024-03-25T09:32:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.30 96.0k 80.4k 0.0k 960.0k 804.0k 0.0k nvme8n9 2024-03-25T09:32:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:10.160 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:10.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 6/s 3/s 161 KiB/s 105 KiB/s 2.35 ms 381.88 us 2024-03-25T09:32:10.160 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 6/s 4/s 172 KiB/s 93 KiB/s 2.67 ms 304.83 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 4/s 90 KiB/s 84 KiB/s 2.83 ms 440.07 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 3/s 110 KiB/s 70 KiB/s 2.72 ms 310.72 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 3/s 85 KiB/s 46 KiB/s 2.50 ms 290.24 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 3/s 79 KiB/s 70 KiB/s 2.44 ms 395.77 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 3/s 146 KiB/s 107 KiB/s 2.59 ms 269.23 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 3/s 98 KiB/s 67 KiB/s 2.03 ms 351.48 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 74 KiB/s 80 KiB/s 2.99 ms 309.73 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 103 KiB/s 70 KiB/s 2.47 ms 341.91 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 5/s 105 KiB/s 142 KiB/s 2.59 ms 335.49 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 126 KiB/s 175 KiB/s 2.43 ms 418.06 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 152 KiB/s 126 KiB/s 2.43 ms 311.53 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 102 KiB/s 79 KiB/s 2.39 ms 357.61 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 3/s 88 KiB/s 58 KiB/s 2.85 ms 354.95 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 110 KiB/s 100 KiB/s 2.49 ms 392.18 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 107 KiB/s 67 KiB/s 2.56 ms 439.15 us 2024-03-25T09:32:10.161 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 86 KiB/s 62 KiB/s 2.32 ms 331.37 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 132 KiB/s 86 KiB/s 2.97 ms 396.16 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 5/s 126 KiB/s 182 KiB/s 2.49 ms 358.57 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 100 KiB/s 94 KiB/s 2.41 ms 287.94 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 92 KiB/s 62 KiB/s 2.20 ms 318.27 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 118 KiB/s 155 KiB/s 3.29 ms 396.56 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 141 KiB/s 122 KiB/s 2.87 ms 354.29 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 78 KiB/s 78 KiB/s 2.45 ms 346.30 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 80 KiB/s 62 KiB/s 2.86 ms 493.77 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 128 KiB/s 166 KiB/s 2.37 ms 335.07 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 63 KiB/s 85 KiB/s 2.54 ms 355.22 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 2/s 65 KiB/s 38 KiB/s 2.50 ms 320.94 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 2/s 105 KiB/s 65 KiB/s 3.12 ms 334.39 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 84 KiB/s 62 KiB/s 2.60 ms 345.57 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 4/s 126 KiB/s 145 KiB/s 2.57 ms 345.80 us 2024-03-25T09:32:10.162 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 96 KiB/s 121 KiB/s 2.68 ms 411.54 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 133 KiB/s 144 KiB/s 2.55 ms 413.40 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 79 KiB/s 68 KiB/s 2.96 ms 299.39 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 3/s 65 KiB/s 67 KiB/s 2.40 ms 400.55 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 5/s 66 KiB/s 109 KiB/s 2.51 ms 331.65 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 108 KiB/s 112 KiB/s 2.55 ms 375.50 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 4/s 61 KiB/s 94 KiB/s 2.47 ms 397.63 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 3/s 70 KiB/s 75 KiB/s 2.47 ms 320.30 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 3/s 59 KiB/s 77 KiB/s 2.59 ms 335.05 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 149 KiB/s 129 KiB/s 2.47 ms 481.66 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 86 KiB/s 70 KiB/s 2.47 ms 311.38 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 4/s 58 KiB/s 109 KiB/s 2.62 ms 429.36 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 2/s 57 KiB/s 61 KiB/s 2.33 ms 283.61 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 4/s 99 KiB/s 157 KiB/s 2.19 ms 323.33 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 4/s 50 KiB/s 61 KiB/s 2.35 ms 293.45 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 4/s 73 KiB/s 111 KiB/s 2.28 ms 312.69 us 2024-03-25T09:32:10.163 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 5/s 110 KiB/s 171 KiB/s 2.76 ms 331.30 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 5/s 103 KiB/s 150 KiB/s 2.20 ms 302.69 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 5/s 78 KiB/s 137 KiB/s 2.63 ms 319.80 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 86 KiB/s 86 KiB/s 2.64 ms 310.22 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 4/s 102 KiB/s 136 KiB/s 2.81 ms 359.46 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 5/s 73 KiB/s 141 KiB/s 2.13 ms 321.60 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 3/s 110 KiB/s 84 KiB/s 3.17 ms 357.63 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 89 KiB/s 150 KiB/s 3.25 ms 404.17 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 2/s 3/s 104 KiB/s 81 KiB/s 2.88 ms 432.93 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 2/s 5/s 38 KiB/s 102 KiB/s 2.34 ms 307.56 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 2/s 4/s 54 KiB/s 62 KiB/s 2.30 ms 279.36 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 2/s 3/s 59 KiB/s 50 KiB/s 2.54 ms 316.45 us 2024-03-25T09:32:10.164 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:10.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:10.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:10.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:11.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:11 smithi019 ceph-mon[29386]: pgmap v696: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 483 op/s 2024-03-25T09:32:11.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:11 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 642 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:11.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:11 smithi059 ceph-mon[32732]: pgmap v696: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 483 op/s 2024-03-25T09:32:11.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:11 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 642 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:11.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:11 smithi040 ceph-mon[33094]: pgmap v696: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 483 op/s 2024-03-25T09:32:11.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:11 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 642 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:11.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:11.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:11.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:12.355 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:12 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:12.355 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:12 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:12.355 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:12 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:12.355 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:12 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:12.355 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:12 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:12.355 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:12 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:12.355 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:12 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:12 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:12 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:12 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:12 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:12 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:12 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:12.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:12 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:12 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:12 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:12 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:12 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:12 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:12 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:12.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:12 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:12.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:12.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:12.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:12.814+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:13 smithi059 ceph-mon[32732]: pgmap v697: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.8 MiB/s wr, 547 op/s 2024-03-25T09:32:13.299 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:13 smithi040 ceph-mon[33094]: pgmap v697: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.8 MiB/s wr, 547 op/s 2024-03-25T09:32:13.299 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:13.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:13 smithi019 ceph-mon[29386]: pgmap v697: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.8 MiB/s wr, 547 op/s 2024-03-25T09:32:13.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:13.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:14.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:14.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:14.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:15.166 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:15.166 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 6/s 3/s 119 KiB/s 58 KiB/s 2.38 ms 350.91 us 2024-03-25T09:32:15.166 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 6/s 4/s 153 KiB/s 117 KiB/s 2.44 ms 365.72 us 2024-03-25T09:32:15.166 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 4/s 87 KiB/s 106 KiB/s 2.50 ms 365.63 us 2024-03-25T09:32:15.166 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 2/s 178 KiB/s 51 KiB/s 2.65 ms 295.90 us 2024-03-25T09:32:15.166 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 2/s 157 KiB/s 87 KiB/s 2.20 ms 306.20 us 2024-03-25T09:32:15.166 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 4/s 82 KiB/s 56 KiB/s 2.41 ms 387.13 us 2024-03-25T09:32:15.166 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 5/s 4/s 201 KiB/s 103 KiB/s 3.25 ms 326.23 us 2024-03-25T09:32:15.166 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 4/s 118 KiB/s 87 KiB/s 2.36 ms 506.77 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 146 KiB/s 121 KiB/s 2.18 ms 322.27 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 2/s 107 KiB/s 47 KiB/s 2.66 ms 344.08 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 3/s 170 KiB/s 106 KiB/s 2.49 ms 329.88 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 3/s 75 KiB/s 47 KiB/s 2.45 ms 303.39 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 3/s 162 KiB/s 90 KiB/s 2.43 ms 352.96 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 4/s 106 KiB/s 114 KiB/s 2.56 ms 356.51 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 143 KiB/s 95 KiB/s 2.47 ms 318.97 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 138 KiB/s 114 KiB/s 2.89 ms 301.58 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 146 KiB/s 147 KiB/s 2.29 ms 386.32 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 5/s 134 KiB/s 189 KiB/s 2.52 ms 413.52 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 115 KiB/s 138 KiB/s 2.70 ms 437.09 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 3/s 77 KiB/s 76 KiB/s 2.41 ms 350.83 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 114 KiB/s 150 KiB/s 2.60 ms 307.91 us 2024-03-25T09:32:15.167 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 148 KiB/s 114 KiB/s 2.29 ms 328.65 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 4/s 146 KiB/s 106 KiB/s 2.62 ms 432.64 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 142 KiB/s 137 KiB/s 2.45 ms 312.12 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 3/s 72 KiB/s 63 KiB/s 2.49 ms 316.38 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 122 KiB/s 100 KiB/s 2.20 ms 275.26 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 3/s 138 KiB/s 122 KiB/s 3.03 ms 441.39 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 114 KiB/s 98 KiB/s 3.17 ms 354.80 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 3/s 116 KiB/s 141 KiB/s 2.55 ms 525.17 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 5/s 138 KiB/s 139 KiB/s 2.52 ms 331.84 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 98 KiB/s 146 KiB/s 3.01 ms 325.68 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 167 KiB/s 110 KiB/s 2.80 ms 332.84 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 5/s 71 KiB/s 102 KiB/s 2.66 ms 295.92 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 6/s 67 KiB/s 138 KiB/s 2.59 ms 373.02 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 106 KiB/s 130 KiB/s 3.46 ms 418.24 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 3/s 131 KiB/s 132 KiB/s 2.92 ms 410.78 us 2024-03-25T09:32:15.168 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 99 KiB/s 125 KiB/s 2.52 ms 332.69 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 3/s 118 KiB/s 105 KiB/s 2.55 ms 327.02 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 122 KiB/s 143 KiB/s 2.64 ms 430.66 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 3/s 93 KiB/s 46 KiB/s 2.70 ms 362.39 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 3/s 76 KiB/s 92 KiB/s 2.51 ms 355.71 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 4/s 80 KiB/s 99 KiB/s 2.36 ms 293.93 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 5/s 86 KiB/s 138 KiB/s 2.85 ms 397.62 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 4/s 111 KiB/s 120 KiB/s 2.40 ms 347.03 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 117 KiB/s 134 KiB/s 2.58 ms 401.52 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 3/s 62 KiB/s 62 KiB/s 2.50 ms 325.07 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 5/s 120 KiB/s 138 KiB/s 2.42 ms 398.41 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 94 KiB/s 133 KiB/s 2.41 ms 419.58 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 3/s 74 KiB/s 58 KiB/s 2.61 ms 305.07 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 3/s 130 KiB/s 109 KiB/s 2.29 ms 483.01 us 2024-03-25T09:32:15.169 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 3/s 109 KiB/s 114 KiB/s 2.62 ms 541.24 us 2024-03-25T09:32:15.170 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 5/s 117 KiB/s 155 KiB/s 2.39 ms 333.90 us 2024-03-25T09:32:15.170 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 78 KiB/s 141 KiB/s 2.40 ms 337.73 us 2024-03-25T09:32:15.170 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 39 KiB/s 64 KiB/s 2.62 ms 364.21 us 2024-03-25T09:32:15.170 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 5/s 86 KiB/s 153 KiB/s 2.56 ms 311.79 us 2024-03-25T09:32:15.170 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 2/s 1/s 74 KiB/s 49 KiB/s 2.40 ms 327.07 us 2024-03-25T09:32:15.170 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 2/s 3/s 54 KiB/s 69 KiB/s 2.66 ms 344.61 us 2024-03-25T09:32:15.170 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 2/s 3/s 88 KiB/s 146 KiB/s 2.73 ms 370.72 us 2024-03-25T09:32:15.170 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 2/s 5/s 67 KiB/s 85 KiB/s 3.10 ms 336.75 us 2024-03-25T09:32:15.170 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 2/s 5/s 52 KiB/s 119 KiB/s 2.63 ms 445.80 us 2024-03-25T09:32:15.170 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:15.304 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:15 smithi040 ceph-mon[33094]: pgmap v698: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 507 op/s 2024-03-25T09:32:15.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:15 smithi019 ceph-mon[29386]: pgmap v698: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 507 op/s 2024-03-25T09:32:15.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:15 smithi059 ceph-mon[32732]: pgmap v698: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 507 op/s 2024-03-25T09:32:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:15.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:16.377 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:16 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 647 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:16.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:16 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 647 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:16.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:16 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 647 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:16.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:16.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:16.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:17.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-mon[33094]: pgmap v699: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 485 op/s 2024-03-25T09:32:17.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:17.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:17.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:17.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:17.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:17.315 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:17.316 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:17 smithi019 ceph-mon[29386]: pgmap v699: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 485 op/s 2024-03-25T09:32:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:17 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:17 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:17 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:17 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:17 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:17 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:17.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:17 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:17 smithi059 ceph-mon[32732]: pgmap v699: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 485 op/s 2024-03-25T09:32:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:17 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:17 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:17 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:17 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:17 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:17 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:17.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:17 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:17.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:17.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:17.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:18.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:17.815+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:18.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:18.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:18.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:19.327 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:19 smithi040 ceph-mon[33094]: pgmap v700: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.9 MiB/s wr, 541 op/s 2024-03-25T09:32:19.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:19 smithi019 ceph-mon[29386]: pgmap v700: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.9 MiB/s wr, 541 op/s 2024-03-25T09:32:19.510 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:19 smithi059 ceph-mon[32732]: pgmap v700: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.9 MiB/s wr, 541 op/s 2024-03-25T09:32:19.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:32:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 122.0k 130.8k 0.0k 1.2M 1.3M 0.0k nvme2n1 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 125.6k 152.0k 0.0k 1.2M 1.5M 0.0k nvme2n10 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 66.8k 78.4k 0.0k 668.0k 784.0k 0.0k nvme2n11 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 60.4k 83.2k 0.0k 604.0k 832.0k 0.0k nvme2n12 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 134.8k 126.8k 0.0k 1.3M 1.2M 0.0k nvme2n13 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 122.4k 138.4k 0.0k 1.2M 1.4M 0.0k nvme2n14 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 119.2k 125.2k 0.0k 1.2M 1.2M 0.0k nvme2n15 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 106.0k 125.2k 0.0k 1.0M 1.2M 0.0k nvme2n16 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 126.8k 119.2k 0.0k 1.2M 1.2M 0.0k nvme2n17 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 126.8k 109.2k 0.0k 1.2M 1.1M 0.0k nvme2n18 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 130.4k 139.6k 0.0k 1.3M 1.4M 0.0k nvme2n19 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 151.6k 132.0k 0.0k 1.5M 1.3M 0.0k nvme2n2 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 113.6k 88.4k 0.0k 1.1M 884.0k 0.0k nvme2n20 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 148.8k 132.4k 0.0k 1.5M 1.3M 0.0k nvme2n3 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 119.2k 113.2k 0.0k 1.2M 1.1M 0.0k nvme2n4 2024-03-25T09:32:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 100.8k 128.8k 0.0k 1008.0k 1.3M 0.0k nvme2n5 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 100.0k 103.6k 0.0k 1000.0k 1.0M 0.0k nvme2n6 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 121.6k 86.0k 0.0k 1.2M 860.0k 0.0k nvme2n7 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 108.4k 147.2k 0.0k 1.1M 1.4M 0.0k nvme2n8 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 124.4k 123.2k 0.0k 1.2M 1.2M 0.0k nvme2n9 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 117.6k 96.0k 0.0k 1.1M 960.0k 0.0k nvme5n1 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 84.0k 65.2k 0.0k 840.0k 652.0k 0.0k nvme5n10 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 129.2k 118.4k 0.0k 1.3M 1.2M 0.0k nvme5n11 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 138.0k 92.4k 0.0k 1.3M 924.0k 0.0k nvme5n12 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 122.0k 108.4k 0.0k 1.2M 1.1M 0.0k nvme5n13 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 106.0k 125.6k 0.0k 1.0M 1.2M 0.0k nvme5n14 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 70.4k 86.4k 0.0k 704.0k 864.0k 0.0k nvme5n15 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 137.6k 115.6k 0.0k 1.3M 1.1M 0.0k nvme5n16 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 122.4k 140.0k 0.0k 1.2M 1.4M 0.0k nvme5n17 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 121.6k 132.4k 0.0k 1.2M 1.3M 0.0k nvme5n18 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 119.6k 138.8k 0.0k 1.2M 1.4M 0.0k nvme5n19 2024-03-25T09:32:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 124.4k 142.8k 0.0k 1.2M 1.4M 0.0k nvme5n2 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 139.2k 121.2k 0.0k 1.4M 1.2M 0.0k nvme5n20 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 120.8k 143.6k 0.0k 1.2M 1.4M 0.0k nvme5n3 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 75.6k 90.4k 0.0k 756.0k 904.0k 0.0k nvme5n4 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 135.6k 113.2k 0.0k 1.3M 1.1M 0.0k nvme5n5 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 68.0k 142.8k 0.0k 680.0k 1.4M 0.0k nvme5n6 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 102.0k 113.2k 0.0k 1020.0k 1.1M 0.0k nvme5n7 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 94.4k 130.8k 0.0k 944.0k 1.3M 0.0k nvme5n8 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 104.8k 135.2k 0.0k 1.0M 1.3M 0.0k nvme5n9 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 118.4k 142.4k 0.0k 1.2M 1.4M 0.0k nvme8n1 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 123.6k 117.6k 0.0k 1.2M 1.1M 0.0k nvme8n10 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 142.0k 126.4k 0.0k 1.4M 1.2M 0.0k nvme8n11 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 128.4k 120.8k 0.0k 1.3M 1.2M 0.0k nvme8n12 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 84.8k 61.2k 0.0k 848.0k 612.0k 0.0k nvme8n13 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 117.6k 130.4k 0.0k 1.1M 1.3M 0.0k nvme8n14 2024-03-25T09:32:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 92.0k 93.2k 0.0k 920.0k 932.0k 0.0k nvme8n15 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 78.8k 125.2k 0.0k 788.0k 1.2M 0.0k nvme8n16 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 138.0k 127.6k 0.0k 1.3M 1.2M 0.0k nvme8n17 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 128.4k 142.4k 0.0k 1.3M 1.4M 0.0k nvme8n18 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 117.2k 114.0k 0.0k 1.1M 1.1M 0.0k nvme8n19 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 132.8k 119.6k 0.0k 1.3M 1.2M 0.0k nvme8n2 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 126.4k 131.2k 0.0k 1.2M 1.3M 0.0k nvme8n20 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 109.6k 97.2k 0.0k 1.1M 972.0k 0.0k nvme8n3 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 101.2k 138.0k 0.0k 1012.0k 1.3M 0.0k nvme8n4 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 143.6k 150.0k 0.0k 1.4M 1.5M 0.0k nvme8n5 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 126.4k 130.4k 0.0k 1.2M 1.3M 0.0k nvme8n6 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 106.0k 145.6k 0.0k 1.0M 1.4M 0.0k nvme8n7 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 118.8k 114.4k 0.0k 1.2M 1.1M 0.0k nvme8n8 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 84.4k 79.6k 0.0k 844.0k 796.0k 0.0k nvme8n9 2024-03-25T09:32:19.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:19.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:19.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:19.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 3/s 170 KiB/s 126 KiB/s 2.56 ms 446.17 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 3/s 164 KiB/s 95 KiB/s 2.64 ms 353.65 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 3/s 168 KiB/s 125 KiB/s 2.35 ms 412.49 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 3/s 174 KiB/s 79 KiB/s 2.42 ms 340.44 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 4/s 151 KiB/s 204 KiB/s 2.91 ms 397.08 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 4/s 164 KiB/s 161 KiB/s 2.59 ms 426.54 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 178 KiB/s 127 KiB/s 2.49 ms 345.42 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 4/s 155 KiB/s 118 KiB/s 2.47 ms 313.58 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 139 KiB/s 111 KiB/s 2.67 ms 309.56 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 3/s 132 KiB/s 101 KiB/s 2.85 ms 338.56 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 130 KiB/s 58 KiB/s 2.65 ms 425.42 us 2024-03-25T09:32:20.171 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 65 KiB/s 56 KiB/s 2.40 ms 466.35 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 110 KiB/s 150 KiB/s 2.72 ms 333.27 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 3/s 140 KiB/s 151 KiB/s 2.58 ms 338.84 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 161 KiB/s 76 KiB/s 2.73 ms 306.90 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 122 KiB/s 122 KiB/s 2.60 ms 345.04 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 143 KiB/s 89 KiB/s 2.65 ms 424.39 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 125 KiB/s 141 KiB/s 2.57 ms 305.65 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 3/s 147 KiB/s 74 KiB/s 3.06 ms 403.92 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 103 KiB/s 119 KiB/s 2.45 ms 389.07 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 166 KiB/s 132 KiB/s 2.79 ms 342.07 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 3/s 98 KiB/s 92 KiB/s 3.42 ms 424.15 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 3/s 158 KiB/s 108 KiB/s 2.58 ms 353.00 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 3/s 137 KiB/s 130 KiB/s 2.26 ms 449.33 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 145 KiB/s 142 KiB/s 2.61 ms 357.15 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 3/s 142 KiB/s 93 KiB/s 2.20 ms 335.55 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 3/s 122 KiB/s 89 KiB/s 2.40 ms 486.70 us 2024-03-25T09:32:20.172 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 3/s 135 KiB/s 111 KiB/s 2.42 ms 420.46 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 125 KiB/s 126 KiB/s 2.61 ms 330.87 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 144 KiB/s 114 KiB/s 2.76 ms 361.68 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 3/s 146 KiB/s 111 KiB/s 2.48 ms 428.59 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 3/s 99 KiB/s 76 KiB/s 2.61 ms 320.94 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 3/s 167 KiB/s 126 KiB/s 2.89 ms 368.73 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 2/s 113 KiB/s 79 KiB/s 2.85 ms 384.91 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 133 KiB/s 130 KiB/s 2.81 ms 361.40 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 149 KiB/s 122 KiB/s 2.23 ms 476.72 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 130 KiB/s 120 KiB/s 2.94 ms 328.50 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 148 KiB/s 168 KiB/s 2.36 ms 407.89 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 94 KiB/s 94 KiB/s 2.69 ms 448.28 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 135 KiB/s 154 KiB/s 2.55 ms 369.80 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 5/s 75 KiB/s 92 KiB/s 2.47 ms 370.34 us 2024-03-25T09:32:20.173 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 118 KiB/s 139 KiB/s 2.55 ms 340.97 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 116 KiB/s 142 KiB/s 2.49 ms 333.94 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 5/s 119 KiB/s 129 KiB/s 2.51 ms 389.97 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 3/s 103 KiB/s 96 KiB/s 2.42 ms 303.52 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 4/s 110 KiB/s 127 KiB/s 2.44 ms 379.91 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 121 KiB/s 145 KiB/s 2.50 ms 371.32 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 4/s 69 KiB/s 62 KiB/s 2.74 ms 297.16 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 5/s 110 KiB/s 125 KiB/s 2.52 ms 357.49 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 89 KiB/s 74 KiB/s 2.93 ms 344.74 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 4/s 81 KiB/s 130 KiB/s 2.54 ms 489.90 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 5/s 112 KiB/s 142 KiB/s 2.71 ms 344.99 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 5/s 66 KiB/s 139 KiB/s 2.07 ms 358.77 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 94 KiB/s 157 KiB/s 2.42 ms 332.25 us 2024-03-25T09:32:20.174 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 54 KiB/s 94 KiB/s 2.37 ms 325.15 us 2024-03-25T09:32:20.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 4/s 86 KiB/s 165 KiB/s 2.28 ms 322.64 us 2024-03-25T09:32:20.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 77 KiB/s 121 KiB/s 2.14 ms 328.95 us 2024-03-25T09:32:20.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 2/s 58 KiB/s 46 KiB/s 2.50 ms 311.56 us 2024-03-25T09:32:20.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 2/s 4/s 87 KiB/s 158 KiB/s 3.24 ms 391.90 us 2024-03-25T09:32:20.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 2/s 2/s 40 KiB/s 58 KiB/s 2.39 ms 325.92 us 2024-03-25T09:32:20.175 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:20.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:20.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:20.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:21.312 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:21 smithi059 ceph-mon[32732]: pgmap v701: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.2 MiB/s wr, 460 op/s 2024-03-25T09:32:21.312 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:21 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 652 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:21.339 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:21 smithi040 ceph-mon[33094]: pgmap v701: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.2 MiB/s wr, 460 op/s 2024-03-25T09:32:21.339 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:21 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 652 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:21.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:21 smithi019 ceph-mon[29386]: pgmap v701: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.2 MiB/s wr, 460 op/s 2024-03-25T09:32:21.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:21 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 652 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:21.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:21.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:21.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:22 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:22 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:22 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:22 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:22 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:22 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:22.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:22 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:22 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:22 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:22 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:22 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:22 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:22 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:22.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:22 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:22 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:22 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:22 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:22 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:22 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:22 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:22.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:22 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:22.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:22.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:22.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:22.815+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:23 smithi059 ceph-mon[32732]: pgmap v702: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 528 op/s 2024-03-25T09:32:23.352 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:23 smithi040 ceph-mon[33094]: pgmap v702: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 528 op/s 2024-03-25T09:32:23.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:23 smithi019 ceph-mon[29386]: pgmap v702: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 528 op/s 2024-03-25T09:32:23.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:23.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:23.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:24.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:24.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:24.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:25.175 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:25.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 7/s 4/s 143 KiB/s 98 KiB/s 2.56 ms 381.08 us 2024-03-25T09:32:25.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 2/s 177 KiB/s 83 KiB/s 2.64 ms 412.51 us 2024-03-25T09:32:25.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 3/s 157 KiB/s 89 KiB/s 2.43 ms 320.12 us 2024-03-25T09:32:25.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 3/s 136 KiB/s 89 KiB/s 2.44 ms 318.03 us 2024-03-25T09:32:25.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 5/s 3/s 162 KiB/s 90 KiB/s 2.56 ms 318.49 us 2024-03-25T09:32:25.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 5/s 3/s 152 KiB/s 114 KiB/s 3.18 ms 322.91 us 2024-03-25T09:32:25.175 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 2/s 161 KiB/s 82 KiB/s 2.78 ms 455.29 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 3/s 133 KiB/s 96 KiB/s 3.60 ms 345.97 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 2/s 134 KiB/s 86 KiB/s 2.97 ms 353.91 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 2/s 153 KiB/s 54 KiB/s 2.60 ms 287.50 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 3/s 154 KiB/s 94 KiB/s 2.38 ms 325.62 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 2/s 158 KiB/s 82 KiB/s 2.47 ms 458.66 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 3/s 195 KiB/s 81 KiB/s 2.38 ms 329.82 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 3/s 166 KiB/s 139 KiB/s 2.71 ms 313.64 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 3/s 179 KiB/s 126 KiB/s 2.47 ms 326.80 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 97 KiB/s 88 KiB/s 2.55 ms 321.92 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 156 KiB/s 176 KiB/s 2.59 ms 493.72 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 3/s 137 KiB/s 106 KiB/s 2.89 ms 381.07 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 3/s 114 KiB/s 110 KiB/s 2.77 ms 366.57 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 5/s 69 KiB/s 107 KiB/s 2.51 ms 373.45 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 3/s 130 KiB/s 121 KiB/s 2.33 ms 462.63 us 2024-03-25T09:32:25.176 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 3/s 115 KiB/s 125 KiB/s 2.28 ms 372.98 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 95 KiB/s 140 KiB/s 2.39 ms 351.36 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 154 KiB/s 115 KiB/s 2.66 ms 320.19 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 3/s 94 KiB/s 121 KiB/s 2.39 ms 386.97 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 118 KiB/s 157 KiB/s 2.85 ms 369.51 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 3/s 103 KiB/s 105 KiB/s 2.51 ms 277.19 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 6/s 70 KiB/s 102 KiB/s 3.13 ms 376.01 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 144 KiB/s 163 KiB/s 2.94 ms 347.58 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 109 KiB/s 135 KiB/s 2.94 ms 341.22 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 3/s 109 KiB/s 103 KiB/s 2.52 ms 314.35 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 3/s 148 KiB/s 103 KiB/s 2.58 ms 364.67 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 135 KiB/s 117 KiB/s 2.72 ms 347.48 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 114 KiB/s 153 KiB/s 3.04 ms 430.26 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 114 KiB/s 138 KiB/s 2.73 ms 492.11 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 106 KiB/s 113 KiB/s 2.74 ms 379.59 us 2024-03-25T09:32:25.177 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 3/s 102 KiB/s 138 KiB/s 2.32 ms 349.94 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 5/s 98 KiB/s 140 KiB/s 2.86 ms 345.46 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 3/s 125 KiB/s 127 KiB/s 2.56 ms 400.08 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 4/s 114 KiB/s 101 KiB/s 2.36 ms 298.34 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 3/s 96 KiB/s 142 KiB/s 2.95 ms 435.67 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 102 KiB/s 130 KiB/s 2.64 ms 396.82 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 5/s 98 KiB/s 156 KiB/s 2.73 ms 442.26 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 4/s 134 KiB/s 82 KiB/s 3.34 ms 306.60 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 102 KiB/s 109 KiB/s 2.26 ms 316.41 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 3/s 119 KiB/s 127 KiB/s 2.43 ms 333.16 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 98 KiB/s 143 KiB/s 2.41 ms 350.81 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 5/s 118 KiB/s 170 KiB/s 2.57 ms 366.83 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 3/s 106 KiB/s 122 KiB/s 2.72 ms 436.52 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 120 KiB/s 142 KiB/s 2.74 ms 376.91 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 86 KiB/s 104 KiB/s 2.42 ms 319.33 us 2024-03-25T09:32:25.178 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 3/s 93 KiB/s 108 KiB/s 2.57 ms 326.72 us 2024-03-25T09:32:25.179 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 4/s 74 KiB/s 152 KiB/s 2.11 ms 345.22 us 2024-03-25T09:32:25.179 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 3/s 124 KiB/s 107 KiB/s 2.42 ms 295.58 us 2024-03-25T09:32:25.179 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 5/s 59 KiB/s 129 KiB/s 2.53 ms 405.49 us 2024-03-25T09:32:25.179 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 5/s 106 KiB/s 154 KiB/s 2.73 ms 295.08 us 2024-03-25T09:32:25.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 4/s 104 KiB/s 163 KiB/s 2.78 ms 381.00 us 2024-03-25T09:32:25.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 5/s 89 KiB/s 170 KiB/s 2.25 ms 339.53 us 2024-03-25T09:32:25.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 2/s 4/s 57 KiB/s 120 KiB/s 2.54 ms 372.03 us 2024-03-25T09:32:25.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 2/s 5/s 64 KiB/s 145 KiB/s 2.51 ms 337.04 us 2024-03-25T09:32:25.180 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:25.365 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:25 smithi040 ceph-mon[33094]: pgmap v703: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 481 op/s 2024-03-25T09:32:25.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:25 smithi019 ceph-mon[29386]: pgmap v703: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 481 op/s 2024-03-25T09:32:25.510 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:25 smithi059 ceph-mon[32732]: pgmap v703: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 481 op/s 2024-03-25T09:32:25.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:25.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:25.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:26.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:26 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 657 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:26.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:26 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 657 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:26.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:26 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 657 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:26.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:26.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:26.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:27.376 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-mon[33094]: pgmap v704: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.7 MiB/s wr, 465 op/s 2024-03-25T09:32:27.376 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:27.376 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:27.376 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:27.376 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:27.376 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:27.376 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:27.377 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:27 smithi019 ceph-mon[29386]: pgmap v704: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.7 MiB/s wr, 465 op/s 2024-03-25T09:32:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:27 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:27 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:27 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:27 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:27 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:27 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:27.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:27 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:27 smithi059 ceph-mon[32732]: pgmap v704: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.7 MiB/s wr, 465 op/s 2024-03-25T09:32:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:27 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:27 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:27 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:27 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:27 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:27 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:27.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:27 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:27.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:27.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:27.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:28.072 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:27.814+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:28.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:28 smithi019 ceph-mon[29386]: pgmap v705: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.6 MiB/s wr, 528 op/s 2024-03-25T09:32:28.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:28 smithi059 ceph-mon[32732]: pgmap v705: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.6 MiB/s wr, 528 op/s 2024-03-25T09:32:28.512 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:28 smithi040 ceph-mon[33094]: pgmap v705: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.6 MiB/s wr, 528 op/s 2024-03-25T09:32:28.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:28.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:29.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:32:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 118.4k 106.8k 0.0k 1.2M 1.0M 0.0k nvme2n1 2024-03-25T09:32:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 138.0k 100.4k 0.0k 1.3M 1004.0k 0.0k nvme2n10 2024-03-25T09:32:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 134.0k 104.8k 0.0k 1.3M 1.0M 0.0k nvme2n11 2024-03-25T09:32:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 100.8k 149.6k 0.0k 1008.0k 1.5M 0.0k nvme2n12 2024-03-25T09:32:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 104.4k 121.2k 0.0k 1.0M 1.2M 0.0k nvme2n13 2024-03-25T09:32:29.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 103.6k 146.0k 0.0k 1.0M 1.4M 0.0k nvme2n14 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 116.0k 89.2k 0.0k 1.1M 892.0k 0.0k nvme2n15 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 126.0k 98.4k 0.0k 1.2M 984.0k 0.0k nvme2n16 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 104.8k 124.0k 0.0k 1.0M 1.2M 0.0k nvme2n17 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 116.4k 138.8k 0.0k 1.1M 1.4M 0.0k nvme2n18 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 84.4k 134.0k 0.0k 844.0k 1.3M 0.0k nvme2n19 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 123.2k 124.0k 0.0k 1.2M 1.2M 0.0k nvme2n2 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 127.6k 97.2k 0.0k 1.2M 972.0k 0.0k nvme2n20 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 110.0k 128.0k 0.0k 1.1M 1.2M 0.0k nvme2n3 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 122.4k 116.8k 0.0k 1.2M 1.1M 0.0k nvme2n4 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 132.4k 106.8k 0.0k 1.3M 1.0M 0.0k nvme2n5 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 86.4k 120.8k 0.0k 864.0k 1.2M 0.0k nvme2n6 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 116.8k 116.8k 0.0k 1.1M 1.1M 0.0k nvme2n7 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 101.6k 127.6k 0.0k 1016.0k 1.2M 0.0k nvme2n8 2024-03-25T09:32:29.688 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 110.8k 126.4k 0.0k 1.1M 1.2M 0.0k nvme2n9 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 99.2k 108.8k 0.0k 992.0k 1.1M 0.0k nvme5n1 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 134.4k 124.8k 0.0k 1.3M 1.2M 0.0k nvme5n10 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 98.8k 103.6k 0.0k 988.0k 1.0M 0.0k nvme5n11 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 126.4k 115.6k 0.0k 1.2M 1.1M 0.0k nvme5n12 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 136.0k 92.4k 0.0k 1.3M 924.0k 0.0k nvme5n13 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 133.2k 141.2k 0.0k 1.3M 1.4M 0.0k nvme5n14 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 93.2k 133.2k 0.0k 932.0k 1.3M 0.0k nvme5n15 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 124.0k 94.0k 0.0k 1.2M 940.0k 0.0k nvme5n16 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 116.8k 96.0k 0.0k 1.1M 960.0k 0.0k nvme5n17 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 142.4k 98.4k 0.0k 1.4M 984.0k 0.0k nvme5n18 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 120.8k 126.0k 0.0k 1.2M 1.2M 0.0k nvme5n19 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 101.2k 100.8k 0.0k 1012.0k 1008.0k 0.0k nvme5n2 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 131.6k 108.0k 0.0k 1.3M 1.1M 0.0k nvme5n20 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 101.6k 121.2k 0.0k 1016.0k 1.2M 0.0k nvme5n3 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 134.0k 121.2k 0.0k 1.3M 1.2M 0.0k nvme5n4 2024-03-25T09:32:29.689 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 112.8k 112.8k 0.0k 1.1M 1.1M 0.0k nvme5n5 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 121.2k 95.6k 0.0k 1.2M 956.0k 0.0k nvme5n6 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 110.0k 112.8k 0.0k 1.1M 1.1M 0.0k nvme5n7 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 162.4k 85.6k 0.0k 1.6M 856.0k 0.0k nvme5n8 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 92.8k 115.2k 0.0k 928.0k 1.1M 0.0k nvme5n9 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 144.8k 125.2k 0.0k 1.4M 1.2M 0.0k nvme8n1 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 93.2k 118.0k 0.0k 932.0k 1.2M 0.0k nvme8n10 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 106.4k 124.0k 0.0k 1.0M 1.2M 0.0k nvme8n11 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 130.0k 90.8k 0.0k 1.3M 908.0k 0.0k nvme8n12 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 110.0k 166.8k 0.0k 1.1M 1.6M 0.0k nvme8n13 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 140.8k 99.2k 0.0k 1.4M 992.0k 0.0k nvme8n14 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 115.2k 138.4k 0.0k 1.1M 1.4M 0.0k nvme8n15 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 116.4k 90.0k 0.0k 1.1M 900.0k 0.0k nvme8n16 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 111.2k 127.2k 0.0k 1.1M 1.2M 0.0k nvme8n17 2024-03-25T09:32:29.690 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 97.6k 135.2k 0.0k 976.0k 1.3M 0.0k nvme8n18 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 139.2k 104.0k 0.0k 1.4M 1.0M 0.0k nvme8n19 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 111.2k 122.8k 0.0k 1.1M 1.2M 0.0k nvme8n2 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 138.4k 110.0k 0.0k 1.4M 1.1M 0.0k nvme8n20 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 116.4k 119.6k 0.0k 1.1M 1.2M 0.0k nvme8n3 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 127.2k 125.6k 0.0k 1.2M 1.2M 0.0k nvme8n4 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 116.8k 155.2k 0.0k 1.1M 1.5M 0.0k nvme8n5 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 112.8k 89.6k 0.0k 1.1M 896.0k 0.0k nvme8n6 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 122.4k 107.2k 0.0k 1.2M 1.0M 0.0k nvme8n7 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 114.8k 98.0k 0.0k 1.1M 980.0k 0.0k nvme8n8 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 138.0k 122.0k 0.0k 1.3M 1.2M 0.0k nvme8n9 2024-03-25T09:32:29.691 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:29.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:29.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:29.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:30.179 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:30.179 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 3/s 152 KiB/s 92 KiB/s 2.82 ms 554.03 us 2024-03-25T09:32:30.179 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 3/s 138 KiB/s 99 KiB/s 2.63 ms 315.25 us 2024-03-25T09:32:30.179 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 2/s 172 KiB/s 89 KiB/s 2.49 ms 370.64 us 2024-03-25T09:32:30.179 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 3/s 171 KiB/s 87 KiB/s 2.75 ms 360.80 us 2024-03-25T09:32:30.179 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 4/s 159 KiB/s 114 KiB/s 2.55 ms 318.33 us 2024-03-25T09:32:30.179 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 3/s 128 KiB/s 75 KiB/s 2.63 ms 354.79 us 2024-03-25T09:32:30.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 3/s 146 KiB/s 93 KiB/s 2.63 ms 366.36 us 2024-03-25T09:32:30.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 3/s 139 KiB/s 112 KiB/s 2.37 ms 487.88 us 2024-03-25T09:32:30.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 126 KiB/s 168 KiB/s 2.86 ms 356.67 us 2024-03-25T09:32:30.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 4/s 116 KiB/s 95 KiB/s 2.61 ms 309.42 us 2024-03-25T09:32:30.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 115 KiB/s 114 KiB/s 2.61 ms 342.23 us 2024-03-25T09:32:30.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 3/s 154 KiB/s 108 KiB/s 2.56 ms 337.83 us 2024-03-25T09:32:30.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 116 KiB/s 143 KiB/s 2.63 ms 342.74 us 2024-03-25T09:32:30.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 3/s 135 KiB/s 66 KiB/s 2.74 ms 334.01 us 2024-03-25T09:32:30.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 150 KiB/s 121 KiB/s 2.50 ms 332.92 us 2024-03-25T09:32:30.180 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 3/s 128 KiB/s 73 KiB/s 3.19 ms 392.56 us 2024-03-25T09:32:30.181 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 113 KiB/s 95 KiB/s 2.77 ms 328.23 us 2024-03-25T09:32:30.181 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 141 KiB/s 145 KiB/s 2.41 ms 388.07 us 2024-03-25T09:32:30.181 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 2/s 171 KiB/s 86 KiB/s 2.96 ms 332.72 us 2024-03-25T09:32:30.181 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 105 KiB/s 109 KiB/s 2.62 ms 458.25 us 2024-03-25T09:32:30.181 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 5/s 167 KiB/s 156 KiB/s 2.64 ms 348.16 us 2024-03-25T09:32:30.181 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 103 KiB/s 124 KiB/s 2.44 ms 358.30 us 2024-03-25T09:32:30.181 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 3/s 133 KiB/s 91 KiB/s 3.01 ms 356.88 us 2024-03-25T09:32:30.181 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 118 KiB/s 114 KiB/s 2.52 ms 340.92 us 2024-03-25T09:32:30.182 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 108 KiB/s 107 KiB/s 2.75 ms 328.38 us 2024-03-25T09:32:30.182 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 4/s 110 KiB/s 92 KiB/s 2.33 ms 295.83 us 2024-03-25T09:32:30.182 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 130 KiB/s 123 KiB/s 2.36 ms 357.38 us 2024-03-25T09:32:30.182 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 122 KiB/s 123 KiB/s 3.18 ms 343.94 us 2024-03-25T09:32:30.182 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 118 KiB/s 123 KiB/s 2.71 ms 339.94 us 2024-03-25T09:32:30.182 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 106 KiB/s 146 KiB/s 2.42 ms 336.05 us 2024-03-25T09:32:30.182 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 3/s 118 KiB/s 83 KiB/s 2.54 ms 322.59 us 2024-03-25T09:32:30.182 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 97 KiB/s 123 KiB/s 2.63 ms 339.27 us 2024-03-25T09:32:30.182 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 83 KiB/s 126 KiB/s 3.50 ms 414.16 us 2024-03-25T09:32:30.183 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 3/s 124 KiB/s 100 KiB/s 2.82 ms 351.43 us 2024-03-25T09:32:30.183 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 3/s 105 KiB/s 93 KiB/s 2.56 ms 411.06 us 2024-03-25T09:32:30.183 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 4/s 126 KiB/s 134 KiB/s 2.92 ms 347.13 us 2024-03-25T09:32:30.183 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 5/s 97 KiB/s 169 KiB/s 2.36 ms 336.29 us 2024-03-25T09:32:30.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 4/s 106 KiB/s 137 KiB/s 2.30 ms 407.94 us 2024-03-25T09:32:30.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 5/s 106 KiB/s 164 KiB/s 2.39 ms 377.73 us 2024-03-25T09:32:30.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 110 KiB/s 109 KiB/s 2.51 ms 378.23 us 2024-03-25T09:32:30.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 132 KiB/s 146 KiB/s 2.54 ms 341.40 us 2024-03-25T09:32:30.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 4/s 110 KiB/s 146 KiB/s 3.06 ms 347.68 us 2024-03-25T09:32:30.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 99 KiB/s 101 KiB/s 2.45 ms 529.05 us 2024-03-25T09:32:30.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 5/s 126 KiB/s 154 KiB/s 2.67 ms 338.93 us 2024-03-25T09:32:30.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 96 KiB/s 129 KiB/s 2.42 ms 363.20 us 2024-03-25T09:32:30.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 101 KiB/s 101 KiB/s 2.96 ms 373.52 us 2024-03-25T09:32:30.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 102 KiB/s 150 KiB/s 3.11 ms 365.24 us 2024-03-25T09:32:30.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 5/s 119 KiB/s 183 KiB/s 2.53 ms 414.58 us 2024-03-25T09:32:30.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 3/s 82 KiB/s 78 KiB/s 2.48 ms 322.29 us 2024-03-25T09:32:30.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 5/s 99 KiB/s 138 KiB/s 2.88 ms 518.96 us 2024-03-25T09:32:30.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 4/s 86 KiB/s 138 KiB/s 2.58 ms 362.99 us 2024-03-25T09:32:30.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 5/s 94 KiB/s 114 KiB/s 2.30 ms 352.97 us 2024-03-25T09:32:30.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 5/s 102 KiB/s 122 KiB/s 3.00 ms 330.91 us 2024-03-25T09:32:30.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 77 KiB/s 146 KiB/s 2.57 ms 321.51 us 2024-03-25T09:32:30.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 4/s 80 KiB/s 158 KiB/s 2.43 ms 383.49 us 2024-03-25T09:32:30.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 4/s 75 KiB/s 140 KiB/s 2.75 ms 371.50 us 2024-03-25T09:32:30.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 4/s 101 KiB/s 116 KiB/s 2.76 ms 375.60 us 2024-03-25T09:32:30.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 2/s 4/s 97 KiB/s 89 KiB/s 3.03 ms 278.48 us 2024-03-25T09:32:30.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 2/s 5/s 81 KiB/s 134 KiB/s 2.65 ms 307.23 us 2024-03-25T09:32:30.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 2/s 5/s 54 KiB/s 182 KiB/s 2.51 ms 338.56 us 2024-03-25T09:32:30.187 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:30.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:30 smithi019 ceph-mon[29386]: pgmap v706: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 452 op/s 2024-03-25T09:32:30.510 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:30 smithi059 ceph-mon[32732]: pgmap v706: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 452 op/s 2024-03-25T09:32:30.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:30 smithi040 ceph-mon[33094]: pgmap v706: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 452 op/s 2024-03-25T09:32:30.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:30.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:30.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:31.400 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:31.400 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:31.400 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:31.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:31.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:31.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:31.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:31.401 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 662 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:31 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:31 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:31 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:31 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:31 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:31 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:31 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:31.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:31 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 662 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:31 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:31 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:31 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:31 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:31 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:31 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:31 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:31.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:31 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 662 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:31.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:31.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:31.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:32.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:32 smithi019 ceph-mon[29386]: pgmap v707: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.3 MiB/s wr, 517 op/s 2024-03-25T09:32:32.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:32.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:32.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:32.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:32 smithi059 ceph-mon[32732]: pgmap v707: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.3 MiB/s wr, 517 op/s 2024-03-25T09:32:32.762 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:32 smithi040 ceph-mon[33094]: pgmap v707: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.3 MiB/s wr, 517 op/s 2024-03-25T09:32:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:32.816+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:33.664 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:33.664 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:33.664 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:34.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:34 smithi019 ceph-mon[29386]: pgmap v708: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.6 MiB/s wr, 472 op/s 2024-03-25T09:32:34.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:34.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:34.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:34.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:34 smithi059 ceph-mon[32732]: pgmap v708: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.6 MiB/s wr, 472 op/s 2024-03-25T09:32:34.762 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:34 smithi040 ceph-mon[33094]: pgmap v708: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.6 MiB/s wr, 472 op/s 2024-03-25T09:32:35.183 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:35.183 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 2/s 138 KiB/s 68 KiB/s 2.66 ms 408.59 us 2024-03-25T09:32:35.183 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 2/s 162 KiB/s 78 KiB/s 2.64 ms 310.68 us 2024-03-25T09:32:35.183 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 2/s 142 KiB/s 84 KiB/s 2.89 ms 411.77 us 2024-03-25T09:32:35.183 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 5/s 3/s 137 KiB/s 75 KiB/s 3.58 ms 333.12 us 2024-03-25T09:32:35.183 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 4/s 142 KiB/s 128 KiB/s 2.79 ms 401.09 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 5/s 3/s 152 KiB/s 83 KiB/s 2.43 ms 316.10 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 3/s 154 KiB/s 82 KiB/s 2.80 ms 357.51 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 3/s 126 KiB/s 82 KiB/s 2.88 ms 344.68 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 2/s 139 KiB/s 70 KiB/s 2.65 ms 344.69 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 3/s 153 KiB/s 95 KiB/s 3.09 ms 624.84 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 3/s 137 KiB/s 122 KiB/s 2.75 ms 427.13 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 131 KiB/s 120 KiB/s 2.75 ms 347.43 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 142 KiB/s 90 KiB/s 2.73 ms 395.53 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 130 KiB/s 89 KiB/s 2.49 ms 411.69 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 148 KiB/s 104 KiB/s 2.85 ms 313.66 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 2/s 146 KiB/s 80 KiB/s 2.88 ms 346.20 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 132 KiB/s 132 KiB/s 2.44 ms 323.46 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 118 KiB/s 141 KiB/s 2.72 ms 327.22 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 4/s 126 KiB/s 139 KiB/s 2.59 ms 374.27 us 2024-03-25T09:32:35.184 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 3/s 117 KiB/s 60 KiB/s 2.38 ms 269.24 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 79 KiB/s 86 KiB/s 2.84 ms 321.47 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 4/s 107 KiB/s 135 KiB/s 2.30 ms 300.43 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 101 KiB/s 108 KiB/s 2.30 ms 328.53 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 98 KiB/s 130 KiB/s 2.53 ms 351.29 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 112 KiB/s 124 KiB/s 2.51 ms 322.04 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 3/s 117 KiB/s 120 KiB/s 2.62 ms 296.18 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 108 KiB/s 137 KiB/s 2.74 ms 306.65 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 3/s 80 KiB/s 76 KiB/s 2.83 ms 301.56 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 3/s 107 KiB/s 91 KiB/s 2.32 ms 290.63 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 2/s 109 KiB/s 78 KiB/s 2.58 ms 358.75 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 123 KiB/s 116 KiB/s 2.49 ms 316.92 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 3/s 126 KiB/s 74 KiB/s 2.43 ms 387.12 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 121 KiB/s 107 KiB/s 2.76 ms 385.87 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 103 KiB/s 126 KiB/s 2.59 ms 418.55 us 2024-03-25T09:32:35.185 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 5/s 96 KiB/s 157 KiB/s 2.79 ms 297.99 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 4/s 91 KiB/s 153 KiB/s 2.43 ms 321.71 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 5/s 104 KiB/s 134 KiB/s 2.46 ms 307.22 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 107 KiB/s 120 KiB/s 2.65 ms 321.75 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 127 KiB/s 126 KiB/s 2.49 ms 299.62 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 3/s 99 KiB/s 58 KiB/s 3.19 ms 320.74 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 4/s 123 KiB/s 138 KiB/s 2.49 ms 499.27 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 99 KiB/s 123 KiB/s 2.49 ms 343.14 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 3/s 99 KiB/s 88 KiB/s 2.35 ms 338.01 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 4/s 86 KiB/s 122 KiB/s 2.99 ms 397.32 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 3/s 108 KiB/s 82 KiB/s 2.28 ms 475.50 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 122 KiB/s 110 KiB/s 2.51 ms 337.32 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 5/s 117 KiB/s 130 KiB/s 2.88 ms 325.20 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 78 KiB/s 114 KiB/s 2.63 ms 297.00 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 90 KiB/s 122 KiB/s 3.14 ms 348.63 us 2024-03-25T09:32:35.186 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 4/s 81 KiB/s 140 KiB/s 2.50 ms 557.71 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 3/s 91 KiB/s 120 KiB/s 2.50 ms 406.52 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 90 KiB/s 148 KiB/s 2.63 ms 377.28 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 98 KiB/s 120 KiB/s 2.36 ms 346.90 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 4/s 85 KiB/s 120 KiB/s 2.67 ms 494.96 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 4/s 99 KiB/s 159 KiB/s 3.00 ms 371.41 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 2/s 5/s 90 KiB/s 150 KiB/s 2.63 ms 518.78 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 2/s 4/s 49 KiB/s 118 KiB/s 2.33 ms 379.24 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 2/s 3/s 70 KiB/s 76 KiB/s 2.56 ms 408.51 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 2/s 5/s 81 KiB/s 127 KiB/s 2.42 ms 386.30 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 2/s 5/s 84 KiB/s 138 KiB/s 2.67 ms 417.39 us 2024-03-25T09:32:35.187 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:35.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:35 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 667 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:35.663 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:35 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 667 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:35.664 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:35.664 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:35.664 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:35.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:35 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 667 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:36.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-mon[29386]: pgmap v709: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 464 op/s 2024-03-25T09:32:36.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:36.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:36.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:36.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:36.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:36.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:36.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:36.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:36 smithi059 ceph-mon[32732]: pgmap v709: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 464 op/s 2024-03-25T09:32:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:36 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:36 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:36 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:36 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:36 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:36 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:36.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:36 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:36.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:36 smithi040 ceph-mon[33094]: pgmap v709: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 464 op/s 2024-03-25T09:32:36.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:36 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:36.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:36 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:36.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:36 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:36.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:36 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:36.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:36 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:36.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:36 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:36.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:36 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:37.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:37.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:37.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:37.816+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:38.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:38 smithi019 ceph-mon[29386]: pgmap v710: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.1 MiB/s wr, 526 op/s 2024-03-25T09:32:38.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:38.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:38.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:38.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:38 smithi059 ceph-mon[32732]: pgmap v710: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.1 MiB/s wr, 526 op/s 2024-03-25T09:32:38.762 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:38 smithi040 ceph-mon[33094]: pgmap v710: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.1 MiB/s wr, 526 op/s 2024-03-25T09:32:39.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:32:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 90.0k 102.8k 0.0k 900.0k 1.0M 0.0k nvme2n1 2024-03-25T09:32:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 111.6k 104.0k 0.0k 1.1M 1.0M 0.0k nvme2n10 2024-03-25T09:32:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 136.4k 77.6k 0.0k 1.3M 776.0k 0.0k nvme2n11 2024-03-25T09:32:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 123.2k 98.8k 0.0k 1.2M 988.0k 0.0k nvme2n12 2024-03-25T09:32:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 104.4k 100.8k 0.0k 1.0M 1008.0k 0.0k nvme2n13 2024-03-25T09:32:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 104.4k 139.2k 0.0k 1.0M 1.4M 0.0k nvme2n14 2024-03-25T09:32:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 84.0k 120.8k 0.0k 840.0k 1.2M 0.0k nvme2n15 2024-03-25T09:32:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 89.6k 123.6k 0.0k 896.0k 1.2M 0.0k nvme2n16 2024-03-25T09:32:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 132.4k 98.0k 0.0k 1.3M 980.0k 0.0k nvme2n17 2024-03-25T09:32:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 86.8k 88.4k 0.0k 868.0k 884.0k 0.0k nvme2n18 2024-03-25T09:32:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 112.4k 80.4k 0.0k 1.1M 804.0k 0.0k nvme2n19 2024-03-25T09:32:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 108.0k 110.0k 0.0k 1.1M 1.1M 0.0k nvme2n2 2024-03-25T09:32:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 88.4k 92.4k 0.0k 884.0k 924.0k 0.0k nvme2n20 2024-03-25T09:32:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 90.0k 114.4k 0.0k 900.0k 1.1M 0.0k nvme2n3 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 122.0k 96.8k 0.0k 1.2M 968.0k 0.0k nvme2n4 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 108.0k 96.4k 0.0k 1.1M 964.0k 0.0k nvme2n5 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 99.2k 94.8k 0.0k 992.0k 948.0k 0.0k nvme2n6 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 94.8k 100.8k 0.0k 948.0k 1008.0k 0.0k nvme2n7 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 91.2k 111.2k 0.0k 912.0k 1.1M 0.0k nvme2n8 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 130.0k 79.6k 0.0k 1.3M 796.0k 0.0k nvme2n9 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 102.0k 115.2k 0.0k 1020.0k 1.1M 0.0k nvme5n1 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 128.8k 131.6k 0.0k 1.3M 1.3M 0.0k nvme5n10 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 100.8k 120.8k 0.0k 1008.0k 1.2M 0.0k nvme5n11 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 94.0k 105.2k 0.0k 940.0k 1.0M 0.0k nvme5n12 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 106.8k 107.2k 0.0k 1.0M 1.0M 0.0k nvme5n13 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 108.0k 96.0k 0.0k 1.1M 960.0k 0.0k nvme5n14 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 121.2k 131.6k 0.0k 1.2M 1.3M 0.0k nvme5n15 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 86.8k 115.2k 0.0k 868.0k 1.1M 0.0k nvme5n16 2024-03-25T09:32:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 98.4k 112.8k 0.0k 984.0k 1.1M 0.0k nvme5n17 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 105.6k 111.2k 0.0k 1.0M 1.1M 0.0k nvme5n18 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 122.8k 119.6k 0.0k 1.2M 1.2M 0.0k nvme5n19 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 95.2k 118.0k 0.0k 952.0k 1.2M 0.0k nvme5n2 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 120.4k 116.4k 0.0k 1.2M 1.1M 0.0k nvme5n20 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 116.4k 96.4k 0.0k 1.1M 964.0k 0.0k nvme5n3 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 109.6k 113.6k 0.0k 1.1M 1.1M 0.0k nvme5n4 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 122.4k 114.8k 0.0k 1.2M 1.1M 0.0k nvme5n5 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 129.6k 117.2k 0.0k 1.3M 1.1M 0.0k nvme5n6 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 109.6k 109.6k 0.0k 1.1M 1.1M 0.0k nvme5n7 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 106.0k 109.6k 0.0k 1.0M 1.1M 0.0k nvme5n8 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 110.8k 110.8k 0.0k 1.1M 1.1M 0.0k nvme5n9 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 96.0k 114.8k 0.0k 960.0k 1.1M 0.0k nvme8n1 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 109.2k 87.2k 0.0k 1.1M 872.0k 0.0k nvme8n10 2024-03-25T09:32:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 83.2k 128.4k 0.0k 832.0k 1.3M 0.0k nvme8n11 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 116.8k 86.4k 0.0k 1.1M 864.0k 0.0k nvme8n12 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 124.8k 91.2k 0.0k 1.2M 912.0k 0.0k nvme8n13 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 94.8k 104.0k 0.0k 948.0k 1.0M 0.0k nvme8n14 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 123.6k 114.8k 0.0k 1.2M 1.1M 0.0k nvme8n15 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 98.4k 102.0k 0.0k 984.0k 1020.0k 0.0k nvme8n16 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 124.4k 94.8k 0.0k 1.2M 948.0k 0.0k nvme8n17 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 105.6k 108.0k 0.0k 1.0M 1.1M 0.0k nvme8n18 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 111.6k 111.2k 0.0k 1.1M 1.1M 0.0k nvme8n19 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 103.6k 116.0k 0.0k 1.0M 1.1M 0.0k nvme8n2 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 101.2k 82.4k 0.0k 1012.0k 824.0k 0.0k nvme8n20 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 127.2k 111.6k 0.0k 1.2M 1.1M 0.0k nvme8n3 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 102.4k 98.4k 0.0k 1.0M 984.0k 0.0k nvme8n4 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 82.8k 116.0k 0.0k 828.0k 1.1M 0.0k nvme8n5 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 104.4k 94.4k 0.0k 1.0M 944.0k 0.0k nvme8n6 2024-03-25T09:32:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 119.2k 107.2k 0.0k 1.2M 1.0M 0.0k nvme8n7 2024-03-25T09:32:39.688 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 102.0k 94.0k 0.0k 1020.0k 940.0k 0.0k nvme8n8 2024-03-25T09:32:39.688 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 128.4k 96.4k 0.0k 1.3M 964.0k 0.0k nvme8n9 2024-03-25T09:32:39.688 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:39.766 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:39.767 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:39.767 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:40.189 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:40.189 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 3/s 149 KiB/s 103 KiB/s 2.99 ms 347.38 us 2024-03-25T09:32:40.189 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 2/s 104 KiB/s 66 KiB/s 2.75 ms 317.60 us 2024-03-25T09:32:40.189 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 3/s 114 KiB/s 76 KiB/s 2.28 ms 359.43 us 2024-03-25T09:32:40.189 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 3/s 151 KiB/s 79 KiB/s 2.60 ms 334.37 us 2024-03-25T09:32:40.189 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 3/s 127 KiB/s 119 KiB/s 2.71 ms 340.03 us 2024-03-25T09:32:40.189 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 133 KiB/s 90 KiB/s 2.25 ms 345.51 us 2024-03-25T09:32:40.189 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 157 KiB/s 102 KiB/s 2.65 ms 402.86 us 2024-03-25T09:32:40.189 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 3/s 102 KiB/s 66 KiB/s 3.05 ms 304.66 us 2024-03-25T09:32:40.189 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 3/s 150 KiB/s 93 KiB/s 2.79 ms 358.55 us 2024-03-25T09:32:40.190 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 119 KiB/s 114 KiB/s 3.18 ms 429.77 us 2024-03-25T09:32:40.190 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 3/s 118 KiB/s 121 KiB/s 3.65 ms 372.08 us 2024-03-25T09:32:40.190 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 3/s 119 KiB/s 90 KiB/s 2.89 ms 353.40 us 2024-03-25T09:32:40.190 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 3/s 106 KiB/s 104 KiB/s 2.56 ms 395.79 us 2024-03-25T09:32:40.190 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 3/s 115 KiB/s 106 KiB/s 3.10 ms 328.63 us 2024-03-25T09:32:40.190 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 3/s 118 KiB/s 103 KiB/s 2.41 ms 335.94 us 2024-03-25T09:32:40.190 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 118 KiB/s 116 KiB/s 2.49 ms 349.90 us 2024-03-25T09:32:40.190 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 105 KiB/s 132 KiB/s 2.59 ms 391.61 us 2024-03-25T09:32:40.190 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 146 KiB/s 118 KiB/s 3.00 ms 397.00 us 2024-03-25T09:32:40.190 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 98 KiB/s 120 KiB/s 2.92 ms 322.20 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 102 KiB/s 125 KiB/s 2.80 ms 403.67 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 110 KiB/s 142 KiB/s 2.56 ms 317.12 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 138 KiB/s 119 KiB/s 2.67 ms 413.02 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 116 KiB/s 112 KiB/s 2.84 ms 287.49 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 3/s 104 KiB/s 97 KiB/s 2.81 ms 336.98 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 4/s 101 KiB/s 98 KiB/s 2.53 ms 310.54 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 4/s 126 KiB/s 82 KiB/s 2.83 ms 373.91 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 3/s 115 KiB/s 112 KiB/s 2.59 ms 346.22 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 4/s 110 KiB/s 114 KiB/s 2.64 ms 352.91 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 3/s 78 KiB/s 100 KiB/s 2.60 ms 440.36 us 2024-03-25T09:32:40.191 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 3/s 96 KiB/s 79 KiB/s 2.29 ms 285.42 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 5/s 150 KiB/s 164 KiB/s 2.43 ms 484.82 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 106 KiB/s 128 KiB/s 2.55 ms 361.31 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 5/s 108 KiB/s 130 KiB/s 2.52 ms 383.22 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 93 KiB/s 108 KiB/s 2.28 ms 340.16 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 3/s 80 KiB/s 107 KiB/s 2.68 ms 493.03 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 103 KiB/s 119 KiB/s 2.77 ms 444.94 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 94 KiB/s 121 KiB/s 2.53 ms 322.46 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 3/s 96 KiB/s 120 KiB/s 2.37 ms 378.83 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 125 KiB/s 105 KiB/s 2.67 ms 311.36 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 93 KiB/s 93 KiB/s 2.39 ms 319.83 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 4/s 99 KiB/s 116 KiB/s 2.70 ms 320.05 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 3/s 81 KiB/s 65 KiB/s 3.02 ms 370.23 us 2024-03-25T09:32:40.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 3/s 93 KiB/s 105 KiB/s 2.66 ms 373.35 us 2024-03-25T09:32:40.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 97 KiB/s 114 KiB/s 2.95 ms 399.91 us 2024-03-25T09:32:40.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 4/s 86 KiB/s 81 KiB/s 3.00 ms 317.66 us 2024-03-25T09:32:40.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 87 KiB/s 120 KiB/s 2.65 ms 348.78 us 2024-03-25T09:32:40.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 5/s 82 KiB/s 143 KiB/s 2.84 ms 443.75 us 2024-03-25T09:32:40.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 5/s 132 KiB/s 144 KiB/s 2.37 ms 331.07 us 2024-03-25T09:32:40.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 107 KiB/s 109 KiB/s 3.04 ms 325.49 us 2024-03-25T09:32:40.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 5/s 100 KiB/s 130 KiB/s 2.35 ms 313.84 us 2024-03-25T09:32:40.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 4/s 126 KiB/s 141 KiB/s 2.71 ms 323.04 us 2024-03-25T09:32:40.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 105 KiB/s 111 KiB/s 3.05 ms 381.82 us 2024-03-25T09:32:40.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 58 KiB/s 154 KiB/s 2.77 ms 387.82 us 2024-03-25T09:32:40.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 70 KiB/s 86 KiB/s 2.56 ms 311.61 us 2024-03-25T09:32:40.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 5/s 102 KiB/s 110 KiB/s 2.98 ms 344.94 us 2024-03-25T09:32:40.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 116 KiB/s 118 KiB/s 2.86 ms 448.84 us 2024-03-25T09:32:40.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 5/s 86 KiB/s 155 KiB/s 2.51 ms 492.17 us 2024-03-25T09:32:40.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 2/s 5/s 61 KiB/s 147 KiB/s 2.43 ms 315.26 us 2024-03-25T09:32:40.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 2/s 4/s 73 KiB/s 127 KiB/s 2.93 ms 332.67 us 2024-03-25T09:32:40.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 2/s 5/s 53 KiB/s 167 KiB/s 2.55 ms 330.38 us 2024-03-25T09:32:40.194 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:40.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:40.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-mon[29386]: pgmap v711: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 449 op/s 2024-03-25T09:32:40.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:32:40.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 672 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:40.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:40 smithi059 ceph-mon[32732]: pgmap v711: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 449 op/s 2024-03-25T09:32:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:32:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:40 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:40 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 672 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:40.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:40 smithi040 ceph-mon[33094]: pgmap v711: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 449 op/s 2024-03-25T09:32:40.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:32:40.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:40 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:40.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:40 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 672 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:41.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:41.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:41.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:41.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:41.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:41.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:41.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:41.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:41.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:41.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"} : dispatch 2024-03-25T09:32:41.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:32:41.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:32:41.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:41.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"} : dispatch 2024-03-25T09:32:41.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:32:41.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:32:41.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:41.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:41.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:41.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:41.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:41.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"} : dispatch 2024-03-25T09:32:41.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:32:41.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:32:41.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:32:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:42 smithi059 ceph-mon[32732]: pgmap v712: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 514 op/s 2024-03-25T09:32:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:42 smithi059 ceph-mon[32732]: pgmap v713: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 482 op/s 2024-03-25T09:32:42.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:42 smithi059 ceph-mon[32732]: pgmap v714: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.4 MiB/s wr, 500 op/s 2024-03-25T09:32:42.762 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:42 smithi040 ceph-mon[33094]: pgmap v712: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 514 op/s 2024-03-25T09:32:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:42 smithi040 ceph-mon[33094]: pgmap v713: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 482 op/s 2024-03-25T09:32:42.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:42 smithi040 ceph-mon[33094]: pgmap v714: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.4 MiB/s wr, 500 op/s 2024-03-25T09:32:42.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:42 smithi019 ceph-mon[29386]: pgmap v712: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 514 op/s 2024-03-25T09:32:42.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:42 smithi019 ceph-mon[29386]: pgmap v713: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 482 op/s 2024-03-25T09:32:42.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:42 smithi019 ceph-mon[29386]: pgmap v714: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.4 MiB/s wr, 500 op/s 2024-03-25T09:32:42.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:42.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:42.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:43.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:42.816+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:43.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:43.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:43.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:44.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:44 smithi059 ceph-mon[32732]: pgmap v715: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 507 op/s 2024-03-25T09:32:44.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:44 smithi040 ceph-mon[33094]: pgmap v715: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 507 op/s 2024-03-25T09:32:44.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:44 smithi019 ceph-mon[29386]: pgmap v715: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 507 op/s 2024-03-25T09:32:44.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:44.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:44.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:45.192 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:45.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 2/s 140 KiB/s 72 KiB/s 2.83 ms 479.29 us 2024-03-25T09:32:45.192 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 1/s 124 KiB/s 42 KiB/s 3.01 ms 331.56 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 3/s 142 KiB/s 109 KiB/s 2.59 ms 349.96 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 96 KiB/s 92 KiB/s 2.86 ms 356.40 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 3/s 126 KiB/s 106 KiB/s 2.66 ms 349.43 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 90 KiB/s 82 KiB/s 2.82 ms 452.16 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 3/s 134 KiB/s 87 KiB/s 2.51 ms 421.76 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 2/s 117 KiB/s 89 KiB/s 2.48 ms 442.57 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 88 KiB/s 82 KiB/s 2.42 ms 269.29 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 102 KiB/s 87 KiB/s 2.51 ms 336.59 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 2/s 126 KiB/s 82 KiB/s 2.94 ms 399.49 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 3/s 103 KiB/s 107 KiB/s 2.60 ms 348.38 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 121 KiB/s 91 KiB/s 2.97 ms 342.27 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 3/s 95 KiB/s 83 KiB/s 2.48 ms 343.50 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 3/s 118 KiB/s 78 KiB/s 2.64 ms 362.87 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 3/s 106 KiB/s 101 KiB/s 2.55 ms 389.51 us 2024-03-25T09:32:45.193 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 122 KiB/s 86 KiB/s 2.69 ms 394.35 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 117 KiB/s 130 KiB/s 3.19 ms 363.03 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 3/s 98 KiB/s 68 KiB/s 2.82 ms 372.43 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 80 KiB/s 103 KiB/s 2.79 ms 393.87 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 106 KiB/s 120 KiB/s 3.21 ms 482.02 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 4/s 79 KiB/s 100 KiB/s 2.69 ms 428.61 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 3/s 104 KiB/s 97 KiB/s 2.55 ms 456.24 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 3/s 109 KiB/s 68 KiB/s 2.76 ms 300.00 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 3/s 96 KiB/s 83 KiB/s 2.39 ms 332.51 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 3/s 90 KiB/s 122 KiB/s 2.49 ms 353.04 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 110 KiB/s 90 KiB/s 2.59 ms 324.30 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 3/s 102 KiB/s 84 KiB/s 2.83 ms 374.55 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 112 KiB/s 87 KiB/s 2.88 ms 332.40 us 2024-03-25T09:32:45.194 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 3/s 73 KiB/s 86 KiB/s 2.53 ms 317.00 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 131 KiB/s 120 KiB/s 2.54 ms 357.34 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 115 KiB/s 119 KiB/s 2.85 ms 480.73 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 104 KiB/s 145 KiB/s 2.92 ms 350.78 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 89 KiB/s 110 KiB/s 3.41 ms 377.05 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 4/s 112 KiB/s 127 KiB/s 2.55 ms 358.01 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 94 KiB/s 146 KiB/s 2.53 ms 353.77 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 3/s 74 KiB/s 118 KiB/s 2.88 ms 448.01 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 3/s 129 KiB/s 66 KiB/s 2.73 ms 342.71 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 5/s 84 KiB/s 124 KiB/s 2.64 ms 320.79 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 103 KiB/s 103 KiB/s 2.36 ms 310.03 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 3/s 108 KiB/s 106 KiB/s 2.66 ms 419.67 us 2024-03-25T09:32:45.195 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 3/s 81 KiB/s 84 KiB/s 2.75 ms 334.55 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 3/s 102 KiB/s 75 KiB/s 3.41 ms 337.65 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 3/s 82 KiB/s 52 KiB/s 2.73 ms 316.46 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 3/s 168 KiB/s 113 KiB/s 3.04 ms 399.62 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 4/s 78 KiB/s 80 KiB/s 2.42 ms 363.96 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 94 KiB/s 125 KiB/s 2.68 ms 325.04 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 74 KiB/s 134 KiB/s 2.66 ms 331.40 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 74 KiB/s 113 KiB/s 3.70 ms 351.35 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 77 KiB/s 108 KiB/s 2.63 ms 344.22 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 99 KiB/s 132 KiB/s 2.81 ms 317.25 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 5/s 130 KiB/s 102 KiB/s 2.55 ms 320.80 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 5/s 82 KiB/s 120 KiB/s 2.68 ms 301.20 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 57 KiB/s 95 KiB/s 2.92 ms 436.45 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 78 KiB/s 78 KiB/s 3.27 ms 326.34 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 4/s 89 KiB/s 127 KiB/s 2.69 ms 337.02 us 2024-03-25T09:32:45.196 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 3/s 88 KiB/s 98 KiB/s 3.09 ms 348.38 us 2024-03-25T09:32:45.197 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 3/s 125 KiB/s 88 KiB/s 2.73 ms 423.82 us 2024-03-25T09:32:45.197 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 2/s 4/s 51 KiB/s 130 KiB/s 2.30 ms 377.11 us 2024-03-25T09:32:45.197 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 2/s 4/s 87 KiB/s 122 KiB/s 2.76 ms 344.33 us 2024-03-25T09:32:45.197 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:45.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:45 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 677 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:45.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:45 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 677 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:45.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:45.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:45.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:45.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:45 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 677 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:46 smithi059 ceph-mon[32732]: pgmap v716: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 414 op/s 2024-03-25T09:32:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:46 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:46 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:46 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:46 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:46 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:46 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:46.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:46 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:46 smithi040 ceph-mon[33094]: pgmap v716: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 414 op/s 2024-03-25T09:32:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:46 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:46 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:46 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:46 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:46 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:46 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:46.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:46 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:46.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-mon[29386]: pgmap v716: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 414 op/s 2024-03-25T09:32:46.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:46.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:46.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:46.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:46.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:46.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:46.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:46.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:46.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:46.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:47.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:47.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:47.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:47.816+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:48.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:48 smithi059 ceph-mon[32732]: pgmap v717: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 530 op/s 2024-03-25T09:32:48.762 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:48 smithi040 ceph-mon[33094]: pgmap v717: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 530 op/s 2024-03-25T09:32:48.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:48 smithi019 ceph-mon[29386]: pgmap v717: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 530 op/s 2024-03-25T09:32:48.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:48.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:48.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:49.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:49.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:49.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:49.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:49.815 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:32:49.815 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 82.0k 87.6k 0.0k 820.0k 876.0k 0.0k nvme2n1 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 98.8k 76.0k 0.0k 988.0k 760.0k 0.0k nvme2n10 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 103.2k 123.6k 0.0k 1.0M 1.2M 0.0k nvme2n11 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 81.2k 128.4k 0.0k 812.0k 1.3M 0.0k nvme2n12 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 94.0k 96.4k 0.0k 940.0k 964.0k 0.0k nvme2n13 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 111.6k 94.0k 0.0k 1.1M 940.0k 0.0k nvme2n14 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 90.4k 98.4k 0.0k 904.0k 984.0k 0.0k nvme2n15 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 80.4k 114.8k 0.0k 804.0k 1.1M 0.0k nvme2n16 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 91.6k 108.4k 0.0k 916.0k 1.1M 0.0k nvme2n17 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 62.4k 89.6k 0.0k 624.0k 896.0k 0.0k nvme2n18 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 114.0k 98.8k 0.0k 1.1M 988.0k 0.0k nvme2n19 2024-03-25T09:32:49.816 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 87.6k 99.2k 0.0k 876.0k 992.0k 0.0k nvme2n2 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 92.0k 98.8k 0.0k 920.0k 988.0k 0.0k nvme2n20 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 100.8k 120.0k 0.0k 1008.0k 1.2M 0.0k nvme2n3 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 85.6k 101.6k 0.0k 856.0k 1016.0k 0.0k nvme2n4 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 104.4k 116.0k 0.0k 1.0M 1.1M 0.0k nvme2n5 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 92.8k 116.4k 0.0k 928.0k 1.1M 0.0k nvme2n6 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 91.6k 74.4k 0.0k 916.0k 744.0k 0.0k nvme2n7 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 127.2k 92.8k 0.0k 1.2M 928.0k 0.0k nvme2n8 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 82.4k 118.4k 0.0k 824.0k 1.2M 0.0k nvme2n9 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 90.8k 95.2k 0.0k 908.0k 952.0k 0.0k nvme5n1 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 104.4k 109.2k 0.0k 1.0M 1.1M 0.0k nvme5n10 2024-03-25T09:32:49.817 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 109.2k 73.6k 0.0k 1.1M 736.0k 0.0k nvme5n11 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 120.8k 84.0k 0.0k 1.2M 840.0k 0.0k nvme5n12 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 119.6k 89.2k 0.0k 1.2M 892.0k 0.0k nvme5n13 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 105.6k 114.0k 0.0k 1.0M 1.1M 0.0k nvme5n14 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 99.6k 134.8k 0.0k 996.0k 1.3M 0.0k nvme5n15 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 89.2k 104.0k 0.0k 892.0k 1.0M 0.0k nvme5n16 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 87.6k 106.8k 0.0k 876.0k 1.0M 0.0k nvme5n17 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 110.4k 110.0k 0.0k 1.1M 1.1M 0.0k nvme5n18 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 124.4k 97.2k 0.0k 1.2M 972.0k 0.0k nvme5n19 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 109.2k 66.0k 0.0k 1.1M 660.0k 0.0k nvme5n2 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 124.4k 93.6k 0.0k 1.2M 936.0k 0.0k nvme5n20 2024-03-25T09:32:49.818 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 102.4k 85.6k 0.0k 1.0M 856.0k 0.0k nvme5n3 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 110.0k 93.2k 0.0k 1.1M 932.0k 0.0k nvme5n4 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 103.6k 89.6k 0.0k 1.0M 896.0k 0.0k nvme5n5 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 105.2k 116.0k 0.0k 1.0M 1.1M 0.0k nvme5n6 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 76.4k 95.2k 0.0k 764.0k 952.0k 0.0k nvme5n7 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 111.6k 91.2k 0.0k 1.1M 912.0k 0.0k nvme5n8 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 100.0k 85.6k 0.0k 1000.0k 856.0k 0.0k nvme5n9 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 74.0k 129.6k 0.0k 740.0k 1.3M 0.0k nvme8n1 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 113.2k 86.0k 0.0k 1.1M 860.0k 0.0k nvme8n10 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 100.8k 111.6k 0.0k 1008.0k 1.1M 0.0k nvme8n11 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 65.2k 114.8k 0.0k 652.0k 1.1M 0.0k nvme8n12 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 110.4k 110.8k 0.0k 1.1M 1.1M 0.0k nvme8n13 2024-03-25T09:32:49.819 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 100.8k 69.2k 0.0k 1008.0k 692.0k 0.0k nvme8n14 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 82.4k 122.0k 0.0k 824.0k 1.2M 0.0k nvme8n15 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 98.8k 96.8k 0.0k 988.0k 968.0k 0.0k nvme8n16 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 87.6k 97.2k 0.0k 876.0k 972.0k 0.0k nvme8n17 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 108.8k 112.4k 0.0k 1.1M 1.1M 0.0k nvme8n18 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 95.6k 84.8k 0.0k 956.0k 848.0k 0.0k nvme8n19 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 86.0k 91.6k 0.0k 860.0k 916.0k 0.0k nvme8n2 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 115.6k 104.4k 0.0k 1.1M 1.0M 0.0k nvme8n20 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 94.0k 112.8k 0.0k 940.0k 1.1M 0.0k nvme8n3 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 87.2k 112.8k 0.0k 872.0k 1.1M 0.0k nvme8n4 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 90.8k 97.6k 0.0k 908.0k 976.0k 0.0k nvme8n5 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 70.8k 113.6k 0.0k 708.0k 1.1M 0.0k nvme8n6 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 100.8k 108.4k 0.0k 1008.0k 1.1M 0.0k nvme8n7 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 116.4k 103.6k 0.0k 1.1M 1.0M 0.0k nvme8n8 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 122.4k 80.8k 0.0k 1.2M 808.0k 0.0k nvme8n9 2024-03-25T09:32:49.820 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:50.197 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:50.197 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 2/s 122 KiB/s 73 KiB/s 2.82 ms 341.11 us 2024-03-25T09:32:50.197 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 1/s 111 KiB/s 46 KiB/s 2.83 ms 363.48 us 2024-03-25T09:32:50.197 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 3/s 128 KiB/s 107 KiB/s 2.54 ms 297.79 us 2024-03-25T09:32:50.197 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 2/s 81 KiB/s 51 KiB/s 2.48 ms 390.73 us 2024-03-25T09:32:50.197 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 2/s 109 KiB/s 57 KiB/s 3.19 ms 343.29 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 3/s 93 KiB/s 64 KiB/s 3.32 ms 328.10 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 2/s 99 KiB/s 71 KiB/s 2.63 ms 453.90 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 2/s 92 KiB/s 61 KiB/s 2.49 ms 314.78 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 2/s 99 KiB/s 57 KiB/s 2.39 ms 384.44 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 2/s 109 KiB/s 75 KiB/s 2.73 ms 367.98 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 3/s 95 KiB/s 75 KiB/s 2.38 ms 322.41 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 2/s 105 KiB/s 62 KiB/s 2.61 ms 334.26 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 2/s 125 KiB/s 76 KiB/s 2.89 ms 333.99 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 3/s 95 KiB/s 91 KiB/s 2.83 ms 384.57 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 3/s 79 KiB/s 93 KiB/s 2.63 ms 419.51 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 2/s 86 KiB/s 68 KiB/s 2.83 ms 411.61 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 2/s 94 KiB/s 71 KiB/s 2.72 ms 374.84 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 112 KiB/s 69 KiB/s 2.89 ms 336.34 us 2024-03-25T09:32:50.198 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 116 KiB/s 99 KiB/s 2.94 ms 325.41 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 3/s 83 KiB/s 114 KiB/s 2.23 ms 394.17 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 2/s 95 KiB/s 72 KiB/s 3.06 ms 319.30 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 3/s 93 KiB/s 63 KiB/s 2.53 ms 310.62 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 3/s 116 KiB/s 95 KiB/s 2.87 ms 350.75 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 2/s 63 KiB/s 85 KiB/s 2.89 ms 412.88 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 2/s 93 KiB/s 69 KiB/s 2.58 ms 399.32 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 3/s 89 KiB/s 85 KiB/s 2.55 ms 349.86 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 3/s 67 KiB/s 89 KiB/s 2.73 ms 429.51 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 3/s 85 KiB/s 88 KiB/s 2.37 ms 355.56 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 3/s 94 KiB/s 102 KiB/s 2.53 ms 327.45 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 3/s 95 KiB/s 62 KiB/s 2.72 ms 297.85 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 4/s 79 KiB/s 95 KiB/s 2.41 ms 323.88 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 2/s 79 KiB/s 43 KiB/s 2.38 ms 318.06 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 3/s 84 KiB/s 78 KiB/s 2.38 ms 329.97 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 3/s 84 KiB/s 95 KiB/s 2.45 ms 454.97 us 2024-03-25T09:32:50.199 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 2/s 74 KiB/s 78 KiB/s 2.98 ms 357.30 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 3/s 93 KiB/s 94 KiB/s 3.06 ms 409.08 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 3/s 72 KiB/s 97 KiB/s 2.78 ms 383.22 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 3/s 103 KiB/s 94 KiB/s 3.03 ms 522.30 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 74 KiB/s 85 KiB/s 2.83 ms 321.28 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 3/s 78 KiB/s 75 KiB/s 3.27 ms 310.98 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 3/s 87 KiB/s 98 KiB/s 2.68 ms 343.61 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 3/s 70 KiB/s 84 KiB/s 2.50 ms 336.10 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 3/s 70 KiB/s 75 KiB/s 2.51 ms 398.50 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 91 KiB/s 94 KiB/s 2.37 ms 324.62 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 3/s 73 KiB/s 101 KiB/s 2.76 ms 339.62 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 3/s 70 KiB/s 60 KiB/s 2.42 ms 363.56 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 3/s 65 KiB/s 77 KiB/s 2.51 ms 354.57 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 3/s 77 KiB/s 68 KiB/s 2.45 ms 293.92 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 3/s 77 KiB/s 63 KiB/s 2.85 ms 340.47 us 2024-03-25T09:32:50.200 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 2/s 4/s 78 KiB/s 127 KiB/s 2.88 ms 373.23 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 2/s 3/s 75 KiB/s 76 KiB/s 2.77 ms 314.90 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 2/s 3/s 55 KiB/s 89 KiB/s 2.41 ms 396.57 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 2/s 4/s 86 KiB/s 113 KiB/s 2.78 ms 387.42 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 2/s 4/s 57 KiB/s 81 KiB/s 2.83 ms 328.86 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 2/s 3/s 51 KiB/s 105 KiB/s 2.53 ms 407.09 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 2/s 3/s 79 KiB/s 86 KiB/s 2.84 ms 336.06 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 2/s 4/s 43 KiB/s 103 KiB/s 2.49 ms 427.30 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 2/s 4/s 77 KiB/s 74 KiB/s 2.72 ms 310.69 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 2/s 3/s 49 KiB/s 97 KiB/s 2.72 ms 338.30 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 2/s 4/s 45 KiB/s 138 KiB/s 2.60 ms 340.97 us 2024-03-25T09:32:50.201 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:50.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:50 smithi059 ceph-mon[32732]: pgmap v718: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 448 op/s 2024-03-25T09:32:50.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:50 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 682 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:50.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:50 smithi040 ceph-mon[33094]: pgmap v718: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 448 op/s 2024-03-25T09:32:50.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:50 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 682 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:50.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:50 smithi019 ceph-mon[29386]: pgmap v718: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 448 op/s 2024-03-25T09:32:50.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:50 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 682 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:50.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:50.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:50.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:51.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:51 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:51.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:51 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:51.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:51 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:51.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:51 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:51.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:51 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:51.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:51 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:51.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:51 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:51.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:51 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:51.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:51 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:51.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:51 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:51.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:51 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:51.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:51 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:51.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:51 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:51.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:51 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:51.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:51.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:51.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:51 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:51 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:51 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:51 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:51 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:51 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:51 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:52.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:52 smithi059 ceph-mon[32732]: pgmap v719: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 483 op/s 2024-03-25T09:32:52.762 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:52 smithi040 ceph-mon[33094]: pgmap v719: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 483 op/s 2024-03-25T09:32:52.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:52 smithi019 ceph-mon[29386]: pgmap v719: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 483 op/s 2024-03-25T09:32:52.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:52.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:52.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:52.817+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:54.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:54.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:54.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:54.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:54 smithi059 ceph-mon[32732]: pgmap v720: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 472 op/s 2024-03-25T09:32:54.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:54 smithi040 ceph-mon[33094]: pgmap v720: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 472 op/s 2024-03-25T09:32:54.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:54 smithi019 ceph-mon[29386]: pgmap v720: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 472 op/s 2024-03-25T09:32:54.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:54.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:54.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:55.201 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 6/s 2/s 154 KiB/s 43 KiB/s 2.35 ms 401.52 us 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 3/s 142 KiB/s 70 KiB/s 2.87 ms 329.31 us 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 2/s 142 KiB/s 68 KiB/s 2.48 ms 326.15 us 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 3/s 106 KiB/s 87 KiB/s 2.64 ms 483.44 us 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 121 KiB/s 129 KiB/s 2.95 ms 374.43 us 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 92 KiB/s 133 KiB/s 2.50 ms 350.90 us 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 3/s 113 KiB/s 58 KiB/s 2.51 ms 293.29 us 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 3/s 115 KiB/s 62 KiB/s 2.69 ms 328.29 us 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 130 KiB/s 89 KiB/s 2.78 ms 369.20 us 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 4/s 121 KiB/s 95 KiB/s 2.77 ms 374.66 us 2024-03-25T09:32:55.202 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 110 KiB/s 72 KiB/s 2.76 ms 335.57 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 3/s 127 KiB/s 70 KiB/s 2.90 ms 329.49 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 98 KiB/s 74 KiB/s 2.34 ms 339.31 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 5/s 106 KiB/s 95 KiB/s 2.58 ms 456.74 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 3/s 110 KiB/s 88 KiB/s 2.68 ms 416.67 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 3/s 86 KiB/s 90 KiB/s 2.93 ms 334.69 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 3/s 125 KiB/s 90 KiB/s 2.76 ms 339.23 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 112 KiB/s 109 KiB/s 3.20 ms 328.39 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 3/s 112 KiB/s 113 KiB/s 2.69 ms 340.89 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 4/s 121 KiB/s 126 KiB/s 2.35 ms 323.87 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 77 KiB/s 78 KiB/s 2.92 ms 321.36 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 102 KiB/s 70 KiB/s 2.66 ms 340.32 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 109 KiB/s 78 KiB/s 3.25 ms 417.99 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 3/s 90 KiB/s 85 KiB/s 2.79 ms 338.72 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 4/s 94 KiB/s 78 KiB/s 2.76 ms 327.51 us 2024-03-25T09:32:55.203 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 83 KiB/s 100 KiB/s 2.79 ms 323.54 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 106 KiB/s 85 KiB/s 2.61 ms 318.98 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 4/s 82 KiB/s 85 KiB/s 2.62 ms 385.04 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 86 KiB/s 101 KiB/s 2.63 ms 329.18 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 94 KiB/s 134 KiB/s 2.87 ms 486.06 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 3/s 110 KiB/s 112 KiB/s 2.33 ms 351.47 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 77 KiB/s 99 KiB/s 2.53 ms 335.08 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 106 KiB/s 91 KiB/s 3.25 ms 409.88 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 80 KiB/s 86 KiB/s 3.06 ms 412.37 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 4/s 72 KiB/s 110 KiB/s 2.41 ms 397.50 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 3/s 96 KiB/s 98 KiB/s 3.05 ms 327.89 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 78 KiB/s 86 KiB/s 2.49 ms 327.61 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 101 KiB/s 98 KiB/s 2.50 ms 293.44 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 4/s 90 KiB/s 122 KiB/s 2.55 ms 402.19 us 2024-03-25T09:32:55.204 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 96 KiB/s 103 KiB/s 2.78 ms 291.96 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 3/s 97 KiB/s 91 KiB/s 2.58 ms 323.44 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 3/s 86 KiB/s 76 KiB/s 3.42 ms 325.32 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 4/s 81 KiB/s 110 KiB/s 2.47 ms 463.09 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 3/s 56 KiB/s 47 KiB/s 2.50 ms 342.89 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 4/s 79 KiB/s 112 KiB/s 3.16 ms 306.66 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 4/s 78 KiB/s 99 KiB/s 2.50 ms 288.47 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 66 KiB/s 99 KiB/s 2.60 ms 303.59 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 5/s 62 KiB/s 95 KiB/s 2.52 ms 295.61 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 78 KiB/s 92 KiB/s 3.24 ms 431.41 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 5/s 68 KiB/s 79 KiB/s 2.55 ms 290.00 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 84 KiB/s 114 KiB/s 2.59 ms 372.38 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 89 KiB/s 116 KiB/s 2.43 ms 320.66 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 92 KiB/s 127 KiB/s 2.68 ms 339.69 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 4/s 93 KiB/s 82 KiB/s 2.23 ms 396.30 us 2024-03-25T09:32:55.205 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 4/s 88 KiB/s 109 KiB/s 2.79 ms 346.98 us 2024-03-25T09:32:55.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 5/s 94 KiB/s 106 KiB/s 3.29 ms 322.29 us 2024-03-25T09:32:55.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 3/s 84 KiB/s 108 KiB/s 2.95 ms 312.40 us 2024-03-25T09:32:55.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 4/s 71 KiB/s 130 KiB/s 3.15 ms 385.16 us 2024-03-25T09:32:55.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 2/s 4/s 52 KiB/s 89 KiB/s 2.51 ms 321.22 us 2024-03-25T09:32:55.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 2/s 4/s 78 KiB/s 105 KiB/s 2.61 ms 424.87 us 2024-03-25T09:32:55.206 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:55.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:55 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 687 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:55.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:55 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 687 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:55.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:55.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:55.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:55.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:55 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 687 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:32:56.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:56 smithi059 ceph-mon[32732]: pgmap v721: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 467 op/s 2024-03-25T09:32:56.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:56 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:56.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:56 smithi059 ceph-mon[32732]: { 2024-03-25T09:32:56.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:56 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:32:56.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:56 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:32:56.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:56 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:32:56.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:56 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:32:56.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:56 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:32:56.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:56 smithi040 ceph-mon[33094]: pgmap v721: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 467 op/s 2024-03-25T09:32:56.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:56 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:56.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:56 smithi040 ceph-mon[33094]: { 2024-03-25T09:32:56.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:56 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:32:56.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:56 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:32:56.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:56 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:32:56.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:56 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:32:56.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:56 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:32:56.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:56.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-mon[29386]: pgmap v721: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 467 op/s 2024-03-25T09:32:56.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:32:56.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-mon[29386]: { 2024-03-25T09:32:56.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:32:56.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:32:56.811 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:32:56.811 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:32:56.811 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:32:56.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:56.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:58.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:58.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:58.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:32:57.817+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:32:58.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:32:58 smithi059 ceph-mon[32732]: pgmap v722: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 523 op/s 2024-03-25T09:32:58.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:32:58 smithi040 ceph-mon[33094]: pgmap v722: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 523 op/s 2024-03-25T09:32:58.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:32:58 smithi019 ceph-mon[29386]: pgmap v722: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 523 op/s 2024-03-25T09:32:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:32:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:32:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:32:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:32:58 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:32:59.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:32:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:32:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 88.0k 78.0k 0.0k 880.0k 780.0k 0.0k nvme2n1 2024-03-25T09:32:59.680 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 90.4k 100.4k 0.0k 904.0k 1004.0k 0.0k nvme2n10 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 74.8k 114.0k 0.0k 748.0k 1.1M 0.0k nvme2n11 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 101.6k 102.4k 0.0k 1016.0k 1.0M 0.0k nvme2n12 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 110.8k 78.8k 0.0k 1.1M 788.0k 0.0k nvme2n13 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 92.0k 93.2k 0.0k 920.0k 932.0k 0.0k nvme2n14 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 85.6k 83.2k 0.0k 856.0k 832.0k 0.0k nvme2n15 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 61.2k 104.4k 0.0k 612.0k 1.0M 0.0k nvme2n16 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 94.8k 78.0k 0.0k 948.0k 780.0k 0.0k nvme2n17 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 79.6k 92.8k 0.0k 796.0k 928.0k 0.0k nvme2n18 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 81.6k 111.2k 0.0k 816.0k 1.1M 0.0k nvme2n19 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 98.8k 101.2k 0.0k 988.0k 1012.0k 0.0k nvme2n2 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 71.6k 105.6k 0.0k 716.0k 1.0M 0.0k nvme2n20 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 120.0k 63.6k 0.0k 1.2M 636.0k 0.0k nvme2n3 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 96.4k 71.6k 0.0k 964.0k 716.0k 0.0k nvme2n4 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 70.0k 102.8k 0.0k 700.0k 1.0M 0.0k nvme2n5 2024-03-25T09:32:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 74.0k 67.6k 0.0k 740.0k 676.0k 0.0k nvme2n6 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 60.8k 83.6k 0.0k 608.0k 836.0k 0.0k nvme2n7 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 96.8k 74.8k 0.0k 968.0k 748.0k 0.0k nvme2n8 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 100.8k 60.8k 0.0k 1008.0k 608.0k 0.0k nvme2n9 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 71.6k 71.6k 0.0k 716.0k 716.0k 0.0k nvme5n1 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 95.6k 102.0k 0.0k 956.0k 1020.0k 0.0k nvme5n10 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 63.6k 91.6k 0.0k 636.0k 916.0k 0.0k nvme5n11 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 89.2k 111.2k 0.0k 892.0k 1.1M 0.0k nvme5n12 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 98.4k 102.8k 0.0k 984.0k 1.0M 0.0k nvme5n13 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 99.6k 84.8k 0.0k 996.0k 848.0k 0.0k nvme5n14 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 90.8k 130.4k 0.0k 908.0k 1.3M 0.0k nvme5n15 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 78.8k 83.2k 0.0k 788.0k 832.0k 0.0k nvme5n16 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 98.8k 68.4k 0.0k 988.0k 684.0k 0.0k nvme5n17 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 124.0k 49.2k 0.0k 1.2M 492.0k 0.0k nvme5n18 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 93.6k 91.2k 0.0k 936.0k 912.0k 0.0k nvme5n19 2024-03-25T09:32:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 75.6k 105.2k 0.0k 756.0k 1.0M 0.0k nvme5n2 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 106.4k 90.4k 0.0k 1.0M 904.0k 0.0k nvme5n20 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 94.0k 99.2k 0.0k 940.0k 992.0k 0.0k nvme5n3 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 80.0k 102.0k 0.0k 800.0k 1020.0k 0.0k nvme5n4 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 84.4k 78.4k 0.0k 844.0k 784.0k 0.0k nvme5n5 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 74.4k 100.4k 0.0k 744.0k 1004.0k 0.0k nvme5n6 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 99.2k 94.8k 0.0k 992.0k 948.0k 0.0k nvme5n7 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 93.2k 92.0k 0.0k 932.0k 920.0k 0.0k nvme5n8 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 107.6k 66.0k 0.0k 1.1M 660.0k 0.0k nvme5n9 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 67.2k 103.6k 0.0k 672.0k 1.0M 0.0k nvme8n1 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 80.4k 77.2k 0.0k 804.0k 772.0k 0.0k nvme8n10 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 103.2k 90.8k 0.0k 1.0M 908.0k 0.0k nvme8n11 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 103.6k 90.0k 0.0k 1.0M 900.0k 0.0k nvme8n12 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 119.2k 106.8k 0.0k 1.2M 1.0M 0.0k nvme8n13 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 68.8k 90.8k 0.0k 688.0k 908.0k 0.0k nvme8n14 2024-03-25T09:32:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 118.0k 81.6k 0.0k 1.2M 816.0k 0.0k nvme8n15 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 85.6k 82.4k 0.0k 856.0k 824.0k 0.0k nvme8n16 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 88.8k 86.4k 0.0k 888.0k 864.0k 0.0k nvme8n17 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 81.2k 96.8k 0.0k 812.0k 968.0k 0.0k nvme8n18 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 88.4k 97.6k 0.0k 884.0k 976.0k 0.0k nvme8n19 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 70.4k 94.0k 0.0k 704.0k 940.0k 0.0k nvme8n2 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 76.4k 115.6k 0.0k 764.0k 1.1M 0.0k nvme8n20 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 89.2k 112.0k 0.0k 892.0k 1.1M 0.0k nvme8n3 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 119.6k 71.2k 0.0k 1.2M 712.0k 0.0k nvme8n4 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 86.4k 94.4k 0.0k 864.0k 944.0k 0.0k nvme8n5 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 78.0k 92.0k 0.0k 780.0k 920.0k 0.0k nvme8n6 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 106.4k 81.2k 0.0k 1.0M 812.0k 0.0k nvme8n7 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 90.4k 82.4k 0.0k 904.0k 824.0k 0.0k nvme8n8 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.90 91.2k 94.0k 0.0k 912.0k 940.0k 0.0k nvme8n9 2024-03-25T09:32:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:00.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:00.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:32:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:00.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:32:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:00.205 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 3/s 139 KiB/s 58 KiB/s 2.54 ms 421.42 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 3/s 117 KiB/s 110 KiB/s 2.57 ms 416.47 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 5/s 2/s 86 KiB/s 58 KiB/s 2.50 ms 338.23 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 2/s 124 KiB/s 67 KiB/s 2.97 ms 288.05 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 3/s 130 KiB/s 84 KiB/s 2.71 ms 521.86 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 2/s 110 KiB/s 55 KiB/s 2.34 ms 324.88 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 3/s 94 KiB/s 78 KiB/s 2.99 ms 363.16 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 4/s 75 KiB/s 105 KiB/s 2.62 ms 398.26 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 2/s 134 KiB/s 74 KiB/s 3.05 ms 464.89 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 3/s 116 KiB/s 85 KiB/s 2.55 ms 344.31 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 3/s 108 KiB/s 87 KiB/s 2.39 ms 496.93 us 2024-03-25T09:33:00.206 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 3/s 82 KiB/s 70 KiB/s 3.33 ms 322.51 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 89 KiB/s 106 KiB/s 3.03 ms 324.78 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 4/s 119 KiB/s 76 KiB/s 2.65 ms 315.86 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 3/s 102 KiB/s 102 KiB/s 2.94 ms 476.39 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 3/s 113 KiB/s 94 KiB/s 2.79 ms 402.60 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 134 KiB/s 116 KiB/s 2.53 ms 327.26 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 76 KiB/s 86 KiB/s 2.62 ms 387.15 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 110 KiB/s 88 KiB/s 3.58 ms 355.65 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 93 KiB/s 75 KiB/s 2.65 ms 333.91 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 82 KiB/s 65 KiB/s 2.96 ms 315.74 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 2/s 106 KiB/s 53 KiB/s 2.66 ms 309.52 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 113 KiB/s 87 KiB/s 2.51 ms 408.51 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 114 KiB/s 63 KiB/s 2.81 ms 286.75 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 112 KiB/s 98 KiB/s 2.97 ms 353.20 us 2024-03-25T09:33:00.207 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 56 KiB/s 109 KiB/s 2.88 ms 346.01 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 3/s 110 KiB/s 60 KiB/s 3.14 ms 385.21 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 77 KiB/s 60 KiB/s 2.66 ms 329.01 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 94 KiB/s 82 KiB/s 2.40 ms 398.83 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 3/s 74 KiB/s 71 KiB/s 2.60 ms 354.96 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 74 KiB/s 82 KiB/s 2.92 ms 412.48 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 95 KiB/s 95 KiB/s 2.67 ms 312.91 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 5/s 67 KiB/s 97 KiB/s 2.83 ms 338.59 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 54 KiB/s 65 KiB/s 2.76 ms 322.38 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 3/s 76 KiB/s 58 KiB/s 2.85 ms 289.52 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 3/s 77 KiB/s 66 KiB/s 2.56 ms 360.66 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 4/s 88 KiB/s 85 KiB/s 3.06 ms 306.38 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 4/s 74 KiB/s 118 KiB/s 2.59 ms 336.97 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 3/s 96 KiB/s 70 KiB/s 3.01 ms 424.81 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 3/s 50 KiB/s 48 KiB/s 2.88 ms 325.00 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 99 KiB/s 66 KiB/s 3.05 ms 454.76 us 2024-03-25T09:33:00.208 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 84 KiB/s 98 KiB/s 2.99 ms 328.38 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 3/s 75 KiB/s 79 KiB/s 2.79 ms 316.62 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 89 KiB/s 109 KiB/s 3.11 ms 381.62 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 3/s 58 KiB/s 78 KiB/s 2.43 ms 315.09 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 4/s 61 KiB/s 82 KiB/s 2.49 ms 333.59 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 5/s 95 KiB/s 136 KiB/s 2.60 ms 341.58 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 97 KiB/s 96 KiB/s 2.78 ms 329.34 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 3/s 70 KiB/s 83 KiB/s 2.68 ms 331.40 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 4/s 81 KiB/s 101 KiB/s 2.60 ms 353.53 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 80 KiB/s 123 KiB/s 2.28 ms 325.73 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 5/s 79 KiB/s 94 KiB/s 2.91 ms 300.41 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 59 KiB/s 115 KiB/s 2.51 ms 535.07 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 4/s 78 KiB/s 122 KiB/s 2.36 ms 367.03 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 50 KiB/s 114 KiB/s 2.89 ms 511.93 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 5/s 82 KiB/s 122 KiB/s 2.93 ms 388.97 us 2024-03-25T09:33:00.209 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 2/s 6/s 58 KiB/s 123 KiB/s 2.85 ms 351.24 us 2024-03-25T09:33:00.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 2/s 5/s 54 KiB/s 103 KiB/s 3.06 ms 412.62 us 2024-03-25T09:33:00.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 2/s 5/s 45 KiB/s 131 KiB/s 2.73 ms 368.18 us 2024-03-25T09:33:00.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 2/s 5/s 53 KiB/s 139 KiB/s 3.33 ms 388.31 us 2024-03-25T09:33:00.210 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:00.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:00 smithi059 ceph-mon[32732]: pgmap v723: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 457 op/s 2024-03-25T09:33:00.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:00 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 692 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:00.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:00 smithi040 ceph-mon[33094]: pgmap v723: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 457 op/s 2024-03-25T09:33:00.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:00 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 692 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:00.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:00 smithi019 ceph-mon[29386]: pgmap v723: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 457 op/s 2024-03-25T09:33:00.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:00 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 692 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:00.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:00.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:00.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:00 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:01.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:01 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:01.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:01 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:01.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:01 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:01.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:01 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:01.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:01 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:01.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:01 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:01.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:01 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:01.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:01 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:01.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:01 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:01.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:01 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:01.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:01 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:01.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:01 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:01.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:01 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:01.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:01 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:01.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:01.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:01.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:01 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:01 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:01 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:01 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:01 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:01 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:01 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:02.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:02 smithi059 ceph-mon[32732]: pgmap v724: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 507 op/s 2024-03-25T09:33:02.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:02 smithi040 ceph-mon[33094]: pgmap v724: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 507 op/s 2024-03-25T09:33:02.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:02 smithi019 ceph-mon[29386]: pgmap v724: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 507 op/s 2024-03-25T09:33:02.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:02.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:02.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:02 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:02.817+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:04.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:04.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:04.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:04.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:04 smithi059 ceph-mon[32732]: pgmap v725: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 474 op/s 2024-03-25T09:33:04.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:04 smithi040 ceph-mon[33094]: pgmap v725: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 474 op/s 2024-03-25T09:33:04.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:04 smithi019 ceph-mon[29386]: pgmap v725: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 474 op/s 2024-03-25T09:33:04.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:04.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:04.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:05.210 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:05.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 6/s 2/s 150 KiB/s 45 KiB/s 2.37 ms 325.42 us 2024-03-25T09:33:05.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 2/s 158 KiB/s 42 KiB/s 2.50 ms 283.38 us 2024-03-25T09:33:05.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 3/s 97 KiB/s 62 KiB/s 2.94 ms 321.84 us 2024-03-25T09:33:05.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 2/s 124 KiB/s 52 KiB/s 2.57 ms 315.83 us 2024-03-25T09:33:05.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 5/s 2/s 122 KiB/s 54 KiB/s 2.71 ms 342.33 us 2024-03-25T09:33:05.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 5/s 2/s 102 KiB/s 64 KiB/s 2.66 ms 434.68 us 2024-03-25T09:33:05.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 101 KiB/s 63 KiB/s 3.04 ms 324.46 us 2024-03-25T09:33:05.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 2/s 97 KiB/s 58 KiB/s 2.60 ms 335.85 us 2024-03-25T09:33:05.210 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 144 KiB/s 90 KiB/s 2.61 ms 388.93 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 102 KiB/s 67 KiB/s 2.79 ms 338.38 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 3/s 123 KiB/s 78 KiB/s 2.75 ms 475.41 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 130 KiB/s 90 KiB/s 2.49 ms 301.57 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 110 KiB/s 75 KiB/s 2.84 ms 329.80 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 4/s 98 KiB/s 114 KiB/s 2.59 ms 355.58 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 3/s 90 KiB/s 74 KiB/s 2.62 ms 288.77 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 3/s 104 KiB/s 79 KiB/s 2.76 ms 312.00 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 77 KiB/s 77 KiB/s 2.58 ms 427.35 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 119 KiB/s 83 KiB/s 2.64 ms 399.00 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 114 KiB/s 46 KiB/s 2.87 ms 313.82 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 4/s 115 KiB/s 96 KiB/s 2.64 ms 311.87 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 107 KiB/s 72 KiB/s 2.43 ms 304.67 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 106 KiB/s 113 KiB/s 2.40 ms 326.86 us 2024-03-25T09:33:05.211 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 74 KiB/s 93 KiB/s 3.13 ms 351.38 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 3/s 116 KiB/s 115 KiB/s 2.94 ms 381.15 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 96 KiB/s 91 KiB/s 3.00 ms 336.10 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 94 KiB/s 98 KiB/s 2.66 ms 394.90 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 3/s 90 KiB/s 66 KiB/s 2.70 ms 324.75 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 106 KiB/s 76 KiB/s 2.63 ms 344.70 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 3/s 99 KiB/s 111 KiB/s 2.62 ms 364.03 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 81 KiB/s 72 KiB/s 2.42 ms 335.09 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 3/s 97 KiB/s 89 KiB/s 2.59 ms 368.80 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 3/s 82 KiB/s 80 KiB/s 2.73 ms 324.93 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 5/s 82 KiB/s 108 KiB/s 2.79 ms 478.03 us 2024-03-25T09:33:05.212 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 3/s 83 KiB/s 94 KiB/s 2.72 ms 366.93 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 90 KiB/s 74 KiB/s 3.12 ms 331.28 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 82 KiB/s 95 KiB/s 3.76 ms 337.62 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 3/s 76 KiB/s 77 KiB/s 2.44 ms 338.94 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 65 KiB/s 79 KiB/s 2.95 ms 557.87 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 95 KiB/s 83 KiB/s 2.89 ms 303.39 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 66 KiB/s 102 KiB/s 2.72 ms 364.51 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 4/s 116 KiB/s 93 KiB/s 2.87 ms 349.57 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 4/s 86 KiB/s 77 KiB/s 2.70 ms 379.05 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 4/s 100 KiB/s 96 KiB/s 2.73 ms 489.05 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 5/s 69 KiB/s 103 KiB/s 3.01 ms 319.53 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 5/s 90 KiB/s 134 KiB/s 2.66 ms 360.23 us 2024-03-25T09:33:05.213 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 4/s 59 KiB/s 136 KiB/s 2.90 ms 366.83 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 5/s 72 KiB/s 95 KiB/s 3.17 ms 353.19 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 4/s 58 KiB/s 122 KiB/s 2.79 ms 341.80 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 3/s 74 KiB/s 109 KiB/s 2.53 ms 364.42 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 72 KiB/s 87 KiB/s 2.75 ms 349.43 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 66 KiB/s 94 KiB/s 3.15 ms 347.89 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 90 KiB/s 91 KiB/s 2.76 ms 314.00 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 5/s 64 KiB/s 76 KiB/s 3.07 ms 316.22 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 74 KiB/s 85 KiB/s 3.24 ms 337.23 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 6/s 63 KiB/s 100 KiB/s 2.57 ms 316.22 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 4/s 50 KiB/s 114 KiB/s 2.76 ms 409.59 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 54 KiB/s 100 KiB/s 2.56 ms 312.67 us 2024-03-25T09:33:05.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 2/s 5/s 45 KiB/s 110 KiB/s 2.34 ms 301.51 us 2024-03-25T09:33:05.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 2/s 5/s 49 KiB/s 104 KiB/s 2.70 ms 395.51 us 2024-03-25T09:33:05.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 2/s 5/s 61 KiB/s 152 KiB/s 2.71 ms 394.93 us 2024-03-25T09:33:05.215 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:05.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:05 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 697 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:05.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:05 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 697 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:05.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:05.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:05.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:05.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:05 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 697 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:06.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:06 smithi059 ceph-mon[32732]: pgmap v726: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 468 op/s 2024-03-25T09:33:06.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:06 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:06.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:06 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:06.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:06 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:06.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:06 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:06.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:06 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:06.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:06 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:06.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:06 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:06.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:06 smithi040 ceph-mon[33094]: pgmap v726: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 468 op/s 2024-03-25T09:33:06.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:06 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:06.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:06 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:06.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:06 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:06.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:06 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:06.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:06 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:06.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:06 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:06.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:06 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:06.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-mon[29386]: pgmap v726: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 468 op/s 2024-03-25T09:33:06.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:06.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:06.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:06.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:06.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:06.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:06.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:06.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:06.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:06.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:08.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:08.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:08.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:08.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:07.818+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:08.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:08 smithi059 ceph-mon[32732]: pgmap v727: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 526 op/s 2024-03-25T09:33:08.762 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:08 smithi040 ceph-mon[33094]: pgmap v727: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 526 op/s 2024-03-25T09:33:08.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:08 smithi019 ceph-mon[29386]: pgmap v727: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 526 op/s 2024-03-25T09:33:08.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:08.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:08.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:08 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:09.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:33:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 89.6k 80.4k 0.0k 896.0k 804.0k 0.0k nvme2n1 2024-03-25T09:33:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 72.8k 62.4k 0.0k 728.0k 624.0k 0.0k nvme2n10 2024-03-25T09:33:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 103.6k 82.4k 0.0k 1.0M 824.0k 0.0k nvme2n11 2024-03-25T09:33:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 110.4k 88.0k 0.0k 1.1M 880.0k 0.0k nvme2n12 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 87.2k 64.8k 0.0k 872.0k 648.0k 0.0k nvme2n13 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 84.8k 87.6k 0.0k 848.0k 876.0k 0.0k nvme2n14 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 88.0k 85.2k 0.0k 880.0k 852.0k 0.0k nvme2n15 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 114.4k 87.6k 0.0k 1.1M 876.0k 0.0k nvme2n16 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 74.0k 118.0k 0.0k 740.0k 1.2M 0.0k nvme2n17 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 72.0k 82.4k 0.0k 720.0k 824.0k 0.0k nvme2n18 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 86.4k 74.0k 0.0k 864.0k 740.0k 0.0k nvme2n19 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 93.2k 82.4k 0.0k 932.0k 824.0k 0.0k nvme2n2 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 76.0k 70.4k 0.0k 760.0k 704.0k 0.0k nvme2n20 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 69.6k 96.8k 0.0k 696.0k 968.0k 0.0k nvme2n3 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 98.8k 48.8k 0.0k 988.0k 488.0k 0.0k nvme2n4 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 110.0k 91.6k 0.0k 1.1M 916.0k 0.0k nvme2n5 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 92.8k 85.2k 0.0k 928.0k 852.0k 0.0k nvme2n6 2024-03-25T09:33:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 80.8k 60.4k 0.0k 808.0k 604.0k 0.0k nvme2n7 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 77.6k 85.6k 0.0k 776.0k 856.0k 0.0k nvme2n8 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 104.8k 64.4k 0.0k 1.0M 644.0k 0.0k nvme2n9 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 88.0k 93.6k 0.0k 880.0k 936.0k 0.0k nvme5n1 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 82.4k 116.4k 0.0k 824.0k 1.1M 0.0k nvme5n10 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 92.4k 89.2k 0.0k 924.0k 892.0k 0.0k nvme5n11 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 72.8k 105.2k 0.0k 728.0k 1.0M 0.0k nvme5n12 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 60.8k 122.0k 0.0k 608.0k 1.2M 0.0k nvme5n13 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 108.0k 73.6k 0.0k 1.1M 736.0k 0.0k nvme5n14 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 114.4k 91.6k 0.0k 1.1M 916.0k 0.0k nvme5n15 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 86.4k 96.8k 0.0k 864.0k 968.0k 0.0k nvme5n16 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 86.0k 66.4k 0.0k 860.0k 664.0k 0.0k nvme5n17 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 108.0k 96.4k 0.0k 1.1M 964.0k 0.0k nvme5n18 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 70.0k 97.2k 0.0k 700.0k 972.0k 0.0k nvme5n19 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 70.8k 62.4k 0.0k 708.0k 624.0k 0.0k nvme5n2 2024-03-25T09:33:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 80.8k 76.4k 0.0k 808.0k 764.0k 0.0k nvme5n20 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 88.0k 84.4k 0.0k 880.0k 844.0k 0.0k nvme5n3 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 102.8k 80.8k 0.0k 1.0M 808.0k 0.0k nvme5n4 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 87.6k 61.2k 0.0k 876.0k 612.0k 0.0k nvme5n5 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 70.0k 111.2k 0.0k 700.0k 1.1M 0.0k nvme5n6 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 92.4k 73.2k 0.0k 924.0k 732.0k 0.0k nvme5n7 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 93.2k 100.0k 0.0k 932.0k 1000.0k 0.0k nvme5n8 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 85.6k 77.6k 0.0k 856.0k 776.0k 0.0k nvme5n9 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 71.2k 96.0k 0.0k 712.0k 960.0k 0.0k nvme8n1 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 67.6k 81.6k 0.0k 676.0k 816.0k 0.0k nvme8n10 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 70.4k 80.0k 0.0k 704.0k 800.0k 0.0k nvme8n11 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 91.2k 62.4k 0.0k 912.0k 624.0k 0.0k nvme8n12 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 92.4k 99.2k 0.0k 924.0k 992.0k 0.0k nvme8n13 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 42.4k 79.2k 0.0k 424.0k 792.0k 0.0k nvme8n14 2024-03-25T09:33:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 105.2k 80.4k 0.0k 1.0M 804.0k 0.0k nvme8n15 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 81.2k 91.6k 0.0k 812.0k 916.0k 0.0k nvme8n16 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 118.8k 57.6k 0.0k 1.2M 576.0k 0.0k nvme8n17 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 79.6k 78.0k 0.0k 796.0k 780.0k 0.0k nvme8n18 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 90.8k 77.2k 0.0k 908.0k 772.0k 0.0k nvme8n19 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 76.8k 96.8k 0.0k 768.0k 968.0k 0.0k nvme8n2 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 65.6k 84.0k 0.0k 656.0k 840.0k 0.0k nvme8n20 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 84.4k 104.8k 0.0k 844.0k 1.0M 0.0k nvme8n3 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 86.8k 61.6k 0.0k 868.0k 616.0k 0.0k nvme8n4 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 85.2k 94.4k 0.0k 852.0k 944.0k 0.0k nvme8n5 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 120.0k 60.0k 0.0k 1.2M 600.0k 0.0k nvme8n6 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 85.2k 96.0k 0.0k 852.0k 960.0k 0.0k nvme8n7 2024-03-25T09:33:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 8.10 78.8k 104.0k 0.0k 788.0k 1.0M 0.0k nvme8n8 2024-03-25T09:33:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 8.00 80.8k 95.2k 0.0k 808.0k 952.0k 0.0k nvme8n9 2024-03-25T09:33:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:10.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:10.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:10.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:09 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:10.213 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 6/s 2/s 136 KiB/s 70 KiB/s 2.69 ms 485.12 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 3/s 130 KiB/s 46 KiB/s 3.00 ms 374.65 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 4/s 118 KiB/s 125 KiB/s 2.42 ms 392.49 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 3/s 108 KiB/s 74 KiB/s 3.03 ms 341.21 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 4/s 88 KiB/s 65 KiB/s 2.59 ms 315.51 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 3/s 85 KiB/s 56 KiB/s 3.00 ms 421.67 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 73 KiB/s 91 KiB/s 2.70 ms 302.89 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 3/s 76 KiB/s 58 KiB/s 2.25 ms 313.25 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 114 KiB/s 99 KiB/s 2.54 ms 326.49 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 3/s 68 KiB/s 65 KiB/s 2.94 ms 391.50 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 2/s 95 KiB/s 81 KiB/s 2.69 ms 366.90 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 3/s 104 KiB/s 92 KiB/s 2.50 ms 304.02 us 2024-03-25T09:33:10.214 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 3/s 88 KiB/s 42 KiB/s 2.62 ms 312.74 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 90 KiB/s 76 KiB/s 2.60 ms 285.27 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 3/s 85 KiB/s 51 KiB/s 2.71 ms 290.28 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 121 KiB/s 83 KiB/s 2.81 ms 326.87 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 122 KiB/s 90 KiB/s 2.93 ms 320.51 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 101 KiB/s 42 KiB/s 2.79 ms 357.86 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 3/s 86 KiB/s 74 KiB/s 2.92 ms 336.38 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 102 KiB/s 89 KiB/s 2.86 ms 335.83 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 3/s 106 KiB/s 66 KiB/s 3.15 ms 335.37 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 5/s 90 KiB/s 114 KiB/s 2.92 ms 314.48 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 4/s 64 KiB/s 78 KiB/s 2.61 ms 403.31 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 91 KiB/s 123 KiB/s 2.90 ms 368.34 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 4/s 90 KiB/s 105 KiB/s 2.79 ms 444.00 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 2/s 56 KiB/s 55 KiB/s 3.01 ms 481.12 us 2024-03-25T09:33:10.215 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 3/s 74 KiB/s 86 KiB/s 2.83 ms 336.21 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 77 KiB/s 92 KiB/s 2.46 ms 403.92 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 3/s 76 KiB/s 57 KiB/s 2.52 ms 309.05 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 93 KiB/s 78 KiB/s 2.74 ms 371.56 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 3/s 114 KiB/s 79 KiB/s 2.82 ms 301.47 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 4/s 66 KiB/s 106 KiB/s 2.46 ms 360.26 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 72 KiB/s 94 KiB/s 2.63 ms 332.86 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 87 KiB/s 74 KiB/s 2.43 ms 334.60 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 94 KiB/s 105 KiB/s 2.83 ms 351.22 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 72 KiB/s 79 KiB/s 3.34 ms 379.40 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 3/s 78 KiB/s 82 KiB/s 2.45 ms 351.72 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 108 KiB/s 115 KiB/s 3.11 ms 345.57 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 4/s 79 KiB/s 70 KiB/s 3.18 ms 308.75 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 3/s 98 KiB/s 66 KiB/s 2.98 ms 304.13 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 5/s 83 KiB/s 126 KiB/s 2.39 ms 406.22 us 2024-03-25T09:33:10.216 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 40 KiB/s 102 KiB/s 2.96 ms 305.68 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 57 KiB/s 93 KiB/s 3.09 ms 318.76 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 78 KiB/s 106 KiB/s 2.55 ms 333.81 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 3/s 68 KiB/s 86 KiB/s 2.55 ms 371.37 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 64 KiB/s 97 KiB/s 3.61 ms 326.38 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 89 KiB/s 94 KiB/s 3.25 ms 486.55 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 69 KiB/s 96 KiB/s 3.17 ms 328.34 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 4/s 76 KiB/s 91 KiB/s 2.86 ms 313.34 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 48 KiB/s 95 KiB/s 2.93 ms 405.86 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 4/s 63 KiB/s 79 KiB/s 2.49 ms 254.01 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 4/s 62 KiB/s 101 KiB/s 2.72 ms 326.38 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 4/s 85 KiB/s 102 KiB/s 2.65 ms 335.62 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 4/s 38 KiB/s 99 KiB/s 2.92 ms 353.31 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 2/s 3/s 60 KiB/s 88 KiB/s 2.54 ms 319.54 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 2/s 4/s 51 KiB/s 118 KiB/s 2.49 ms 346.08 us 2024-03-25T09:33:10.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 2/s 3/s 76 KiB/s 73 KiB/s 2.51 ms 356.63 us 2024-03-25T09:33:10.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 2/s 4/s 43 KiB/s 86 KiB/s 2.62 ms 501.29 us 2024-03-25T09:33:10.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 2/s 4/s 64 KiB/s 111 KiB/s 2.56 ms 311.56 us 2024-03-25T09:33:10.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 2/s 4/s 54 KiB/s 114 KiB/s 2.65 ms 329.23 us 2024-03-25T09:33:10.218 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:10.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:10 smithi059 ceph-mon[32732]: pgmap v728: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.9 MiB/s wr, 468 op/s 2024-03-25T09:33:10.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:10 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 702 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:10 smithi040 ceph-mon[33094]: pgmap v728: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.9 MiB/s wr, 468 op/s 2024-03-25T09:33:10.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:10 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 702 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:10.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:10 smithi019 ceph-mon[29386]: pgmap v728: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.9 MiB/s wr, 468 op/s 2024-03-25T09:33:10.810 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:10 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 702 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:10.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:10.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:10.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:10 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:11.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:11 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:11.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:11 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:11.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:11 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:11.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:11 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:11.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:11 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:11.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:11 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:11.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:11 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:11.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:11 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:11.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:11 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:11.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:11 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:11.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:11 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:11.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:11 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:11.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:11 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:11.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:11 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:11.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:11.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:11.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:11 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:11.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:11 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:11.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:11 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:11.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:11 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:11.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:11 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:11.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:11 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:11.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:11 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:11.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:11 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:12.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:12 smithi059 ceph-mon[32732]: pgmap v729: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 518 op/s 2024-03-25T09:33:12.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:12 smithi040 ceph-mon[33094]: pgmap v729: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 518 op/s 2024-03-25T09:33:12.809 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:12 smithi019 ceph-mon[29386]: pgmap v729: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 518 op/s 2024-03-25T09:33:12.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:12.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:12.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:12 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:12.818+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:14.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:14.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:14.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:13 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:14.740 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:14 smithi019 ceph-mon[29386]: pgmap v730: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 486 op/s 2024-03-25T09:33:14.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:14.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:14 smithi059 ceph-mon[32732]: pgmap v730: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 486 op/s 2024-03-25T09:33:14.766 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:14 smithi040 ceph-mon[33094]: pgmap v730: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 486 op/s 2024-03-25T09:33:15.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:15.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:15.217 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:15.217 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 4/s 146 KiB/s 100 KiB/s 2.62 ms 402.38 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 5/s 3/s 80 KiB/s 66 KiB/s 2.99 ms 348.19 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 3/s 116 KiB/s 70 KiB/s 2.80 ms 327.51 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 5/s 4/s 80 KiB/s 83 KiB/s 2.34 ms 318.62 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 4/s 92 KiB/s 79 KiB/s 2.56 ms 324.60 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 3/s 117 KiB/s 83 KiB/s 2.59 ms 484.88 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 106 KiB/s 86 KiB/s 2.84 ms 309.80 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 4/s 109 KiB/s 107 KiB/s 2.58 ms 373.66 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 101 KiB/s 80 KiB/s 2.56 ms 312.02 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 105 KiB/s 82 KiB/s 2.66 ms 293.74 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 99 KiB/s 67 KiB/s 2.78 ms 272.78 us 2024-03-25T09:33:15.218 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 2/s 93 KiB/s 54 KiB/s 2.52 ms 259.29 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 3/s 124 KiB/s 74 KiB/s 2.85 ms 304.10 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 109 KiB/s 102 KiB/s 3.53 ms 342.21 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 5/s 91 KiB/s 85 KiB/s 2.69 ms 383.62 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 3/s 74 KiB/s 78 KiB/s 2.67 ms 481.45 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 3/s 95 KiB/s 42 KiB/s 2.75 ms 383.75 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 3/s 94 KiB/s 70 KiB/s 2.82 ms 387.48 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 2/s 70 KiB/s 30 KiB/s 2.33 ms 433.26 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 4/s 86 KiB/s 86 KiB/s 2.95 ms 401.82 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 2/s 96 KiB/s 46 KiB/s 2.75 ms 352.39 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 88 KiB/s 96 KiB/s 3.05 ms 345.01 us 2024-03-25T09:33:15.219 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 69 KiB/s 119 KiB/s 2.61 ms 329.30 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 88 KiB/s 71 KiB/s 2.65 ms 380.76 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 102 KiB/s 94 KiB/s 3.09 ms 330.05 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 86 KiB/s 122 KiB/s 2.78 ms 364.14 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 93 KiB/s 94 KiB/s 3.00 ms 377.61 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 5/s 75 KiB/s 127 KiB/s 2.76 ms 304.25 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 96 KiB/s 62 KiB/s 2.99 ms 307.84 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 93 KiB/s 78 KiB/s 2.50 ms 482.01 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 86 KiB/s 75 KiB/s 2.55 ms 386.78 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 4/s 82 KiB/s 77 KiB/s 2.54 ms 385.22 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 4/s 89 KiB/s 98 KiB/s 3.04 ms 293.40 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 3/s 69 KiB/s 66 KiB/s 2.40 ms 324.32 us 2024-03-25T09:33:15.220 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 74 KiB/s 83 KiB/s 2.80 ms 385.64 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 5/s 76 KiB/s 98 KiB/s 3.06 ms 326.64 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 4/s 102 KiB/s 73 KiB/s 2.55 ms 346.39 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 3/s 79 KiB/s 59 KiB/s 2.55 ms 309.29 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 80 KiB/s 63 KiB/s 2.98 ms 365.54 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 67 KiB/s 76 KiB/s 3.72 ms 322.69 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 86 KiB/s 82 KiB/s 3.18 ms 347.94 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 4/s 84 KiB/s 79 KiB/s 3.03 ms 336.97 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 62 KiB/s 111 KiB/s 2.38 ms 271.06 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 3/s 72 KiB/s 64 KiB/s 2.57 ms 344.52 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 4/s 74 KiB/s 86 KiB/s 2.84 ms 315.62 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 4/s 58 KiB/s 154 KiB/s 2.92 ms 354.85 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 78 KiB/s 73 KiB/s 2.67 ms 321.46 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 3/s 63 KiB/s 55 KiB/s 2.47 ms 297.84 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 48 KiB/s 90 KiB/s 2.74 ms 321.25 us 2024-03-25T09:33:15.221 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 3/s 81 KiB/s 82 KiB/s 2.74 ms 430.77 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 54 KiB/s 111 KiB/s 3.21 ms 341.11 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 3/s 52 KiB/s 61 KiB/s 2.31 ms 299.03 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 51 KiB/s 80 KiB/s 2.79 ms 320.50 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 69 KiB/s 98 KiB/s 3.13 ms 329.11 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 4/s 57 KiB/s 83 KiB/s 2.98 ms 336.29 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 71 KiB/s 80 KiB/s 2.63 ms 404.20 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 83 KiB/s 106 KiB/s 2.73 ms 337.56 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 2/s 3/s 37 KiB/s 60 KiB/s 2.60 ms 276.59 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 2/s 4/s 68 KiB/s 118 KiB/s 2.57 ms 324.00 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 2/s 4/s 58 KiB/s 94 KiB/s 3.20 ms 332.09 us 2024-03-25T09:33:15.222 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:15.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:15 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 707 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:15.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:15 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 707 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:15.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:15.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:15.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:15 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:15 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 707 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:16.744 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-mon[29386]: pgmap v731: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 475 op/s 2024-03-25T09:33:16.744 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:16.745 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:16.745 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:16.745 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:16.745 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:16.745 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:16.745 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:16.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:16 smithi059 ceph-mon[32732]: pgmap v731: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 475 op/s 2024-03-25T09:33:16.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:16 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:16.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:16 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:16.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:16 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:16.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:16 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:16.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:16 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:16.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:16 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:16.762 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:16 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:16 smithi040 ceph-mon[33094]: pgmap v731: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 475 op/s 2024-03-25T09:33:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:16 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:16 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:16 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:16 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:16 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:16.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:16 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:16.764 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:16 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:17.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:17.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:17.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:16 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:18.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:18.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:18.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:17 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:18.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:17.819+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:18.757 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:18 smithi019 ceph-mon[29386]: pgmap v732: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 526 op/s 2024-03-25T09:33:18.760 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:18 smithi059 ceph-mon[32732]: pgmap v732: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 526 op/s 2024-03-25T09:33:18.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:18 smithi040 ceph-mon[33094]: pgmap v732: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 526 op/s 2024-03-25T09:33:19.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:19.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:19.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:18 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:19.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:33:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 81.2k 44.8k 0.0k 812.0k 448.0k 0.0k nvme2n1 2024-03-25T09:33:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 78.4k 92.4k 0.0k 784.0k 924.0k 0.0k nvme2n10 2024-03-25T09:33:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 94.8k 82.4k 0.0k 948.0k 824.0k 0.0k nvme2n11 2024-03-25T09:33:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 80.4k 85.2k 0.0k 804.0k 852.0k 0.0k nvme2n12 2024-03-25T09:33:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 65.2k 101.2k 0.0k 652.0k 1012.0k 0.0k nvme2n13 2024-03-25T09:33:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 83.2k 76.8k 0.0k 832.0k 768.0k 0.0k nvme2n14 2024-03-25T09:33:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 73.2k 71.6k 0.0k 732.0k 716.0k 0.0k nvme2n15 2024-03-25T09:33:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 96.8k 69.2k 0.0k 968.0k 692.0k 0.0k nvme2n16 2024-03-25T09:33:19.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 94.4k 57.6k 0.0k 944.0k 576.0k 0.0k nvme2n17 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 62.0k 75.2k 0.0k 620.0k 752.0k 0.0k nvme2n18 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 58.4k 90.4k 0.0k 584.0k 904.0k 0.0k nvme2n19 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 60.4k 90.0k 0.0k 604.0k 900.0k 0.0k nvme2n2 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 80.0k 69.2k 0.0k 800.0k 692.0k 0.0k nvme2n20 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 76.8k 70.0k 0.0k 768.0k 700.0k 0.0k nvme2n3 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 92.8k 69.2k 0.0k 928.0k 692.0k 0.0k nvme2n4 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 64.4k 96.4k 0.0k 644.0k 964.0k 0.0k nvme2n5 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 74.0k 50.8k 0.0k 740.0k 508.0k 0.0k nvme2n6 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 84.0k 66.0k 0.0k 840.0k 660.0k 0.0k nvme2n7 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 72.4k 96.8k 0.0k 724.0k 968.0k 0.0k nvme2n8 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 81.2k 80.8k 0.0k 812.0k 808.0k 0.0k nvme2n9 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 76.8k 81.6k 0.0k 768.0k 816.0k 0.0k nvme5n1 2024-03-25T09:33:19.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 101.2k 71.6k 0.0k 1012.0k 716.0k 0.0k nvme5n10 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 80.8k 85.6k 0.0k 808.0k 856.0k 0.0k nvme5n11 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 70.8k 94.8k 0.0k 708.0k 948.0k 0.0k nvme5n12 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 80.0k 77.6k 0.0k 800.0k 776.0k 0.0k nvme5n13 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 106.4k 57.2k 0.0k 1.0M 572.0k 0.0k nvme5n14 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 95.6k 86.4k 0.0k 956.0k 864.0k 0.0k nvme5n15 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 72.8k 83.2k 0.0k 728.0k 832.0k 0.0k nvme5n16 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 74.0k 78.0k 0.0k 740.0k 780.0k 0.0k nvme5n17 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 66.8k 90.0k 0.0k 668.0k 900.0k 0.0k nvme5n18 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 100.8k 92.8k 0.0k 1008.0k 928.0k 0.0k nvme5n19 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 68.8k 89.2k 0.0k 688.0k 892.0k 0.0k nvme5n2 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 91.6k 58.0k 0.0k 916.0k 580.0k 0.0k nvme5n20 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 100.4k 67.2k 0.0k 1004.0k 672.0k 0.0k nvme5n3 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 101.6k 89.6k 0.0k 1016.0k 896.0k 0.0k nvme5n4 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 83.6k 79.6k 0.0k 836.0k 796.0k 0.0k nvme5n5 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 82.0k 73.2k 0.0k 820.0k 732.0k 0.0k nvme5n6 2024-03-25T09:33:19.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 78.0k 69.2k 0.0k 780.0k 692.0k 0.0k nvme5n7 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 76.0k 97.2k 0.0k 760.0k 972.0k 0.0k nvme5n8 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 75.6k 96.8k 0.0k 756.0k 968.0k 0.0k nvme5n9 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 72.0k 86.4k 0.0k 720.0k 864.0k 0.0k nvme8n1 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 75.6k 76.0k 0.0k 756.0k 760.0k 0.0k nvme8n10 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 72.8k 97.6k 0.0k 728.0k 976.0k 0.0k nvme8n11 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 90.4k 63.2k 0.0k 904.0k 632.0k 0.0k nvme8n12 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 122.4k 78.4k 0.0k 1.2M 784.0k 0.0k nvme8n13 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 90.0k 63.2k 0.0k 900.0k 632.0k 0.0k nvme8n14 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 62.8k 106.8k 0.0k 628.0k 1.0M 0.0k nvme8n15 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 66.8k 99.2k 0.0k 668.0k 992.0k 0.0k nvme8n16 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 70.8k 78.4k 0.0k 708.0k 784.0k 0.0k nvme8n17 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 58.8k 84.0k 0.0k 588.0k 840.0k 0.0k nvme8n18 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 87.2k 73.6k 0.0k 872.0k 736.0k 0.0k nvme8n19 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 76.8k 93.6k 0.0k 768.0k 936.0k 0.0k nvme8n2 2024-03-25T09:33:19.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 70.8k 75.2k 0.0k 708.0k 752.0k 0.0k nvme8n20 2024-03-25T09:33:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 90.8k 84.0k 0.0k 908.0k 840.0k 0.0k nvme8n3 2024-03-25T09:33:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 80.8k 81.2k 0.0k 808.0k 812.0k 0.0k nvme8n4 2024-03-25T09:33:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 66.8k 85.6k 0.0k 668.0k 856.0k 0.0k nvme8n5 2024-03-25T09:33:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 81.6k 56.4k 0.0k 816.0k 564.0k 0.0k nvme8n6 2024-03-25T09:33:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 56.8k 72.4k 0.0k 568.0k 724.0k 0.0k nvme8n7 2024-03-25T09:33:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 74.8k 65.2k 0.0k 748.0k 652.0k 0.0k nvme8n8 2024-03-25T09:33:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 85.2k 84.0k 0.0k 852.0k 840.0k 0.0k nvme8n9 2024-03-25T09:33:19.685 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:20.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:20.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:20.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:19 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 3/s 111 KiB/s 66 KiB/s 3.21 ms 355.45 us 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 5/s 3/s 92 KiB/s 76 KiB/s 2.91 ms 301.28 us 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 5/s 3/s 94 KiB/s 67 KiB/s 2.99 ms 312.94 us 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 2/s 104 KiB/s 53 KiB/s 2.82 ms 386.21 us 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 72 KiB/s 60 KiB/s 2.57 ms 317.26 us 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 2/s 92 KiB/s 44 KiB/s 2.36 ms 269.09 us 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 82 KiB/s 52 KiB/s 2.56 ms 309.44 us 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 3/s 93 KiB/s 41 KiB/s 2.54 ms 314.74 us 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 5/s 86 KiB/s 76 KiB/s 2.32 ms 335.56 us 2024-03-25T09:33:20.222 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 3/s 97 KiB/s 53 KiB/s 2.46 ms 309.31 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 3/s 101 KiB/s 62 KiB/s 2.92 ms 340.97 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 83 KiB/s 72 KiB/s 2.91 ms 353.26 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 3/s 98 KiB/s 75 KiB/s 2.48 ms 344.75 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 3/s 77 KiB/s 45 KiB/s 3.57 ms 428.33 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 3/s 106 KiB/s 88 KiB/s 2.25 ms 299.16 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 102 KiB/s 104 KiB/s 2.68 ms 338.34 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 3/s 91 KiB/s 78 KiB/s 2.84 ms 385.18 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 2/s 90 KiB/s 52 KiB/s 3.31 ms 331.16 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 2/s 107 KiB/s 48 KiB/s 3.27 ms 426.91 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 3/s 74 KiB/s 86 KiB/s 2.92 ms 291.46 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 57 KiB/s 113 KiB/s 2.98 ms 346.06 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 5/s 108 KiB/s 139 KiB/s 2.74 ms 415.60 us 2024-03-25T09:33:20.223 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 77 KiB/s 83 KiB/s 2.73 ms 361.80 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 3/s 81 KiB/s 86 KiB/s 2.54 ms 352.65 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 61 KiB/s 70 KiB/s 2.32 ms 524.47 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 2/s 75 KiB/s 70 KiB/s 2.70 ms 360.69 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 73 KiB/s 100 KiB/s 3.85 ms 401.43 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 4/s 90 KiB/s 78 KiB/s 2.65 ms 468.16 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 5/s 94 KiB/s 108 KiB/s 3.00 ms 352.96 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 83 KiB/s 91 KiB/s 2.59 ms 349.55 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 3/s 70 KiB/s 80 KiB/s 2.91 ms 327.99 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 92 KiB/s 97 KiB/s 2.72 ms 313.06 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 3/s 98 KiB/s 63 KiB/s 2.83 ms 309.57 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 5/s 106 KiB/s 141 KiB/s 3.36 ms 340.83 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 3/s 84 KiB/s 55 KiB/s 2.48 ms 335.98 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 3/s 78 KiB/s 81 KiB/s 3.00 ms 438.67 us 2024-03-25T09:33:20.224 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 4/s 67 KiB/s 77 KiB/s 2.61 ms 305.44 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 3/s 43 KiB/s 71 KiB/s 3.23 ms 384.70 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 2/s 70 KiB/s 46 KiB/s 2.70 ms 334.49 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 3/s 85 KiB/s 77 KiB/s 3.14 ms 322.03 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 3/s 54 KiB/s 54 KiB/s 2.58 ms 333.05 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 42 KiB/s 102 KiB/s 2.56 ms 359.91 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 3/s 78 KiB/s 65 KiB/s 2.73 ms 290.65 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 71 KiB/s 82 KiB/s 3.22 ms 301.99 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 66 KiB/s 80 KiB/s 2.57 ms 334.85 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 5/s 49 KiB/s 105 KiB/s 2.55 ms 319.63 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 4/s 71 KiB/s 112 KiB/s 2.69 ms 346.23 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 3/s 80 KiB/s 82 KiB/s 2.66 ms 455.54 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 4/s 54 KiB/s 102 KiB/s 2.54 ms 317.22 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 4/s 101 KiB/s 81 KiB/s 2.93 ms 398.54 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 3/s 56 KiB/s 78 KiB/s 2.83 ms 432.28 us 2024-03-25T09:33:20.225 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 2/s 4/s 61 KiB/s 92 KiB/s 2.86 ms 402.43 us 2024-03-25T09:33:20.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 2/s 2/s 56 KiB/s 62 KiB/s 2.87 ms 466.61 us 2024-03-25T09:33:20.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 2/s 4/s 50 KiB/s 71 KiB/s 2.81 ms 352.01 us 2024-03-25T09:33:20.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 2/s 3/s 38 KiB/s 62 KiB/s 2.90 ms 329.74 us 2024-03-25T09:33:20.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 2/s 5/s 64 KiB/s 106 KiB/s 2.47 ms 347.80 us 2024-03-25T09:33:20.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 2/s 4/s 54 KiB/s 89 KiB/s 2.72 ms 339.42 us 2024-03-25T09:33:20.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 2/s 4/s 67 KiB/s 82 KiB/s 2.86 ms 339.93 us 2024-03-25T09:33:20.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 2/s 3/s 46 KiB/s 64 KiB/s 2.79 ms 319.54 us 2024-03-25T09:33:20.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 2/s 5/s 35 KiB/s 110 KiB/s 2.69 ms 348.00 us 2024-03-25T09:33:20.226 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:20 smithi059 ceph-mon[32732]: pgmap v733: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 457 op/s 2024-03-25T09:33:20.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:20 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 712 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:20.762 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:20 smithi040 ceph-mon[33094]: pgmap v733: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 457 op/s 2024-03-25T09:33:20.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:20 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 712 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:20.769 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:20 smithi019 ceph-mon[29386]: pgmap v733: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 457 op/s 2024-03-25T09:33:20.769 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:20 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 712 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:21.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:21.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:21.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:20 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:21.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:21 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:21.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:21 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:21.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:21 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:21.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:21 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:21.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:21 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:21.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:21 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:21.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:21 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:21.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:21 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:21.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:21 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:21.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:21 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:21.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:21 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:21.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:21 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:21.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:21 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:21.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:21 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:21.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:21.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:21.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:21 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:21 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:21 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:21 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:21 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:21 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:21 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:21 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:22.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:22 smithi059 ceph-mon[32732]: pgmap v734: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 499 op/s 2024-03-25T09:33:22.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:22 smithi040 ceph-mon[33094]: pgmap v734: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 499 op/s 2024-03-25T09:33:22.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:22 smithi019 ceph-mon[29386]: pgmap v734: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 499 op/s 2024-03-25T09:33:23.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:23.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:23.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:22 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:23.260 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:22.819+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:24.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:24.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:24.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:23 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:24.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:24 smithi059 ceph-mon[32732]: pgmap v735: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 463 op/s 2024-03-25T09:33:24.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:24 smithi040 ceph-mon[33094]: pgmap v735: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 463 op/s 2024-03-25T09:33:24.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:24 smithi019 ceph-mon[29386]: pgmap v735: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 463 op/s 2024-03-25T09:33:25.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:25.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:25.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:24 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:25.226 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:25.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 5/s 4/s 134 KiB/s 109 KiB/s 2.63 ms 323.56 us 2024-03-25T09:33:25.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 3/s 121 KiB/s 59 KiB/s 2.70 ms 322.47 us 2024-03-25T09:33:25.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 3/s 110 KiB/s 86 KiB/s 2.72 ms 439.87 us 2024-03-25T09:33:25.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 5/s 1/s 112 KiB/s 22 KiB/s 2.58 ms 307.42 us 2024-03-25T09:33:25.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 3/s 99 KiB/s 62 KiB/s 2.55 ms 448.66 us 2024-03-25T09:33:25.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 5/s 3/s 88 KiB/s 87 KiB/s 2.76 ms 426.17 us 2024-03-25T09:33:25.226 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 3/s 98 KiB/s 58 KiB/s 2.59 ms 339.03 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 2/s 96 KiB/s 43 KiB/s 2.67 ms 340.54 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 4/s 92 KiB/s 86 KiB/s 2.91 ms 306.29 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 5/s 2/s 94 KiB/s 67 KiB/s 2.85 ms 327.57 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 3/s 102 KiB/s 78 KiB/s 2.92 ms 374.47 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 110 KiB/s 71 KiB/s 2.75 ms 262.22 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 86 KiB/s 88 KiB/s 2.29 ms 288.64 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 4/s 96 KiB/s 108 KiB/s 2.69 ms 352.19 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 122 KiB/s 82 KiB/s 3.35 ms 304.32 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 78 KiB/s 86 KiB/s 2.75 ms 335.06 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 84 KiB/s 86 KiB/s 3.46 ms 319.64 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 4/s 106 KiB/s 110 KiB/s 2.96 ms 415.12 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 76 KiB/s 60 KiB/s 2.75 ms 331.77 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 110 KiB/s 98 KiB/s 2.67 ms 338.68 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 3/s 62 KiB/s 83 KiB/s 2.78 ms 430.65 us 2024-03-25T09:33:25.227 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 3/s 72 KiB/s 60 KiB/s 2.39 ms 528.66 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 3/s 90 KiB/s 70 KiB/s 2.79 ms 374.65 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 5/s 78 KiB/s 90 KiB/s 2.78 ms 291.58 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 76 KiB/s 69 KiB/s 2.94 ms 311.46 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 110 KiB/s 76 KiB/s 2.63 ms 332.55 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 3/s 105 KiB/s 63 KiB/s 3.27 ms 422.39 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 3/s 66 KiB/s 72 KiB/s 2.83 ms 330.76 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 3/s 108 KiB/s 70 KiB/s 2.99 ms 338.17 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 64 KiB/s 82 KiB/s 2.92 ms 277.07 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 4/s 65 KiB/s 76 KiB/s 2.74 ms 433.73 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 2/s 56 KiB/s 68 KiB/s 2.53 ms 504.20 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 72 KiB/s 89 KiB/s 2.96 ms 344.84 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 3/s 81 KiB/s 70 KiB/s 2.42 ms 309.93 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 4/s 58 KiB/s 82 KiB/s 3.09 ms 316.02 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 64 KiB/s 100 KiB/s 2.79 ms 362.89 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 4/s 74 KiB/s 109 KiB/s 2.72 ms 351.30 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 3/s 62 KiB/s 50 KiB/s 2.62 ms 313.03 us 2024-03-25T09:33:25.228 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 3/s 77 KiB/s 50 KiB/s 2.96 ms 297.02 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 57 KiB/s 87 KiB/s 3.33 ms 335.12 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 4/s 72 KiB/s 90 KiB/s 2.90 ms 428.34 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 93 KiB/s 105 KiB/s 2.61 ms 417.49 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 3/s 70 KiB/s 77 KiB/s 2.76 ms 471.21 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 3/s 78 KiB/s 74 KiB/s 2.57 ms 284.87 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 70 KiB/s 79 KiB/s 3.16 ms 423.13 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 3/s 62 KiB/s 53 KiB/s 2.92 ms 316.74 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 5/s 62 KiB/s 103 KiB/s 2.76 ms 362.25 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 72 KiB/s 80 KiB/s 2.49 ms 305.54 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 5/s 72 KiB/s 83 KiB/s 2.75 ms 413.19 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 3/s 69 KiB/s 62 KiB/s 2.97 ms 360.37 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 2/s 52 KiB/s 56 KiB/s 2.40 ms 287.72 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 66 KiB/s 71 KiB/s 3.30 ms 343.04 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 67 KiB/s 86 KiB/s 2.53 ms 371.88 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 3/s 46 KiB/s 82 KiB/s 2.55 ms 310.16 us 2024-03-25T09:33:25.229 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 3/s 56 KiB/s 64 KiB/s 2.51 ms 349.43 us 2024-03-25T09:33:25.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 85 KiB/s 102 KiB/s 2.54 ms 318.70 us 2024-03-25T09:33:25.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 2/s 3/s 46 KiB/s 70 KiB/s 3.95 ms 346.41 us 2024-03-25T09:33:25.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 2/s 5/s 52 KiB/s 94 KiB/s 2.63 ms 440.01 us 2024-03-25T09:33:25.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 2/s 4/s 39 KiB/s 93 KiB/s 2.31 ms 308.54 us 2024-03-25T09:33:25.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 2/s 4/s 26 KiB/s 95 KiB/s 2.69 ms 321.86 us 2024-03-25T09:33:25.230 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:25.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:25 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 717 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:25.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:25 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 717 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:25.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:25.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:25.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:25 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:25.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:25 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 717 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:26 smithi059 ceph-mon[32732]: pgmap v736: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 448 op/s 2024-03-25T09:33:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:26 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:26 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:26 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:26 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:26 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:26 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:26.761 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:26 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:26.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:26 smithi040 ceph-mon[33094]: pgmap v736: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 448 op/s 2024-03-25T09:33:26.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:26 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:26.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:26 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:26.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:26 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:26.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:26 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:26.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:26 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:26.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:26 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:26.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:26 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:26.806 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-mon[29386]: pgmap v736: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 448 op/s 2024-03-25T09:33:26.806 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:26.806 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:26.806 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:26.806 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:26.806 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:26.806 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:26.806 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:27.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:27.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:27.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:26 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:28.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:28.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:28.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:27 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:28.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:27.819+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:28.763 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:28 smithi040 ceph-mon[33094]: pgmap v737: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 504 op/s 2024-03-25T09:33:28.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:28 smithi019 ceph-mon[29386]: pgmap v737: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 504 op/s 2024-03-25T09:33:29.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:28 smithi059 ceph-mon[32732]: pgmap v737: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 504 op/s 2024-03-25T09:33:29.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:29.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:29.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:28 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:29.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:33:29.680 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 84.8k 103.2k 0.0k 848.0k 1.0M 0.0k nvme2n1 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 68.0k 72.0k 0.0k 680.0k 720.0k 0.0k nvme2n10 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 80.4k 71.6k 0.0k 804.0k 716.0k 0.0k nvme2n11 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 79.6k 75.2k 0.0k 796.0k 752.0k 0.0k nvme2n12 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 83.2k 63.6k 0.0k 832.0k 636.0k 0.0k nvme2n13 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 95.6k 64.0k 0.0k 956.0k 640.0k 0.0k nvme2n14 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 87.6k 74.8k 0.0k 876.0k 748.0k 0.0k nvme2n15 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 63.2k 72.4k 0.0k 632.0k 724.0k 0.0k nvme2n16 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 57.6k 67.2k 0.0k 576.0k 672.0k 0.0k nvme2n17 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 56.0k 62.4k 0.0k 560.0k 624.0k 0.0k nvme2n18 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 88.4k 85.6k 0.0k 884.0k 856.0k 0.0k nvme2n19 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 64.0k 54.8k 0.0k 640.0k 548.0k 0.0k nvme2n2 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 90.4k 116.8k 0.0k 904.0k 1.1M 0.0k nvme2n20 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 71.2k 63.2k 0.0k 712.0k 632.0k 0.0k nvme2n3 2024-03-25T09:33:29.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 76.4k 72.8k 0.0k 764.0k 728.0k 0.0k nvme2n4 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 84.0k 62.8k 0.0k 840.0k 628.0k 0.0k nvme2n5 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 90.4k 53.6k 0.0k 904.0k 536.0k 0.0k nvme2n6 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 126.0k 92.0k 0.0k 1.2M 920.0k 0.0k nvme2n7 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 62.4k 67.6k 0.0k 624.0k 676.0k 0.0k nvme2n8 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 89.2k 63.6k 0.0k 892.0k 636.0k 0.0k nvme2n9 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 119.2k 114.8k 0.0k 1.2M 1.1M 0.0k nvme5n1 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 80.4k 68.8k 0.0k 804.0k 688.0k 0.0k nvme5n10 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 68.8k 55.6k 0.0k 688.0k 556.0k 0.0k nvme5n11 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 58.4k 80.4k 0.0k 584.0k 804.0k 0.0k nvme5n12 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 72.4k 78.0k 0.0k 724.0k 780.0k 0.0k nvme5n13 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 68.8k 102.0k 0.0k 688.0k 1020.0k 0.0k nvme5n14 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 87.6k 75.2k 0.0k 876.0k 752.0k 0.0k nvme5n15 2024-03-25T09:33:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 111.6k 50.0k 0.0k 1.1M 500.0k 0.0k nvme5n16 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 95.2k 70.4k 0.0k 952.0k 704.0k 0.0k nvme5n17 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 80.0k 78.4k 0.0k 800.0k 784.0k 0.0k nvme5n18 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 70.8k 78.8k 0.0k 708.0k 788.0k 0.0k nvme5n19 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 74.0k 65.2k 0.0k 740.0k 652.0k 0.0k nvme5n2 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 67.2k 74.4k 0.0k 672.0k 744.0k 0.0k nvme5n20 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 94.8k 59.6k 0.0k 948.0k 596.0k 0.0k nvme5n3 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 69.6k 84.4k 0.0k 696.0k 844.0k 0.0k nvme5n4 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 64.0k 73.2k 0.0k 640.0k 732.0k 0.0k nvme5n5 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 90.0k 85.6k 0.0k 900.0k 856.0k 0.0k nvme5n6 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 74.8k 58.0k 0.0k 748.0k 580.0k 0.0k nvme5n7 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 66.8k 80.8k 0.0k 668.0k 808.0k 0.0k nvme5n8 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 75.6k 66.4k 0.0k 756.0k 664.0k 0.0k nvme5n9 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 65.6k 75.6k 0.0k 656.0k 756.0k 0.0k nvme8n1 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 69.6k 69.6k 0.0k 696.0k 696.0k 0.0k nvme8n10 2024-03-25T09:33:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 52.0k 95.2k 0.0k 520.0k 952.0k 0.0k nvme8n11 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 92.8k 97.6k 0.0k 928.0k 976.0k 0.0k nvme8n12 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 60.8k 71.6k 0.0k 608.0k 716.0k 0.0k nvme8n13 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 110.8k 58.4k 0.0k 1.1M 584.0k 0.0k nvme8n14 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 106.0k 74.0k 0.0k 1.0M 740.0k 0.0k nvme8n15 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 88.0k 69.6k 0.0k 880.0k 696.0k 0.0k nvme8n16 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 51.6k 80.4k 0.0k 516.0k 804.0k 0.0k nvme8n17 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 77.2k 84.0k 0.0k 772.0k 840.0k 0.0k nvme8n18 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 56.8k 78.0k 0.0k 568.0k 780.0k 0.0k nvme8n19 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 70.8k 78.4k 0.0k 708.0k 784.0k 0.0k nvme8n2 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 60.8k 91.6k 0.0k 608.0k 916.0k 0.0k nvme8n20 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 84.0k 70.4k 0.0k 840.0k 704.0k 0.0k nvme8n3 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 75.6k 83.6k 0.0k 756.0k 836.0k 0.0k nvme8n4 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 66.0k 66.4k 0.0k 660.0k 664.0k 0.0k nvme8n5 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 77.2k 73.6k 0.0k 772.0k 736.0k 0.0k nvme8n6 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 63.2k 62.4k 0.0k 632.0k 624.0k 0.0k nvme8n7 2024-03-25T09:33:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 58.4k 95.6k 0.0k 584.0k 956.0k 0.0k nvme8n8 2024-03-25T09:33:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 71.2k 64.0k 0.0k 712.0k 640.0k 0.0k nvme8n9 2024-03-25T09:33:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 7/s 2/s 158 KiB/s 71 KiB/s 2.53 ms 349.50 us 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 5/s 3/s 110 KiB/s 46 KiB/s 2.59 ms 326.85 us 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 3/s 78 KiB/s 69 KiB/s 2.94 ms 357.28 us 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 2/s 74 KiB/s 37 KiB/s 2.68 ms 326.86 us 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 2/s 85 KiB/s 57 KiB/s 2.94 ms 307.00 us 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 2/s 99 KiB/s 57 KiB/s 2.77 ms 396.60 us 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 3/s 108 KiB/s 64 KiB/s 2.61 ms 475.45 us 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 2/s 100 KiB/s 34 KiB/s 2.93 ms 424.31 us 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 5/s 3/s 67 KiB/s 59 KiB/s 3.03 ms 517.85 us 2024-03-25T09:33:30.230 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 3/s 110 KiB/s 54 KiB/s 2.69 ms 333.20 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 2/s 77 KiB/s 41 KiB/s 2.57 ms 430.21 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 90 KiB/s 87 KiB/s 2.81 ms 343.06 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 3/s 83 KiB/s 70 KiB/s 2.52 ms 364.72 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 4/s 65 KiB/s 58 KiB/s 3.04 ms 318.94 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 3/s 61 KiB/s 68 KiB/s 4.07 ms 332.19 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 68 KiB/s 75 KiB/s 2.59 ms 353.84 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 3/s 57 KiB/s 80 KiB/s 2.71 ms 342.31 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 3/s 69 KiB/s 47 KiB/s 3.24 ms 374.43 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 76 KiB/s 82 KiB/s 3.10 ms 319.55 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 121 KiB/s 105 KiB/s 3.12 ms 544.26 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 2/s 73 KiB/s 57 KiB/s 2.59 ms 316.15 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 3/s 66 KiB/s 87 KiB/s 3.04 ms 489.85 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 4/s 70 KiB/s 90 KiB/s 2.85 ms 299.11 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 3/s 125 KiB/s 122 KiB/s 2.84 ms 323.62 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 86 KiB/s 92 KiB/s 3.06 ms 341.39 us 2024-03-25T09:33:30.231 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 59 KiB/s 64 KiB/s 2.95 ms 343.72 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 70 KiB/s 86 KiB/s 3.45 ms 416.24 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 87 KiB/s 93 KiB/s 2.72 ms 418.16 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 3/s 67 KiB/s 95 KiB/s 3.21 ms 331.92 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 3/s 62 KiB/s 46 KiB/s 2.84 ms 294.22 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 3/s 61 KiB/s 91 KiB/s 3.34 ms 422.47 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 48 KiB/s 69 KiB/s 3.38 ms 355.59 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 75 KiB/s 81 KiB/s 2.89 ms 394.92 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 66 KiB/s 85 KiB/s 2.70 ms 419.30 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 3/s 62 KiB/s 70 KiB/s 3.15 ms 386.52 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 5/s 50 KiB/s 79 KiB/s 2.73 ms 422.99 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 3/s 94 KiB/s 94 KiB/s 2.38 ms 338.56 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 3/s 87 KiB/s 63 KiB/s 2.90 ms 339.48 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 57 KiB/s 64 KiB/s 2.74 ms 338.78 us 2024-03-25T09:33:30.232 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 4/s 62 KiB/s 100 KiB/s 2.73 ms 295.23 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 64 KiB/s 82 KiB/s 2.35 ms 395.77 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 65 KiB/s 81 KiB/s 2.76 ms 407.75 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 3/s 48 KiB/s 66 KiB/s 3.16 ms 327.10 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 69 KiB/s 87 KiB/s 3.05 ms 429.82 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 3/s 62 KiB/s 73 KiB/s 3.21 ms 306.09 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 2/s 75 KiB/s 57 KiB/s 2.44 ms 414.14 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 70 KiB/s 74 KiB/s 2.74 ms 322.82 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 3/s 74 KiB/s 78 KiB/s 2.72 ms 333.00 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 71 KiB/s 68 KiB/s 2.57 ms 313.11 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 5/s 63 KiB/s 111 KiB/s 2.52 ms 331.88 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 5/s 67 KiB/s 116 KiB/s 2.76 ms 365.85 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 4/s 49 KiB/s 76 KiB/s 2.96 ms 303.18 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 2/s 4/s 91 KiB/s 126 KiB/s 2.84 ms 305.12 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 2/s 3/s 53 KiB/s 60 KiB/s 2.68 ms 387.96 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 2/s 5/s 53 KiB/s 76 KiB/s 3.01 ms 313.24 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 2/s 5/s 49 KiB/s 90 KiB/s 2.41 ms 367.82 us 2024-03-25T09:33:30.233 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 2/s 4/s 58 KiB/s 108 KiB/s 2.64 ms 322.73 us 2024-03-25T09:33:30.234 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 2/s 3/s 46 KiB/s 66 KiB/s 2.68 ms 321.39 us 2024-03-25T09:33:30.234 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 2/s 3/s 34 KiB/s 62 KiB/s 3.47 ms 325.63 us 2024-03-25T09:33:30.234 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 2/s 4/s 42 KiB/s 102 KiB/s 3.52 ms 340.55 us 2024-03-25T09:33:30.234 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:30.830 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:30 smithi019 ceph-mon[29386]: pgmap v738: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 442 op/s 2024-03-25T09:33:30.830 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:30 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 722 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:31.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:30 smithi059 ceph-mon[32732]: pgmap v738: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 442 op/s 2024-03-25T09:33:31.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:30 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 722 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:31.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:30 smithi040 ceph-mon[33094]: pgmap v738: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 442 op/s 2024-03-25T09:33:31.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:30 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 722 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:31.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:31.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:31.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:30 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:31.774 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:31.775 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:31 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:31.775 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:31 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:31.775 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:31 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:31.775 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:31 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:31.775 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:31 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:31.775 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:31 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:31.775 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:31 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:31 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:31 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:31 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:31 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:31 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:31 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:31 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:31 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:31 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:31 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:32.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:31 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:32.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:31 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:32.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:31 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:32.012 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:31 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:32.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:32.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:31 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:32.820 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:32 smithi059 ceph-mon[32732]: pgmap v739: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.6 MiB/s wr, 486 op/s 2024-03-25T09:33:32.842 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:32 smithi019 ceph-mon[29386]: pgmap v739: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.6 MiB/s wr, 486 op/s 2024-03-25T09:33:33.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:32 smithi040 ceph-mon[33094]: pgmap v739: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.6 MiB/s wr, 486 op/s 2024-03-25T09:33:33.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:33.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:33.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:32 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:32.820+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:34.854 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:34 smithi019 ceph-mon[29386]: pgmap v740: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 460 op/s 2024-03-25T09:33:35.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:34 smithi059 ceph-mon[32732]: pgmap v740: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 460 op/s 2024-03-25T09:33:35.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:34 smithi040 ceph-mon[33094]: pgmap v740: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 460 op/s 2024-03-25T09:33:35.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:35.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:35.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:34 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:35.234 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:35.234 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 6/s 3/s 116 KiB/s 63 KiB/s 2.78 ms 313.02 us 2024-03-25T09:33:35.234 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 4/s 110 KiB/s 69 KiB/s 2.55 ms 289.79 us 2024-03-25T09:33:35.234 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 5/s 4/s 74 KiB/s 76 KiB/s 2.92 ms 382.02 us 2024-03-25T09:33:35.234 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 5/s 3/s 113 KiB/s 67 KiB/s 2.88 ms 342.63 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 5/s 3/s 94 KiB/s 83 KiB/s 2.42 ms 435.98 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 3/s 68 KiB/s 66 KiB/s 2.58 ms 318.54 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 3/s 90 KiB/s 79 KiB/s 2.16 ms 318.39 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 5/s 70 KiB/s 98 KiB/s 2.42 ms 337.06 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 4/s 94 KiB/s 79 KiB/s 2.46 ms 328.28 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 2/s 92 KiB/s 41 KiB/s 2.67 ms 305.01 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 90 KiB/s 79 KiB/s 3.02 ms 346.47 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 4/s 62 KiB/s 82 KiB/s 2.75 ms 388.72 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 67 KiB/s 77 KiB/s 2.64 ms 285.53 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 94 KiB/s 58 KiB/s 2.89 ms 449.62 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 81 KiB/s 65 KiB/s 3.07 ms 487.86 us 2024-03-25T09:33:35.235 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 68 KiB/s 67 KiB/s 2.52 ms 390.93 us 2024-03-25T09:33:35.236 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 94 KiB/s 150 KiB/s 2.95 ms 372.75 us 2024-03-25T09:33:35.236 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 4/s 90 KiB/s 78 KiB/s 2.67 ms 318.16 us 2024-03-25T09:33:35.236 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 3/s 77 KiB/s 38 KiB/s 2.95 ms 303.72 us 2024-03-25T09:33:35.236 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 3/s 74 KiB/s 42 KiB/s 2.65 ms 308.18 us 2024-03-25T09:33:35.236 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 3/s 71 KiB/s 77 KiB/s 3.42 ms 405.54 us 2024-03-25T09:33:35.236 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 5/s 66 KiB/s 99 KiB/s 2.97 ms 378.00 us 2024-03-25T09:33:35.236 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 4/s 56 KiB/s 81 KiB/s 2.76 ms 318.77 us 2024-03-25T09:33:35.236 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 3/s 90 KiB/s 51 KiB/s 2.83 ms 373.61 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 60 KiB/s 64 KiB/s 2.71 ms 309.11 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 4/s 78 KiB/s 101 KiB/s 3.20 ms 342.89 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 4/s 82 KiB/s 80 KiB/s 2.77 ms 378.20 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 90 KiB/s 62 KiB/s 2.81 ms 301.53 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 99 KiB/s 106 KiB/s 4.03 ms 310.34 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 3/s 88 KiB/s 63 KiB/s 2.86 ms 531.65 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 72 KiB/s 69 KiB/s 2.86 ms 316.80 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 4/s 118 KiB/s 129 KiB/s 2.38 ms 382.33 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 52 KiB/s 58 KiB/s 2.86 ms 335.64 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 74 KiB/s 83 KiB/s 3.52 ms 326.78 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 4/s 84 KiB/s 120 KiB/s 2.67 ms 324.37 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 3/s 67 KiB/s 63 KiB/s 2.73 ms 337.34 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 3/s 66 KiB/s 81 KiB/s 2.62 ms 317.40 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 2/s 59 KiB/s 50 KiB/s 2.99 ms 368.92 us 2024-03-25T09:33:35.237 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 5/s 58 KiB/s 82 KiB/s 3.22 ms 319.26 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 3/s 135 KiB/s 90 KiB/s 2.76 ms 369.03 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 60 KiB/s 109 KiB/s 2.85 ms 412.04 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 75 KiB/s 82 KiB/s 3.10 ms 336.53 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 5/s 50 KiB/s 111 KiB/s 2.36 ms 290.09 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 5/s 45 KiB/s 103 KiB/s 2.75 ms 317.39 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 5/s 84 KiB/s 109 KiB/s 2.90 ms 320.61 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 5/s 102 KiB/s 136 KiB/s 2.70 ms 308.06 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 5/s 94 KiB/s 161 KiB/s 2.74 ms 354.43 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 58 KiB/s 97 KiB/s 2.69 ms 326.47 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 97 KiB/s 137 KiB/s 2.61 ms 393.71 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 3/s 42 KiB/s 47 KiB/s 3.02 ms 303.49 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 62 KiB/s 87 KiB/s 2.58 ms 318.92 us 2024-03-25T09:33:35.238 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 48 KiB/s 106 KiB/s 3.34 ms 400.46 us 2024-03-25T09:33:35.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 2/s 4/s 58 KiB/s 70 KiB/s 2.94 ms 303.67 us 2024-03-25T09:33:35.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 2/s 4/s 55 KiB/s 69 KiB/s 2.36 ms 293.61 us 2024-03-25T09:33:35.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 2/s 4/s 72 KiB/s 70 KiB/s 3.12 ms 332.01 us 2024-03-25T09:33:35.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 2/s 4/s 58 KiB/s 68 KiB/s 2.40 ms 365.58 us 2024-03-25T09:33:35.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 2/s 5/s 50 KiB/s 103 KiB/s 3.06 ms 392.02 us 2024-03-25T09:33:35.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 2/s 4/s 34 KiB/s 91 KiB/s 3.52 ms 337.74 us 2024-03-25T09:33:35.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 2/s 4/s 68 KiB/s 146 KiB/s 3.05 ms 341.43 us 2024-03-25T09:33:35.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 2/s 4/s 64 KiB/s 151 KiB/s 2.56 ms 384.06 us 2024-03-25T09:33:35.239 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:35.793 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:35 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 727 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:35.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:35 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 727 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:36.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:35 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 727 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:36.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:36.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:36.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:36.867 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-mon[29386]: pgmap v741: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.2 MiB/s wr, 451 op/s 2024-03-25T09:33:36.867 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:36.867 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:36.867 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:36.867 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:36.867 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:36.867 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:36.867 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:36 smithi059 ceph-mon[32732]: pgmap v741: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.2 MiB/s wr, 451 op/s 2024-03-25T09:33:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:36 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:36 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:36 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:36 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:36 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:36 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:36 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:36 smithi040 ceph-mon[33094]: pgmap v741: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.2 MiB/s wr, 451 op/s 2024-03-25T09:33:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:36 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:36 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:36 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:36 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:36 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:36 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:36 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:37.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:37.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:37.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:36 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:38.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:37.820+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:38.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:38.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:38.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:38.879 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:38 smithi019 ceph-mon[29386]: pgmap v742: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 502 op/s 2024-03-25T09:33:39.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:38 smithi059 ceph-mon[32732]: pgmap v742: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 502 op/s 2024-03-25T09:33:39.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:38 smithi040 ceph-mon[33094]: pgmap v742: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 502 op/s 2024-03-25T09:33:39.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:39.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:39.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:38 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:39.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:33:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 118.4k 114.4k 0.0k 1.2M 1.1M 0.0k nvme2n1 2024-03-25T09:33:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 93.2k 121.2k 0.0k 932.0k 1.2M 0.0k nvme2n10 2024-03-25T09:33:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 74.4k 72.0k 0.0k 744.0k 720.0k 0.0k nvme2n11 2024-03-25T09:33:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 45.2k 111.2k 0.0k 452.0k 1.1M 0.0k nvme2n12 2024-03-25T09:33:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 134.8k 92.8k 0.0k 1.3M 928.0k 0.0k nvme2n13 2024-03-25T09:33:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 68.0k 78.0k 0.0k 680.0k 780.0k 0.0k nvme2n14 2024-03-25T09:33:39.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 111.6k 148.8k 0.0k 1.1M 1.5M 0.0k nvme2n15 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 74.0k 64.0k 0.0k 740.0k 640.0k 0.0k nvme2n16 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 77.2k 73.2k 0.0k 772.0k 732.0k 0.0k nvme2n17 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 103.6k 63.6k 0.0k 1.0M 636.0k 0.0k nvme2n18 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 87.2k 58.0k 0.0k 872.0k 580.0k 0.0k nvme2n19 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 106.0k 72.0k 0.0k 1.0M 720.0k 0.0k nvme2n2 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 127.6k 105.6k 0.0k 1.2M 1.0M 0.0k nvme2n20 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 114.4k 63.6k 0.0k 1.1M 636.0k 0.0k nvme2n3 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 99.6k 100.0k 0.0k 996.0k 1000.0k 0.0k nvme2n4 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 61.2k 79.6k 0.0k 612.0k 796.0k 0.0k nvme2n5 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 91.2k 138.8k 0.0k 912.0k 1.4M 0.0k nvme2n6 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 123.2k 108.4k 0.0k 1.2M 1.1M 0.0k nvme2n7 2024-03-25T09:33:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 50.8k 88.4k 0.0k 508.0k 884.0k 0.0k nvme2n8 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 56.8k 74.8k 0.0k 568.0k 748.0k 0.0k nvme2n9 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 108.8k 104.4k 0.0k 1.1M 1.0M 0.0k nvme5n1 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 75.2k 54.4k 0.0k 752.0k 544.0k 0.0k nvme5n10 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 90.0k 60.0k 0.0k 900.0k 600.0k 0.0k nvme5n11 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 62.0k 80.8k 0.0k 620.0k 808.0k 0.0k nvme5n12 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 115.6k 72.8k 0.0k 1.1M 728.0k 0.0k nvme5n13 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 64.4k 66.8k 0.0k 644.0k 668.0k 0.0k nvme5n14 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 88.0k 75.2k 0.0k 880.0k 752.0k 0.0k nvme5n15 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 102.4k 102.0k 0.0k 1.0M 1020.0k 0.0k nvme5n16 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 98.4k 112.8k 0.0k 984.0k 1.1M 0.0k nvme5n17 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 92.8k 67.2k 0.0k 928.0k 672.0k 0.0k nvme5n18 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 96.0k 108.4k 0.0k 960.0k 1.1M 0.0k nvme5n19 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 112.8k 86.0k 0.0k 1.1M 860.0k 0.0k nvme5n2 2024-03-25T09:33:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 85.6k 72.4k 0.0k 856.0k 724.0k 0.0k nvme5n20 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 57.2k 72.0k 0.0k 572.0k 720.0k 0.0k nvme5n3 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 62.8k 90.8k 0.0k 628.0k 908.0k 0.0k nvme5n4 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 92.0k 72.8k 0.0k 920.0k 728.0k 0.0k nvme5n5 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 87.6k 56.0k 0.0k 876.0k 560.0k 0.0k nvme5n6 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 116.4k 109.6k 0.0k 1.1M 1.1M 0.0k nvme5n7 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 72.4k 74.4k 0.0k 724.0k 744.0k 0.0k nvme5n8 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 62.0k 70.4k 0.0k 620.0k 704.0k 0.0k nvme5n9 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 66.4k 70.4k 0.0k 664.0k 704.0k 0.0k nvme8n1 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 84.0k 72.0k 0.0k 840.0k 720.0k 0.0k nvme8n10 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 107.6k 86.8k 0.0k 1.1M 868.0k 0.0k nvme8n11 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 150.8k 115.2k 0.0k 1.5M 1.1M 0.0k nvme8n12 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 80.8k 68.4k 0.0k 808.0k 684.0k 0.0k nvme8n13 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 124.8k 114.4k 0.0k 1.2M 1.1M 0.0k nvme8n14 2024-03-25T09:33:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 93.2k 60.0k 0.0k 932.0k 600.0k 0.0k nvme8n15 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 109.2k 133.2k 0.0k 1.1M 1.3M 0.0k nvme8n16 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 63.2k 58.0k 0.0k 632.0k 580.0k 0.0k nvme8n17 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 72.0k 50.8k 0.0k 720.0k 508.0k 0.0k nvme8n18 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 76.4k 55.6k 0.0k 764.0k 556.0k 0.0k nvme8n19 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 116.0k 90.4k 0.0k 1.1M 904.0k 0.0k nvme8n2 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.70 50.8k 94.4k 0.0k 508.0k 944.0k 0.0k nvme8n20 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 63.2k 85.2k 0.0k 632.0k 852.0k 0.0k nvme8n3 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 108.4k 90.4k 0.0k 1.1M 904.0k 0.0k nvme8n4 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 65.6k 89.2k 0.0k 656.0k 892.0k 0.0k nvme8n5 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 128.8k 107.6k 0.0k 1.3M 1.1M 0.0k nvme8n6 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 81.6k 70.8k 0.0k 816.0k 708.0k 0.0k nvme8n7 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 65.6k 116.4k 0.0k 656.0k 1.1M 0.0k nvme8n8 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.80 80.0k 68.4k 0.0k 800.0k 684.0k 0.0k nvme8n9 2024-03-25T09:33:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:40.239 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:40.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 5/s 3/s 170 KiB/s 84 KiB/s 3.04 ms 333.99 us 2024-03-25T09:33:40.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 3/s 110 KiB/s 47 KiB/s 2.77 ms 425.14 us 2024-03-25T09:33:40.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 5/s 84 KiB/s 123 KiB/s 3.25 ms 412.30 us 2024-03-25T09:33:40.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 5/s 5/s 88 KiB/s 93 KiB/s 2.66 ms 278.72 us 2024-03-25T09:33:40.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 3/s 128 KiB/s 50 KiB/s 2.23 ms 284.26 us 2024-03-25T09:33:40.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 2/s 131 KiB/s 62 KiB/s 2.62 ms 296.87 us 2024-03-25T09:33:40.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 3/s 178 KiB/s 94 KiB/s 3.15 ms 368.06 us 2024-03-25T09:33:40.239 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 2/s 119 KiB/s 54 KiB/s 2.88 ms 324.93 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 3/s 103 KiB/s 65 KiB/s 2.82 ms 348.50 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 156 KiB/s 127 KiB/s 3.24 ms 371.27 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 3/s 86 KiB/s 60 KiB/s 2.99 ms 345.35 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 66 KiB/s 73 KiB/s 3.23 ms 386.81 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 2/s 83 KiB/s 57 KiB/s 3.70 ms 395.71 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 4/s 62 KiB/s 80 KiB/s 2.79 ms 390.64 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 3/s 56 KiB/s 50 KiB/s 2.81 ms 506.48 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 2/s 138 KiB/s 61 KiB/s 2.87 ms 454.74 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 4/s 79 KiB/s 92 KiB/s 2.81 ms 453.62 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 2/s 84 KiB/s 63 KiB/s 3.14 ms 442.30 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 4/s 124 KiB/s 123 KiB/s 2.52 ms 402.48 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 2/s 60 KiB/s 58 KiB/s 2.73 ms 340.72 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 69 KiB/s 58 KiB/s 2.70 ms 301.22 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 3/s 130 KiB/s 85 KiB/s 3.13 ms 293.54 us 2024-03-25T09:33:40.240 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 4/s 85 KiB/s 108 KiB/s 3.28 ms 345.57 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 111 KiB/s 105 KiB/s 2.94 ms 322.21 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 111 KiB/s 86 KiB/s 2.84 ms 307.52 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 138 KiB/s 129 KiB/s 2.44 ms 281.75 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 4/s 68 KiB/s 68 KiB/s 2.84 ms 363.61 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 86 KiB/s 72 KiB/s 2.96 ms 326.67 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 117 KiB/s 93 KiB/s 2.59 ms 305.45 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 3/s 98 KiB/s 86 KiB/s 2.52 ms 476.03 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 3/s 76 KiB/s 76 KiB/s 2.63 ms 332.35 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 64 KiB/s 62 KiB/s 2.42 ms 370.38 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 4/s 66 KiB/s 74 KiB/s 2.70 ms 375.46 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 4/s 119 KiB/s 134 KiB/s 2.77 ms 329.83 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 78 KiB/s 96 KiB/s 3.15 ms 328.39 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 118 KiB/s 130 KiB/s 3.94 ms 313.34 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 93 KiB/s 95 KiB/s 2.50 ms 329.60 us 2024-03-25T09:33:40.241 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 4/s 53 KiB/s 75 KiB/s 2.36 ms 310.04 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 2/s 103 KiB/s 46 KiB/s 3.51 ms 303.87 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 4/s 56 KiB/s 68 KiB/s 2.87 ms 319.13 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 66 KiB/s 60 KiB/s 2.63 ms 333.78 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 5/s 78 KiB/s 98 KiB/s 2.30 ms 326.99 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 4/s 84 KiB/s 79 KiB/s 2.56 ms 317.86 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 111 KiB/s 148 KiB/s 2.56 ms 368.77 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 3/s 129 KiB/s 130 KiB/s 2.77 ms 354.61 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 4/s 62 KiB/s 80 KiB/s 2.46 ms 306.90 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 4/s 68 KiB/s 80 KiB/s 2.90 ms 302.44 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 66 KiB/s 99 KiB/s 2.77 ms 367.77 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 5/s 70 KiB/s 93 KiB/s 2.59 ms 295.58 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 70 KiB/s 84 KiB/s 2.54 ms 354.32 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 5/s 78 KiB/s 138 KiB/s 2.65 ms 418.27 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 101 KiB/s 120 KiB/s 3.35 ms 380.58 us 2024-03-25T09:33:40.242 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 3/s 48 KiB/s 52 KiB/s 3.16 ms 304.47 us 2024-03-25T09:33:40.243 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 4/s 80 KiB/s 93 KiB/s 2.86 ms 339.59 us 2024-03-25T09:33:40.243 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 2/s 4/s 51 KiB/s 77 KiB/s 2.71 ms 405.73 us 2024-03-25T09:33:40.243 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 2/s 5/s 54 KiB/s 93 KiB/s 2.96 ms 468.39 us 2024-03-25T09:33:40.243 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 2/s 4/s 85 KiB/s 138 KiB/s 3.14 ms 322.69 us 2024-03-25T09:33:40.243 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 2/s 3/s 51 KiB/s 62 KiB/s 1.95 ms 403.04 us 2024-03-25T09:33:40.243 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 2/s 3/s 63 KiB/s 92 KiB/s 2.86 ms 411.98 us 2024-03-25T09:33:40.243 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 1/s 3/s 30 KiB/s 123 KiB/s 3.01 ms 348.75 us 2024-03-25T09:33:40.243 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:40.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:40.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:40.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:40.891 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:40 smithi019 ceph-mon[29386]: pgmap v743: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 441 op/s 2024-03-25T09:33:40.891 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:40 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 732 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:40 smithi059 ceph-mon[32732]: pgmap v743: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 441 op/s 2024-03-25T09:33:41.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:40 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 732 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:41.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:40 smithi040 ceph-mon[33094]: pgmap v743: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 441 op/s 2024-03-25T09:33:41.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:40 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 732 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:41.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:41.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:41.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:40 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:41.828 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:41.828 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:41.828 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:41.828 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:41.828 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:41.828 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:41.828 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:41.829 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:33:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:41 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:41 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:41 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:41 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:41 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:41 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:41 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:41 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:33:42.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:41 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:41 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:41 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:41 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:41 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:41 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:41 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:41 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:33:42.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:42.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:42.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:42.821 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:42 smithi059 ceph-mon[32732]: pgmap v744: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.0 MiB/s wr, 487 op/s 2024-03-25T09:33:42.821 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:42 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:33:42.821 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:42 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:33:42.821 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:42 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:33:42.903 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:42 smithi019 ceph-mon[29386]: pgmap v744: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.0 MiB/s wr, 487 op/s 2024-03-25T09:33:42.903 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:42 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:33:42.903 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:42 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:33:42.903 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:42 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:33:43.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:42 smithi040 ceph-mon[33094]: pgmap v744: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.0 MiB/s wr, 487 op/s 2024-03-25T09:33:43.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:42 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:33:43.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:42 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:33:43.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:42 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:33:43.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:43.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:43.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:42 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:43.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:42.820+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:43.843 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:43 smithi040 ceph-mon[33094]: pgmap v745: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 476 op/s 2024-03-25T09:33:43.843 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:43 smithi040 ceph-mon[33094]: pgmap v746: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 484 op/s 2024-03-25T09:33:43.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:43 smithi019 ceph-mon[29386]: pgmap v745: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 476 op/s 2024-03-25T09:33:43.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:43 smithi019 ceph-mon[29386]: pgmap v746: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 484 op/s 2024-03-25T09:33:44.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:43 smithi059 ceph-mon[32732]: pgmap v745: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 476 op/s 2024-03-25T09:33:44.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:43 smithi059 ceph-mon[32732]: pgmap v746: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 484 op/s 2024-03-25T09:33:44.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:44.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:44.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:43 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:45.243 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:45.243 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 5/s 3/s 114 KiB/s 118 KiB/s 2.86 ms 311.18 us 2024-03-25T09:33:45.243 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 5/s 2/s 162 KiB/s 74 KiB/s 2.79 ms 358.12 us 2024-03-25T09:33:45.243 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 5/s 3/s 120 KiB/s 86 KiB/s 2.99 ms 378.01 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 5/s 115 KiB/s 177 KiB/s 2.75 ms 394.62 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 3/s 122 KiB/s 98 KiB/s 3.06 ms 356.81 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 2/s 139 KiB/s 109 KiB/s 3.21 ms 377.15 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 4/s 85 KiB/s 96 KiB/s 3.02 ms 376.26 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 3/s 148 KiB/s 84 KiB/s 2.71 ms 301.70 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 159 KiB/s 117 KiB/s 2.77 ms 346.24 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 2/s 118 KiB/s 86 KiB/s 2.61 ms 432.36 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 3/s 74 KiB/s 43 KiB/s 2.72 ms 350.81 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 122 KiB/s 108 KiB/s 2.97 ms 315.64 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 3/s 116 KiB/s 124 KiB/s 2.71 ms 360.22 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 4/s 158 KiB/s 141 KiB/s 3.34 ms 430.88 us 2024-03-25T09:33:45.244 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 2/s 74 KiB/s 40 KiB/s 3.11 ms 328.03 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 2/s 86 KiB/s 26 KiB/s 2.97 ms 342.25 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 3/s 120 KiB/s 127 KiB/s 3.07 ms 343.44 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 4/s 91 KiB/s 155 KiB/s 3.61 ms 345.43 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 3/s 49 KiB/s 59 KiB/s 3.37 ms 346.61 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 3/s 83 KiB/s 69 KiB/s 2.66 ms 442.09 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 3/s 118 KiB/s 104 KiB/s 3.59 ms 363.03 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 89 KiB/s 107 KiB/s 2.96 ms 337.31 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 3/s 150 KiB/s 110 KiB/s 2.38 ms 356.77 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 132 KiB/s 160 KiB/s 2.55 ms 319.16 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 4/s 44 KiB/s 86 KiB/s 2.82 ms 391.43 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 2/s 114 KiB/s 70 KiB/s 3.00 ms 324.40 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 3/s 54 KiB/s 76 KiB/s 2.75 ms 373.18 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 3/s 122 KiB/s 95 KiB/s 2.88 ms 378.84 us 2024-03-25T09:33:45.245 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 3/s 78 KiB/s 90 KiB/s 2.99 ms 503.56 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 108 KiB/s 133 KiB/s 2.43 ms 352.13 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 106 KiB/s 124 KiB/s 2.79 ms 394.10 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 4/s 119 KiB/s 138 KiB/s 2.94 ms 374.89 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 3/s 64 KiB/s 62 KiB/s 3.01 ms 351.56 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 3/s 118 KiB/s 107 KiB/s 2.96 ms 458.72 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 3/s 118 KiB/s 90 KiB/s 3.34 ms 365.20 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 4/s 118 KiB/s 132 KiB/s 3.11 ms 305.29 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 5/s 102 KiB/s 138 KiB/s 2.77 ms 361.45 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 3/s 52 KiB/s 62 KiB/s 2.94 ms 327.25 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 3/s 104 KiB/s 120 KiB/s 2.41 ms 356.20 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 62 KiB/s 84 KiB/s 3.05 ms 467.49 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 105 KiB/s 151 KiB/s 3.64 ms 410.21 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 4/s 87 KiB/s 122 KiB/s 2.71 ms 374.19 us 2024-03-25T09:33:45.246 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 45 KiB/s 73 KiB/s 2.76 ms 325.20 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 4/s 89 KiB/s 111 KiB/s 3.28 ms 398.27 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 58 KiB/s 102 KiB/s 3.43 ms 346.86 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 3/s 72 KiB/s 80 KiB/s 2.79 ms 353.23 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 3/s 64 KiB/s 66 KiB/s 2.79 ms 368.63 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 70 KiB/s 69 KiB/s 2.64 ms 296.40 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 77 KiB/s 130 KiB/s 2.71 ms 461.80 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 3/s 85 KiB/s 102 KiB/s 3.86 ms 302.85 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 2/s 78 KiB/s 62 KiB/s 2.73 ms 276.38 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 2/s 84 KiB/s 67 KiB/s 2.36 ms 347.48 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 3/s 50 KiB/s 69 KiB/s 2.92 ms 433.41 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 2/s 2/s 73 KiB/s 41 KiB/s 2.91 ms 335.51 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 2/s 3/s 46 KiB/s 87 KiB/s 2.48 ms 399.33 us 2024-03-25T09:33:45.247 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 2/s 3/s 84 KiB/s 127 KiB/s 2.96 ms 337.19 us 2024-03-25T09:33:45.248 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 2/s 3/s 92 KiB/s 133 KiB/s 3.70 ms 407.99 us 2024-03-25T09:33:45.248 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 2/s 2/s 40 KiB/s 51 KiB/s 2.63 ms 287.87 us 2024-03-25T09:33:45.248 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 2/s 2/s 46 KiB/s 52 KiB/s 2.60 ms 348.69 us 2024-03-25T09:33:45.248 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 1/s 2/s 38 KiB/s 58 KiB/s 2.68 ms 345.72 us 2024-03-25T09:33:45.248 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:45.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:45.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:45.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:44 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:45.856 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:45 smithi040 ceph-mon[33094]: pgmap v747: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 474 op/s 2024-03-25T09:33:45.856 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:45 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 737 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:45.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:45 smithi019 ceph-mon[29386]: pgmap v747: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 474 op/s 2024-03-25T09:33:45.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:45 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 737 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:46.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:45 smithi059 ceph-mon[32732]: pgmap v747: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 474 op/s 2024-03-25T09:33:46.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:45 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 737 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:46.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:46.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:46.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:45 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:46.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:46 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:46.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:46 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:46.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:46 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:46.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:46 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:46.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:46 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:46.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:46 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:46.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:46 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:47.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:46 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:47.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:46 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:47.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:46 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:47.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:46 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:47.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:46 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:47.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:46 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:47.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:46 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:47.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:46 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:47.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:46 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:47.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:46 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:47.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:46 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:47.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:46 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:47.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:46 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:47.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:46 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:47.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:47.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:47.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:46 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:47.821 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:47 smithi059 ceph-mon[32732]: pgmap v748: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 458 op/s 2024-03-25T09:33:47.868 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:47 smithi040 ceph-mon[33094]: pgmap v748: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 458 op/s 2024-03-25T09:33:47.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:47 smithi019 ceph-mon[29386]: pgmap v748: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 458 op/s 2024-03-25T09:33:48.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:47.821+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:48.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:48.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:48.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:47 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:49.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:49.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:49.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:48 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:49.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:33:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 106.0k 111.2k 0.0k 1.0M 1.1M 0.0k nvme2n1 2024-03-25T09:33:49.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 116.0k 128.0k 0.0k 1.1M 1.2M 0.0k nvme2n10 2024-03-25T09:33:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 76.8k 72.0k 0.0k 768.0k 720.0k 0.0k nvme2n11 2024-03-25T09:33:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 55.2k 76.4k 0.0k 552.0k 764.0k 0.0k nvme2n12 2024-03-25T09:33:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 121.2k 111.2k 0.0k 1.2M 1.1M 0.0k nvme2n13 2024-03-25T09:33:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 120.4k 145.2k 0.0k 1.2M 1.4M 0.0k nvme2n14 2024-03-25T09:33:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 114.8k 117.2k 0.0k 1.1M 1.1M 0.0k nvme2n15 2024-03-25T09:33:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 67.6k 125.2k 0.0k 676.0k 1.2M 0.0k nvme2n16 2024-03-25T09:33:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 108.8k 132.8k 0.0k 1.1M 1.3M 0.0k nvme2n17 2024-03-25T09:33:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 112.8k 124.0k 0.0k 1.1M 1.2M 0.0k nvme2n18 2024-03-25T09:33:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 99.2k 131.2k 0.0k 992.0k 1.3M 0.0k nvme2n19 2024-03-25T09:33:49.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 121.2k 101.2k 0.0k 1.2M 1012.0k 0.0k nvme2n2 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 149.2k 89.6k 0.0k 1.5M 896.0k 0.0k nvme2n20 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 109.2k 127.6k 0.0k 1.1M 1.2M 0.0k nvme2n3 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 104.8k 118.8k 0.0k 1.0M 1.2M 0.0k nvme2n4 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 112.8k 91.6k 0.0k 1.1M 916.0k 0.0k nvme2n5 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 94.8k 126.4k 0.0k 948.0k 1.2M 0.0k nvme2n6 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 132.0k 76.0k 0.0k 1.3M 760.0k 0.0k nvme2n7 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 105.2k 113.2k 0.0k 1.0M 1.1M 0.0k nvme2n8 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 143.6k 96.0k 0.0k 1.4M 960.0k 0.0k nvme2n9 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 105.2k 112.0k 0.0k 1.0M 1.1M 0.0k nvme5n1 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 70.4k 68.8k 0.0k 704.0k 688.0k 0.0k nvme5n10 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 140.0k 118.4k 0.0k 1.4M 1.2M 0.0k nvme5n11 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 93.2k 60.0k 0.0k 932.0k 600.0k 0.0k nvme5n12 2024-03-25T09:33:49.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 163.2k 84.8k 0.0k 1.6M 848.0k 0.0k nvme5n13 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 89.2k 82.8k 0.0k 892.0k 828.0k 0.0k nvme5n14 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 85.2k 82.8k 0.0k 852.0k 828.0k 0.0k nvme5n15 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 133.2k 81.2k 0.0k 1.3M 812.0k 0.0k nvme5n16 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 87.6k 137.6k 0.0k 876.0k 1.3M 0.0k nvme5n17 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 138.4k 113.2k 0.0k 1.4M 1.1M 0.0k nvme5n18 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 110.0k 129.2k 0.0k 1.1M 1.3M 0.0k nvme5n19 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 123.6k 116.0k 0.0k 1.2M 1.1M 0.0k nvme5n2 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 100.8k 122.0k 0.0k 1008.0k 1.2M 0.0k nvme5n20 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 93.6k 86.8k 0.0k 936.0k 868.0k 0.0k nvme5n3 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 87.6k 72.8k 0.0k 876.0k 728.0k 0.0k nvme5n4 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 138.0k 110.8k 0.0k 1.3M 1.1M 0.0k nvme5n5 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 72.8k 89.2k 0.0k 728.0k 892.0k 0.0k nvme5n6 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 105.2k 116.0k 0.0k 1.0M 1.1M 0.0k nvme5n7 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 143.2k 94.4k 0.0k 1.4M 944.0k 0.0k nvme5n8 2024-03-25T09:33:49.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 139.2k 107.2k 0.0k 1.4M 1.0M 0.0k nvme5n9 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 126.4k 103.6k 0.0k 1.2M 1.0M 0.0k nvme8n1 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 132.8k 95.2k 0.0k 1.3M 952.0k 0.0k nvme8n10 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 125.2k 112.4k 0.0k 1.2M 1.1M 0.0k nvme8n11 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 112.0k 90.0k 0.0k 1.1M 900.0k 0.0k nvme8n12 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 55.6k 86.4k 0.0k 556.0k 864.0k 0.0k nvme8n13 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 120.4k 106.4k 0.0k 1.2M 1.0M 0.0k nvme8n14 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 88.4k 114.8k 0.0k 884.0k 1.1M 0.0k nvme8n15 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 95.2k 112.8k 0.0k 952.0k 1.1M 0.0k nvme8n16 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 118.4k 81.2k 0.0k 1.2M 812.0k 0.0k nvme8n17 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 102.8k 156.8k 0.0k 1.0M 1.5M 0.0k nvme8n18 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 130.8k 104.0k 0.0k 1.3M 1.0M 0.0k nvme8n19 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 131.6k 113.6k 0.0k 1.3M 1.1M 0.0k nvme8n2 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 101.2k 128.4k 0.0k 1012.0k 1.3M 0.0k nvme8n20 2024-03-25T09:33:49.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 97.6k 91.6k 0.0k 976.0k 916.0k 0.0k nvme8n3 2024-03-25T09:33:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 135.2k 92.0k 0.0k 1.3M 920.0k 0.0k nvme8n4 2024-03-25T09:33:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 110.8k 134.8k 0.0k 1.1M 1.3M 0.0k nvme8n5 2024-03-25T09:33:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 112.4k 134.8k 0.0k 1.1M 1.3M 0.0k nvme8n6 2024-03-25T09:33:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 98.0k 123.2k 0.0k 980.0k 1.2M 0.0k nvme8n7 2024-03-25T09:33:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 101.2k 120.0k 0.0k 1012.0k 1.2M 0.0k nvme8n8 2024-03-25T09:33:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 64.0k 64.8k 0.0k 640.0k 648.0k 0.0k nvme8n9 2024-03-25T09:33:49.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:49.881 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:49 smithi040 ceph-mon[33094]: pgmap v749: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 473 op/s 2024-03-25T09:33:49.907 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:49 smithi019 ceph-mon[29386]: pgmap v749: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 473 op/s 2024-03-25T09:33:50.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:49 smithi059 ceph-mon[32732]: pgmap v749: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 473 op/s 2024-03-25T09:33:50.248 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:50.248 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 5/s 126 KiB/s 182 KiB/s 3.11 ms 352.74 us 2024-03-25T09:33:50.248 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 5/s 4/s 150 KiB/s 130 KiB/s 2.46 ms 333.22 us 2024-03-25T09:33:50.248 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 3/s 155 KiB/s 101 KiB/s 2.67 ms 332.32 us 2024-03-25T09:33:50.248 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 2/s 87 KiB/s 57 KiB/s 3.15 ms 362.11 us 2024-03-25T09:33:50.248 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 5/s 3/s 192 KiB/s 139 KiB/s 2.74 ms 365.35 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 3/s 159 KiB/s 98 KiB/s 3.14 ms 338.56 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 5/s 126 KiB/s 192 KiB/s 3.01 ms 334.41 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 2/s 148 KiB/s 76 KiB/s 2.84 ms 405.41 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 1/s 102 KiB/s 30 KiB/s 3.04 ms 366.76 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 2/s 140 KiB/s 96 KiB/s 2.79 ms 316.34 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 2/s 148 KiB/s 98 KiB/s 2.93 ms 393.65 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 3/s 117 KiB/s 110 KiB/s 2.71 ms 356.43 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 3/s 114 KiB/s 136 KiB/s 2.76 ms 438.13 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 2/s 137 KiB/s 89 KiB/s 2.53 ms 308.38 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 3/s 117 KiB/s 100 KiB/s 3.35 ms 365.18 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 4/s 115 KiB/s 130 KiB/s 2.87 ms 347.98 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 139 KiB/s 109 KiB/s 2.87 ms 449.29 us 2024-03-25T09:33:50.249 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 4/s 139 KiB/s 159 KiB/s 2.75 ms 359.24 us 2024-03-25T09:33:50.250 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 118 KiB/s 118 KiB/s 2.65 ms 313.94 us 2024-03-25T09:33:50.250 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 3/s 94 KiB/s 94 KiB/s 2.90 ms 337.27 us 2024-03-25T09:33:50.250 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 4/s 4/s 137 KiB/s 106 KiB/s 2.98 ms 352.31 us 2024-03-25T09:33:50.250 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 3/s 116 KiB/s 101 KiB/s 3.05 ms 351.03 us 2024-03-25T09:33:50.250 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 3/s 149 KiB/s 126 KiB/s 3.10 ms 387.01 us 2024-03-25T09:33:50.250 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 122 KiB/s 134 KiB/s 2.76 ms 327.91 us 2024-03-25T09:33:50.250 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 4/s 95 KiB/s 105 KiB/s 3.51 ms 334.74 us 2024-03-25T09:33:50.250 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 97 KiB/s 102 KiB/s 3.68 ms 407.26 us 2024-03-25T09:33:50.251 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 3/s 137 KiB/s 121 KiB/s 2.41 ms 352.77 us 2024-03-25T09:33:50.251 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 3/s 79 KiB/s 53 KiB/s 2.71 ms 324.48 us 2024-03-25T09:33:50.251 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 3/s 97 KiB/s 98 KiB/s 2.67 ms 333.20 us 2024-03-25T09:33:50.251 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 3/s 121 KiB/s 99 KiB/s 3.85 ms 310.64 us 2024-03-25T09:33:50.251 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 3/s 117 KiB/s 87 KiB/s 2.66 ms 282.46 us 2024-03-25T09:33:50.251 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 3/s 103 KiB/s 90 KiB/s 3.23 ms 314.24 us 2024-03-25T09:33:50.251 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 117 KiB/s 148 KiB/s 2.91 ms 444.96 us 2024-03-25T09:33:50.251 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 114 KiB/s 101 KiB/s 2.76 ms 311.68 us 2024-03-25T09:33:50.251 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 3/s 77 KiB/s 122 KiB/s 3.57 ms 355.93 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 122 KiB/s 126 KiB/s 2.73 ms 330.98 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 3/s 138 KiB/s 115 KiB/s 2.91 ms 319.83 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 4/s 97 KiB/s 193 KiB/s 2.35 ms 342.51 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 3/s 83 KiB/s 139 KiB/s 2.91 ms 329.62 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 4/s 122 KiB/s 154 KiB/s 2.41 ms 439.41 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 3/s 104 KiB/s 110 KiB/s 2.83 ms 316.12 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 64 KiB/s 93 KiB/s 2.90 ms 420.10 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 2/s 121 KiB/s 83 KiB/s 3.18 ms 310.14 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 70 KiB/s 117 KiB/s 2.49 ms 313.37 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 4/s 94 KiB/s 138 KiB/s 2.51 ms 368.82 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 4/s 66 KiB/s 77 KiB/s 3.12 ms 442.22 us 2024-03-25T09:33:50.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 2/s 54 KiB/s 33 KiB/s 2.98 ms 358.89 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 3/s 76 KiB/s 46 KiB/s 3.06 ms 413.93 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 3/s 92 KiB/s 108 KiB/s 2.91 ms 309.91 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 86 KiB/s 179 KiB/s 2.88 ms 393.71 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 4/s 94 KiB/s 119 KiB/s 3.29 ms 345.11 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 98 KiB/s 114 KiB/s 2.88 ms 359.41 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 2/s 4/s 71 KiB/s 141 KiB/s 2.71 ms 353.97 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 2/s 4/s 95 KiB/s 159 KiB/s 2.69 ms 403.47 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 2/s 4/s 50 KiB/s 63 KiB/s 3.28 ms 326.82 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 2/s 4/s 78 KiB/s 134 KiB/s 3.02 ms 321.78 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 2/s 4/s 41 KiB/s 64 KiB/s 3.14 ms 319.94 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 2/s 4/s 80 KiB/s 147 KiB/s 2.44 ms 370.20 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 2/s 4/s 78 KiB/s 141 KiB/s 3.09 ms 333.20 us 2024-03-25T09:33:50.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 2/s 6/s 33 KiB/s 111 KiB/s 3.57 ms 326.64 us 2024-03-25T09:33:50.254 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:50.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:50.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:50.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:49 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:50.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:50 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 742 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:51.013 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:50 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 742 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:51.015 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:50 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 742 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:51.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:51.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:51.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:50 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:51.893 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-mon[33094]: pgmap v750: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 411 op/s 2024-03-25T09:33:51.893 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:51.893 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:51.893 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:51.893 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:51.893 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:51.893 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:51.893 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:51 smithi019 ceph-mon[29386]: pgmap v750: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 411 op/s 2024-03-25T09:33:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:51 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:51 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:51 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:51.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:51 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:51.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:51 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:51.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:51 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:51.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:51 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:51.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:51 smithi059 ceph-mon[32732]: pgmap v750: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 411 op/s 2024-03-25T09:33:51.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:51 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:51.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:51 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:51.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:51 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:51.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:51 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:51.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:51 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:51.912 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:51 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:51.912 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:51 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:52.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:52.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:52.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:51 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:53.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:52.821+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:53.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:53.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:53.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:52 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:53.905 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:53 smithi040 ceph-mon[33094]: pgmap v751: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.1 MiB/s wr, 455 op/s 2024-03-25T09:33:53.907 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:53 smithi019 ceph-mon[29386]: pgmap v751: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.1 MiB/s wr, 455 op/s 2024-03-25T09:33:54.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:53 smithi059 ceph-mon[32732]: pgmap v751: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.1 MiB/s wr, 455 op/s 2024-03-25T09:33:54.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:54.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:54.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:53 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:55.252 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:33:55.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 5/s 2/s 184 KiB/s 62 KiB/s 2.75 ms 307.83 us 2024-03-25T09:33:55.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 3/s 141 KiB/s 103 KiB/s 3.73 ms 392.96 us 2024-03-25T09:33:55.252 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 148 KiB/s 91 KiB/s 2.58 ms 337.66 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 83 KiB/s 65 KiB/s 3.01 ms 335.54 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 146 KiB/s 98 KiB/s 2.71 ms 339.32 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 4/s 116 KiB/s 150 KiB/s 2.88 ms 458.13 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 166 KiB/s 135 KiB/s 2.57 ms 295.30 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 146 KiB/s 111 KiB/s 2.95 ms 360.77 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 3/s 146 KiB/s 110 KiB/s 2.76 ms 287.97 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 81 KiB/s 88 KiB/s 2.79 ms 388.64 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 4/s 149 KiB/s 106 KiB/s 3.11 ms 408.10 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 2/s 129 KiB/s 102 KiB/s 3.27 ms 354.23 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 2/s 120 KiB/s 70 KiB/s 2.76 ms 395.81 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 4/s 83 KiB/s 108 KiB/s 2.94 ms 320.60 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 2/s 140 KiB/s 70 KiB/s 2.64 ms 272.19 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 3/s 91 KiB/s 135 KiB/s 2.45 ms 345.26 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 3/s 117 KiB/s 82 KiB/s 3.32 ms 316.27 us 2024-03-25T09:33:55.253 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 3/s 124 KiB/s 95 KiB/s 3.03 ms 315.23 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 126 KiB/s 120 KiB/s 3.03 ms 322.13 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 134 KiB/s 78 KiB/s 2.73 ms 398.04 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 134 KiB/s 98 KiB/s 3.49 ms 341.27 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 2/s 122 KiB/s 93 KiB/s 2.61 ms 300.60 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 3/s 114 KiB/s 114 KiB/s 2.93 ms 407.65 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 4/s 115 KiB/s 152 KiB/s 2.90 ms 308.18 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 125 KiB/s 131 KiB/s 2.90 ms 325.07 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 3/s 119 KiB/s 109 KiB/s 2.60 ms 448.68 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 5/s 126 KiB/s 158 KiB/s 2.85 ms 325.29 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 3/s 131 KiB/s 146 KiB/s 3.11 ms 399.75 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 126 KiB/s 151 KiB/s 2.94 ms 402.54 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 128 KiB/s 95 KiB/s 2.77 ms 324.75 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 3/s 130 KiB/s 132 KiB/s 3.12 ms 321.10 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 131 KiB/s 137 KiB/s 3.20 ms 378.59 us 2024-03-25T09:33:55.254 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 106 KiB/s 95 KiB/s 2.72 ms 348.04 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 101 KiB/s 112 KiB/s 2.64 ms 439.06 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 3/s 113 KiB/s 97 KiB/s 2.75 ms 310.29 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 3/s 116 KiB/s 105 KiB/s 2.66 ms 323.62 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 3/s 100 KiB/s 102 KiB/s 3.43 ms 335.12 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 4/s 119 KiB/s 138 KiB/s 3.13 ms 301.12 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 93 KiB/s 85 KiB/s 3.28 ms 475.35 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 106 KiB/s 102 KiB/s 2.59 ms 342.32 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 3/s 49 KiB/s 54 KiB/s 3.05 ms 557.45 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 4/s 84 KiB/s 114 KiB/s 2.84 ms 369.01 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 3/s 155 KiB/s 122 KiB/s 2.99 ms 340.12 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 3/s 102 KiB/s 99 KiB/s 3.41 ms 308.83 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 96 KiB/s 89 KiB/s 2.53 ms 325.82 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 60 KiB/s 41 KiB/s 2.79 ms 322.51 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 4/s 98 KiB/s 103 KiB/s 2.51 ms 340.52 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 116 KiB/s 155 KiB/s 2.67 ms 326.73 us 2024-03-25T09:33:55.255 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 3/s 111 KiB/s 86 KiB/s 3.11 ms 305.64 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 3/s 100 KiB/s 100 KiB/s 2.68 ms 375.91 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 5/s 113 KiB/s 138 KiB/s 3.21 ms 406.02 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 4/s 91 KiB/s 131 KiB/s 3.03 ms 322.70 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 3/s 94 KiB/s 117 KiB/s 3.59 ms 368.24 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 3/s 94 KiB/s 88 KiB/s 2.55 ms 345.79 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 5/s 68 KiB/s 144 KiB/s 2.52 ms 307.98 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 3/s 78 KiB/s 128 KiB/s 3.46 ms 381.00 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 2/s 5/s 56 KiB/s 118 KiB/s 3.30 ms 390.51 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 2/s 4/s 58 KiB/s 126 KiB/s 2.76 ms 311.29 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 2/s 5/s 63 KiB/s 186 KiB/s 2.86 ms 318.51 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 2/s 4/s 71 KiB/s 154 KiB/s 2.81 ms 325.45 us 2024-03-25T09:33:55.256 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:55.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:55.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:55.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:54 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:55.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:55 smithi019 ceph-mon[29386]: pgmap v752: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 432 op/s 2024-03-25T09:33:55.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:55 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 747 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:55.917 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:55 smithi040 ceph-mon[33094]: pgmap v752: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 432 op/s 2024-03-25T09:33:55.917 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:55 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 747 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:55 smithi059 ceph-mon[32732]: pgmap v752: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 432 op/s 2024-03-25T09:33:56.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:55 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 747 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:33:56.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:56.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:56.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:55 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:56 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:56 smithi019 ceph-mon[29386]: { 2024-03-25T09:33:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:56 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:33:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:56 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:33:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:56 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:33:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:56 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:33:56.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:56 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:33:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:56 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:56 smithi059 ceph-mon[32732]: { 2024-03-25T09:33:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:56 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:33:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:56 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:33:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:56 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:33:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:56 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:33:57.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:56 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:33:57.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:56 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:33:57.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:56 smithi040 ceph-mon[33094]: { 2024-03-25T09:33:57.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:56 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:33:57.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:56 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:33:57.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:56 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:33:57.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:56 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:33:57.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:56 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:33:57.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:57.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:57.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:56 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:57.821 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:57 smithi059 ceph-mon[32732]: pgmap v753: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.6 MiB/s wr, 480 op/s 2024-03-25T09:33:57.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:57 smithi019 ceph-mon[29386]: pgmap v753: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.6 MiB/s wr, 480 op/s 2024-03-25T09:33:57.929 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:57 smithi040 ceph-mon[33094]: pgmap v753: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.6 MiB/s wr, 480 op/s 2024-03-25T09:33:58.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:33:57.821+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:33:58.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:58.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:58.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:57 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:59.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:33:59.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:33:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:33:59.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:33:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:33:59.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:33:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 82.8k 115.2k 0.0k 828.0k 1.1M 0.0k nvme2n1 2024-03-25T09:33:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 106.8k 99.6k 0.0k 1.0M 996.0k 0.0k nvme2n10 2024-03-25T09:33:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 57.6k 93.6k 0.0k 576.0k 936.0k 0.0k nvme2n11 2024-03-25T09:33:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 92.4k 89.2k 0.0k 924.0k 892.0k 0.0k nvme2n12 2024-03-25T09:33:59.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 97.2k 100.0k 0.0k 972.0k 1000.0k 0.0k nvme2n13 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 98.8k 111.6k 0.0k 988.0k 1.1M 0.0k nvme2n14 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 92.4k 119.6k 0.0k 924.0k 1.2M 0.0k nvme2n15 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 116.0k 112.8k 0.0k 1.1M 1.1M 0.0k nvme2n16 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 126.8k 131.6k 0.0k 1.2M 1.3M 0.0k nvme2n17 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 87.2k 125.2k 0.0k 872.0k 1.2M 0.0k nvme2n18 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 134.8k 88.8k 0.0k 1.3M 888.0k 0.0k nvme2n19 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 104.8k 118.0k 0.0k 1.0M 1.2M 0.0k nvme2n2 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 101.2k 96.8k 0.0k 1012.0k 968.0k 0.0k nvme2n20 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 102.4k 111.6k 0.0k 1.0M 1.1M 0.0k nvme2n3 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 96.8k 120.0k 0.0k 968.0k 1.2M 0.0k nvme2n4 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 119.6k 108.8k 0.0k 1.2M 1.1M 0.0k nvme2n5 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 120.8k 73.2k 0.0k 1.2M 732.0k 0.0k nvme2n6 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 103.2k 85.2k 0.0k 1.0M 852.0k 0.0k nvme2n7 2024-03-25T09:33:59.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 128.0k 117.6k 0.0k 1.2M 1.1M 0.0k nvme2n8 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 138.8k 136.4k 0.0k 1.4M 1.3M 0.0k nvme2n9 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 114.0k 72.0k 0.0k 1.1M 720.0k 0.0k nvme5n1 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 128.8k 125.2k 0.0k 1.3M 1.2M 0.0k nvme5n10 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 107.2k 137.6k 0.0k 1.0M 1.3M 0.0k nvme5n11 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 130.4k 87.6k 0.0k 1.3M 876.0k 0.0k nvme5n12 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 149.2k 82.0k 0.0k 1.5M 820.0k 0.0k nvme5n13 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 110.8k 121.2k 0.0k 1.1M 1.2M 0.0k nvme5n14 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 83.6k 139.2k 0.0k 836.0k 1.4M 0.0k nvme5n15 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 115.2k 114.8k 0.0k 1.1M 1.1M 0.0k nvme5n16 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 120.0k 94.0k 0.0k 1.2M 940.0k 0.0k nvme5n17 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 109.2k 113.6k 0.0k 1.1M 1.1M 0.0k nvme5n18 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 116.0k 98.0k 0.0k 1.1M 980.0k 0.0k nvme5n19 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 120.4k 106.4k 0.0k 1.2M 1.0M 0.0k nvme5n2 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 122.0k 127.6k 0.0k 1.2M 1.2M 0.0k nvme5n20 2024-03-25T09:33:59.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 107.6k 125.6k 0.0k 1.1M 1.2M 0.0k nvme5n3 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 114.0k 134.4k 0.0k 1.1M 1.3M 0.0k nvme5n4 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 110.4k 104.4k 0.0k 1.1M 1.0M 0.0k nvme5n5 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 104.4k 144.8k 0.0k 1.0M 1.4M 0.0k nvme5n6 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 82.4k 120.0k 0.0k 824.0k 1.2M 0.0k nvme5n7 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 109.6k 132.8k 0.0k 1.1M 1.3M 0.0k nvme5n8 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 107.6k 112.8k 0.0k 1.1M 1.1M 0.0k nvme5n9 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 111.6k 142.0k 0.0k 1.1M 1.4M 0.0k nvme8n1 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 135.2k 78.8k 0.0k 1.3M 788.0k 0.0k nvme8n10 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 104.4k 84.4k 0.0k 1.0M 844.0k 0.0k nvme8n11 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 103.2k 85.2k 0.0k 1.0M 852.0k 0.0k nvme8n12 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 111.2k 128.4k 0.0k 1.1M 1.3M 0.0k nvme8n13 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 134.4k 77.6k 0.0k 1.3M 776.0k 0.0k nvme8n14 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 101.6k 125.6k 0.0k 1016.0k 1.2M 0.0k nvme8n15 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 111.2k 94.0k 0.0k 1.1M 940.0k 0.0k nvme8n16 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 106.4k 162.0k 0.0k 1.0M 1.6M 0.0k nvme8n17 2024-03-25T09:33:59.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 126.8k 126.8k 0.0k 1.2M 1.2M 0.0k nvme8n18 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 142.4k 92.8k 0.0k 1.4M 928.0k 0.0k nvme8n19 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 104.0k 82.8k 0.0k 1.0M 828.0k 0.0k nvme8n2 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 112.0k 126.4k 0.0k 1.1M 1.2M 0.0k nvme8n20 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 108.8k 128.0k 0.0k 1.1M 1.2M 0.0k nvme8n3 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 108.4k 98.0k 0.0k 1.1M 980.0k 0.0k nvme8n4 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 130.4k 112.8k 0.0k 1.3M 1.1M 0.0k nvme8n5 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 104.4k 86.0k 0.0k 1.0M 860.0k 0.0k nvme8n6 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 84.8k 104.4k 0.0k 848.0k 1.0M 0.0k nvme8n7 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 95.2k 114.8k 0.0k 952.0k 1.1M 0.0k nvme8n8 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 95.6k 110.0k 0.0k 956.0k 1.1M 0.0k nvme8n9 2024-03-25T09:33:59.685 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:33:59.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:33:59 smithi019 ceph-mon[29386]: pgmap v754: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 448 op/s 2024-03-25T09:33:59.941 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:33:59 smithi040 ceph-mon[33094]: pgmap v754: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 448 op/s 2024-03-25T09:34:00.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:33:59 smithi059 ceph-mon[32732]: pgmap v754: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 448 op/s 2024-03-25T09:34:00.256 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:00.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 4/s 146 KiB/s 97 KiB/s 3.21 ms 308.53 us 2024-03-25T09:34:00.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 5/s 2/s 120 KiB/s 47 KiB/s 2.61 ms 263.33 us 2024-03-25T09:34:00.256 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 4/s 154 KiB/s 127 KiB/s 3.27 ms 337.53 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 3/s 158 KiB/s 79 KiB/s 2.61 ms 508.42 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 180 KiB/s 123 KiB/s 2.95 ms 462.47 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 3/s 130 KiB/s 111 KiB/s 2.48 ms 316.75 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 153 KiB/s 130 KiB/s 2.89 ms 359.74 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 71 KiB/s 78 KiB/s 3.30 ms 516.11 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 3/s 122 KiB/s 54 KiB/s 2.60 ms 288.50 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 4/s 158 KiB/s 138 KiB/s 2.95 ms 378.90 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 2/s 123 KiB/s 86 KiB/s 2.55 ms 447.68 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 185 KiB/s 106 KiB/s 3.10 ms 409.73 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 97 KiB/s 138 KiB/s 2.93 ms 430.50 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 2/s 145 KiB/s 62 KiB/s 2.84 ms 322.42 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 3/s 103 KiB/s 97 KiB/s 2.54 ms 426.02 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 3/s 142 KiB/s 90 KiB/s 2.74 ms 326.13 us 2024-03-25T09:34:00.257 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 3/s 133 KiB/s 134 KiB/s 2.91 ms 502.02 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 147 KiB/s 144 KiB/s 2.57 ms 434.10 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 2/s 114 KiB/s 70 KiB/s 2.69 ms 397.40 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 3/s 134 KiB/s 110 KiB/s 2.67 ms 314.14 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 3/s 127 KiB/s 78 KiB/s 2.76 ms 388.89 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 139 KiB/s 105 KiB/s 2.99 ms 423.86 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 3/s 96 KiB/s 100 KiB/s 3.02 ms 448.82 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 2/s 115 KiB/s 82 KiB/s 4.02 ms 344.98 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 130 KiB/s 110 KiB/s 2.87 ms 306.93 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 3/s 86 KiB/s 88 KiB/s 2.84 ms 330.97 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 4/s 92 KiB/s 128 KiB/s 3.19 ms 350.48 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 84 KiB/s 122 KiB/s 2.56 ms 383.26 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 3/s 113 KiB/s 114 KiB/s 2.70 ms 320.38 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 3/s 67 KiB/s 115 KiB/s 3.19 ms 561.78 us 2024-03-25T09:34:00.258 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 90 KiB/s 133 KiB/s 3.01 ms 365.09 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 119 KiB/s 128 KiB/s 2.78 ms 321.40 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 3/s 122 KiB/s 83 KiB/s 2.72 ms 308.29 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 3/s 107 KiB/s 99 KiB/s 2.92 ms 344.21 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 4/s 83 KiB/s 126 KiB/s 3.08 ms 349.31 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 3/s 122 KiB/s 109 KiB/s 2.77 ms 345.27 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 4/s 91 KiB/s 142 KiB/s 2.44 ms 571.39 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 5/s 69 KiB/s 138 KiB/s 3.02 ms 322.35 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 3/s 91 KiB/s 89 KiB/s 3.23 ms 331.73 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 91 KiB/s 129 KiB/s 2.76 ms 355.94 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 5/s 135 KiB/s 170 KiB/s 2.67 ms 360.11 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 3/s 96 KiB/s 91 KiB/s 3.09 ms 426.13 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 3/s 106 KiB/s 116 KiB/s 2.77 ms 341.70 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 3/s 96 KiB/s 102 KiB/s 2.75 ms 350.54 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 4/s 79 KiB/s 144 KiB/s 2.43 ms 312.25 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 4/s 82 KiB/s 123 KiB/s 2.92 ms 455.80 us 2024-03-25T09:34:00.259 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 5/s 69 KiB/s 130 KiB/s 3.01 ms 388.29 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 4/s 99 KiB/s 129 KiB/s 3.11 ms 317.48 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 94 KiB/s 122 KiB/s 2.46 ms 392.15 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 3/s 112 KiB/s 106 KiB/s 2.67 ms 433.65 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 3/s 125 KiB/s 110 KiB/s 2.67 ms 345.38 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 98 KiB/s 115 KiB/s 3.15 ms 358.44 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 94 KiB/s 138 KiB/s 3.28 ms 373.45 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 4/s 105 KiB/s 148 KiB/s 2.90 ms 382.04 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 84 KiB/s 89 KiB/s 2.76 ms 352.04 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 4/s 81 KiB/s 79 KiB/s 2.86 ms 360.20 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 4/s 81 KiB/s 131 KiB/s 3.23 ms 329.94 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 2/s 5/s 81 KiB/s 135 KiB/s 3.44 ms 395.41 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 2/s 4/s 87 KiB/s 80 KiB/s 2.69 ms 323.82 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 2/s 5/s 54 KiB/s 132 KiB/s 3.44 ms 408.35 us 2024-03-25T09:34:00.260 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:00.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:00.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:33:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:00.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:33:59 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:00.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:00 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 752 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:01.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:00 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 752 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:01.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:00 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 752 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:01.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:01.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:01.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-mon[29386]: pgmap v755: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.1 MiB/s wr, 441 op/s 2024-03-25T09:34:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:01.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:01 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:01.954 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-mon[33094]: pgmap v755: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.1 MiB/s wr, 441 op/s 2024-03-25T09:34:01.954 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:01.954 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:01.954 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:01.954 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:01.955 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:01.955 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:01.955 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:02.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:01 smithi059 ceph-mon[32732]: pgmap v755: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.1 MiB/s wr, 441 op/s 2024-03-25T09:34:02.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:01 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:02.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:01 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:02.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:01 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:02.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:01 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:02.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:01 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:02.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:01 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:02.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:01 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:02.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:02.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:02.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:01 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:02.821+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:03.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:03.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:03.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:03.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:03 smithi019 ceph-mon[29386]: pgmap v756: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.0 MiB/s wr, 499 op/s 2024-03-25T09:34:03.966 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:03 smithi040 ceph-mon[33094]: pgmap v756: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.0 MiB/s wr, 499 op/s 2024-03-25T09:34:04.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:03 smithi059 ceph-mon[32732]: pgmap v756: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.0 MiB/s wr, 499 op/s 2024-03-25T09:34:04.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:03 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 5/s 2/s 142 KiB/s 51 KiB/s 3.31 ms 474.73 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 2/s 166 KiB/s 74 KiB/s 2.92 ms 585.85 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 5/s 3/s 130 KiB/s 90 KiB/s 2.45 ms 360.88 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 5/s 3/s 163 KiB/s 76 KiB/s 2.90 ms 411.35 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 4/s 102 KiB/s 87 KiB/s 2.88 ms 306.47 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 2/s 146 KiB/s 68 KiB/s 2.92 ms 366.87 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 3/s 126 KiB/s 99 KiB/s 2.78 ms 319.49 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 2/s 126 KiB/s 82 KiB/s 2.83 ms 344.45 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 3/s 146 KiB/s 90 KiB/s 3.37 ms 338.38 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 3/s 105 KiB/s 86 KiB/s 2.56 ms 334.25 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 3/s 164 KiB/s 94 KiB/s 3.44 ms 422.43 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 124 KiB/s 62 KiB/s 2.64 ms 323.71 us 2024-03-25T09:34:05.261 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 3/s 111 KiB/s 112 KiB/s 2.63 ms 332.22 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 4/s 138 KiB/s 102 KiB/s 3.00 ms 332.97 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 4/s 95 KiB/s 106 KiB/s 2.67 ms 325.45 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 126 KiB/s 105 KiB/s 2.74 ms 308.21 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 4/s 115 KiB/s 135 KiB/s 2.95 ms 359.89 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 103 KiB/s 113 KiB/s 2.74 ms 335.15 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 80 KiB/s 133 KiB/s 3.11 ms 443.83 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 106 KiB/s 82 KiB/s 2.90 ms 332.67 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 2/s 109 KiB/s 130 KiB/s 2.71 ms 381.68 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 4/s 93 KiB/s 141 KiB/s 2.77 ms 436.33 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 3/s 91 KiB/s 67 KiB/s 3.37 ms 343.25 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 5/s 120 KiB/s 179 KiB/s 2.97 ms 344.52 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 3/s 114 KiB/s 98 KiB/s 3.12 ms 330.19 us 2024-03-25T09:34:05.262 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 3/s 89 KiB/s 118 KiB/s 2.74 ms 321.12 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 3/s 106 KiB/s 110 KiB/s 2.69 ms 359.69 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 3/s 104 KiB/s 120 KiB/s 2.66 ms 348.94 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 3/s 152 KiB/s 110 KiB/s 2.98 ms 436.10 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 4/s 88 KiB/s 97 KiB/s 2.91 ms 318.39 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 3/s 126 KiB/s 135 KiB/s 2.88 ms 416.97 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 3/s 148 KiB/s 90 KiB/s 3.12 ms 317.65 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 3/s 77 KiB/s 88 KiB/s 3.08 ms 302.51 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 3/s 94 KiB/s 98 KiB/s 3.25 ms 333.93 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 3/s 96 KiB/s 82 KiB/s 2.45 ms 280.39 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 78 KiB/s 106 KiB/s 3.92 ms 317.40 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 3/s 60 KiB/s 68 KiB/s 2.43 ms 422.99 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 4/s 71 KiB/s 138 KiB/s 3.12 ms 398.23 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 96 KiB/s 132 KiB/s 2.97 ms 386.49 us 2024-03-25T09:34:05.263 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 91 KiB/s 112 KiB/s 3.22 ms 318.96 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 3/s 103 KiB/s 107 KiB/s 2.77 ms 397.93 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 3/s 105 KiB/s 107 KiB/s 3.17 ms 393.96 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 4/s 127 KiB/s 128 KiB/s 3.15 ms 470.28 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 70 KiB/s 134 KiB/s 3.27 ms 320.52 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 101 KiB/s 128 KiB/s 3.53 ms 391.32 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 4/s 81 KiB/s 133 KiB/s 2.98 ms 363.79 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 74 KiB/s 101 KiB/s 2.87 ms 431.42 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 3/s 78 KiB/s 107 KiB/s 2.59 ms 496.78 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 4/s 81 KiB/s 110 KiB/s 3.03 ms 320.30 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 82 KiB/s 156 KiB/s 2.74 ms 321.28 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 77 KiB/s 106 KiB/s 3.65 ms 419.57 us 2024-03-25T09:34:05.264 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 82 KiB/s 118 KiB/s 2.91 ms 453.06 us 2024-03-25T09:34:05.265 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 4/s 52 KiB/s 122 KiB/s 2.77 ms 336.86 us 2024-03-25T09:34:05.265 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 2/s 4/s 89 KiB/s 147 KiB/s 3.13 ms 343.31 us 2024-03-25T09:34:05.265 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 2/s 3/s 62 KiB/s 94 KiB/s 2.77 ms 338.34 us 2024-03-25T09:34:05.265 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 2/s 4/s 67 KiB/s 148 KiB/s 2.87 ms 400.22 us 2024-03-25T09:34:05.265 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 2/s 5/s 76 KiB/s 141 KiB/s 2.57 ms 323.16 us 2024-03-25T09:34:05.265 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 2/s 4/s 62 KiB/s 118 KiB/s 2.67 ms 408.00 us 2024-03-25T09:34:05.265 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 2/s 3/s 50 KiB/s 94 KiB/s 2.76 ms 405.48 us 2024-03-25T09:34:05.265 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 2/s 4/s 66 KiB/s 146 KiB/s 3.01 ms 360.91 us 2024-03-25T09:34:05.265 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:05.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:05.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:05.409 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:05.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:05 smithi019 ceph-mon[29386]: pgmap v757: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 435 op/s 2024-03-25T09:34:05.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:05 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 757 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:05.978 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:05 smithi040 ceph-mon[33094]: pgmap v757: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 435 op/s 2024-03-25T09:34:05.978 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:05 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 757 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:06.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:05 smithi059 ceph-mon[32732]: pgmap v757: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 435 op/s 2024-03-25T09:34:06.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:05 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 757 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:06.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:06.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:06.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:05 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:06 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:06 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:06 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:06 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:06 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:06 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:06.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:06 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:07.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:06 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:07.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:06 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:07.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:06 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:07.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:06 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:07.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:06 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:07.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:06 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:07.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:06 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:07.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:06 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:07.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:06 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:07.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:06 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:07.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:06 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:07.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:06 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:07.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:06 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:07.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:06 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:07.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:07.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:07.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:07.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:07 smithi019 ceph-mon[29386]: pgmap v758: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.5 MiB/s wr, 482 op/s 2024-03-25T09:34:07.990 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:07 smithi040 ceph-mon[33094]: pgmap v758: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.5 MiB/s wr, 482 op/s 2024-03-25T09:34:08.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:07 smithi059 ceph-mon[32732]: pgmap v758: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.5 MiB/s wr, 482 op/s 2024-03-25T09:34:08.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:07 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:07.822+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:08.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:07 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:09.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:09.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:09.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:09.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:34:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 86.4k 87.6k 0.0k 864.0k 876.0k 0.0k nvme2n1 2024-03-25T09:34:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 92.4k 115.6k 0.0k 924.0k 1.1M 0.0k nvme2n10 2024-03-25T09:34:09.681 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 110.8k 112.4k 0.0k 1.1M 1.1M 0.0k nvme2n11 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 95.2k 118.0k 0.0k 952.0k 1.2M 0.0k nvme2n12 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 88.8k 108.4k 0.0k 888.0k 1.1M 0.0k nvme2n13 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 94.4k 92.0k 0.0k 944.0k 920.0k 0.0k nvme2n14 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 74.0k 105.6k 0.0k 740.0k 1.0M 0.0k nvme2n15 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 106.0k 120.0k 0.0k 1.0M 1.2M 0.0k nvme2n16 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 94.8k 84.4k 0.0k 948.0k 844.0k 0.0k nvme2n17 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 83.6k 107.2k 0.0k 836.0k 1.0M 0.0k nvme2n18 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 103.2k 97.2k 0.0k 1.0M 972.0k 0.0k nvme2n19 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 104.8k 77.2k 0.0k 1.0M 772.0k 0.0k nvme2n2 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 78.0k 84.4k 0.0k 780.0k 844.0k 0.0k nvme2n20 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 92.4k 98.4k 0.0k 924.0k 984.0k 0.0k nvme2n3 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 86.8k 110.8k 0.0k 868.0k 1.1M 0.0k nvme2n4 2024-03-25T09:34:09.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 106.8k 90.4k 0.0k 1.0M 904.0k 0.0k nvme2n5 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 68.8k 96.4k 0.0k 688.0k 964.0k 0.0k nvme2n6 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 78.8k 74.8k 0.0k 788.0k 748.0k 0.0k nvme2n7 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 117.6k 89.2k 0.0k 1.1M 892.0k 0.0k nvme2n8 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 89.2k 116.0k 0.0k 892.0k 1.1M 0.0k nvme2n9 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 96.4k 73.2k 0.0k 964.0k 732.0k 0.0k nvme5n1 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 126.8k 99.6k 0.0k 1.2M 996.0k 0.0k nvme5n10 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 111.6k 96.8k 0.0k 1.1M 968.0k 0.0k nvme5n11 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 99.2k 120.0k 0.0k 992.0k 1.2M 0.0k nvme5n12 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 92.4k 108.0k 0.0k 924.0k 1.1M 0.0k nvme5n13 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 95.6k 103.6k 0.0k 956.0k 1.0M 0.0k nvme5n14 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 90.0k 138.4k 0.0k 900.0k 1.4M 0.0k nvme5n15 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 127.2k 78.4k 0.0k 1.2M 784.0k 0.0k nvme5n16 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 135.2k 68.8k 0.0k 1.3M 688.0k 0.0k nvme5n17 2024-03-25T09:34:09.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 105.6k 77.6k 0.0k 1.0M 776.0k 0.0k nvme5n18 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 96.8k 115.6k 0.0k 968.0k 1.1M 0.0k nvme5n19 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 85.2k 112.4k 0.0k 852.0k 1.1M 0.0k nvme5n2 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 79.2k 93.6k 0.0k 792.0k 936.0k 0.0k nvme5n20 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 112.8k 94.0k 0.0k 1.1M 940.0k 0.0k nvme5n3 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 108.8k 107.6k 0.0k 1.1M 1.1M 0.0k nvme5n4 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 126.0k 98.8k 0.0k 1.2M 988.0k 0.0k nvme5n5 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 82.4k 107.6k 0.0k 824.0k 1.1M 0.0k nvme5n6 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 99.6k 96.4k 0.0k 996.0k 964.0k 0.0k nvme5n7 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 95.2k 105.2k 0.0k 952.0k 1.0M 0.0k nvme5n8 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 97.6k 90.8k 0.0k 976.0k 908.0k 0.0k nvme5n9 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 129.2k 104.4k 0.0k 1.3M 1.0M 0.0k nvme8n1 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 103.2k 97.2k 0.0k 1.0M 972.0k 0.0k nvme8n10 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 116.8k 96.4k 0.0k 1.1M 964.0k 0.0k nvme8n11 2024-03-25T09:34:09.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 90.0k 78.8k 0.0k 900.0k 788.0k 0.0k nvme8n12 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 112.0k 101.6k 0.0k 1.1M 1016.0k 0.0k nvme8n13 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 108.0k 54.4k 0.0k 1.1M 544.0k 0.0k nvme8n14 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 111.6k 103.2k 0.0k 1.1M 1.0M 0.0k nvme8n15 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 90.8k 106.8k 0.0k 908.0k 1.0M 0.0k nvme8n16 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 63.6k 112.0k 0.0k 636.0k 1.1M 0.0k nvme8n17 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 90.4k 86.0k 0.0k 904.0k 860.0k 0.0k nvme8n18 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 112.4k 114.8k 0.0k 1.1M 1.1M 0.0k nvme8n19 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 97.2k 96.0k 0.0k 972.0k 960.0k 0.0k nvme8n2 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 86.0k 107.6k 0.0k 860.0k 1.1M 0.0k nvme8n20 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 90.4k 125.6k 0.0k 904.0k 1.2M 0.0k nvme8n3 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 96.0k 84.4k 0.0k 960.0k 844.0k 0.0k nvme8n4 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 96.0k 112.4k 0.0k 960.0k 1.1M 0.0k nvme8n5 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 121.6k 78.0k 0.0k 1.2M 780.0k 0.0k nvme8n6 2024-03-25T09:34:09.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 114.0k 117.2k 0.0k 1.1M 1.1M 0.0k nvme8n7 2024-03-25T09:34:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 109.6k 83.2k 0.0k 1.1M 832.0k 0.0k nvme8n8 2024-03-25T09:34:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 130.0k 134.8k 0.0k 1.3M 1.3M 0.0k nvme8n9 2024-03-25T09:34:09.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:09.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:09 smithi019 ceph-mon[29386]: pgmap v759: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 446 op/s 2024-03-25T09:34:10.002 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:09 smithi040 ceph-mon[33094]: pgmap v759: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 446 op/s 2024-03-25T09:34:10.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:09 smithi059 ceph-mon[32732]: pgmap v759: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 446 op/s 2024-03-25T09:34:10.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:10.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:10.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 6/s 2/s 171 KiB/s 74 KiB/s 3.09 ms 331.00 us 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 1/s 129 KiB/s 69 KiB/s 2.58 ms 344.12 us 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 5/s 2/s 151 KiB/s 63 KiB/s 2.93 ms 277.30 us 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 5/s 2/s 127 KiB/s 87 KiB/s 2.52 ms 350.78 us 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 2/s 129 KiB/s 110 KiB/s 3.05 ms 390.28 us 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 2/s 142 KiB/s 78 KiB/s 2.68 ms 314.88 us 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 2/s 131 KiB/s 69 KiB/s 2.95 ms 330.03 us 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 168 KiB/s 128 KiB/s 2.99 ms 338.66 us 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 3/s 106 KiB/s 58 KiB/s 3.60 ms 376.20 us 2024-03-25T09:34:10.266 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 150 KiB/s 74 KiB/s 3.15 ms 270.86 us 2024-03-25T09:34:10.267 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 4/s 101 KiB/s 110 KiB/s 2.62 ms 340.43 us 2024-03-25T09:34:10.267 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 3/s 88 KiB/s 102 KiB/s 2.89 ms 407.77 us 2024-03-25T09:34:10.267 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 107 KiB/s 104 KiB/s 2.95 ms 333.76 us 2024-03-25T09:34:10.267 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 4/s 2/s 97 KiB/s 61 KiB/s 3.25 ms 328.75 us 2024-03-25T09:34:10.267 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 74 KiB/s 100 KiB/s 2.71 ms 366.87 us 2024-03-25T09:34:10.267 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 80 KiB/s 79 KiB/s 2.53 ms 380.49 us 2024-03-25T09:34:10.267 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 4/s 99 KiB/s 95 KiB/s 2.70 ms 416.16 us 2024-03-25T09:34:10.267 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 3/s 70 KiB/s 85 KiB/s 2.40 ms 337.15 us 2024-03-25T09:34:10.268 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 3/s 113 KiB/s 89 KiB/s 3.07 ms 299.21 us 2024-03-25T09:34:10.268 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 3/s 101 KiB/s 88 KiB/s 3.65 ms 314.61 us 2024-03-25T09:34:10.268 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 3/s 128 KiB/s 107 KiB/s 2.96 ms 357.61 us 2024-03-25T09:34:10.268 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 3/s 88 KiB/s 62 KiB/s 3.22 ms 518.85 us 2024-03-25T09:34:10.268 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 3/s 80 KiB/s 72 KiB/s 2.59 ms 458.50 us 2024-03-25T09:34:10.268 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 4/s 140 KiB/s 115 KiB/s 3.42 ms 320.44 us 2024-03-25T09:34:10.268 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 3/s 126 KiB/s 97 KiB/s 3.22 ms 326.56 us 2024-03-25T09:34:10.268 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 3/s 122 KiB/s 84 KiB/s 3.28 ms 345.47 us 2024-03-25T09:34:10.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 3/s 82 KiB/s 69 KiB/s 2.98 ms 295.83 us 2024-03-25T09:34:10.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 4/s 95 KiB/s 102 KiB/s 2.87 ms 316.77 us 2024-03-25T09:34:10.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 97 KiB/s 90 KiB/s 3.24 ms 332.79 us 2024-03-25T09:34:10.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 78 KiB/s 140 KiB/s 3.00 ms 398.90 us 2024-03-25T09:34:10.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 2/s 88 KiB/s 78 KiB/s 2.81 ms 382.21 us 2024-03-25T09:34:10.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 3/s 114 KiB/s 108 KiB/s 2.71 ms 347.68 us 2024-03-25T09:34:10.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 4/s 86 KiB/s 143 KiB/s 3.14 ms 392.41 us 2024-03-25T09:34:10.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 2/s 56 KiB/s 48 KiB/s 3.06 ms 285.01 us 2024-03-25T09:34:10.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 3/s 98 KiB/s 104 KiB/s 3.21 ms 392.16 us 2024-03-25T09:34:10.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 4/s 70 KiB/s 99 KiB/s 2.98 ms 342.50 us 2024-03-25T09:34:10.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 100 KiB/s 84 KiB/s 2.88 ms 279.33 us 2024-03-25T09:34:10.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 5/s 107 KiB/s 118 KiB/s 2.63 ms 275.27 us 2024-03-25T09:34:10.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 3/s 113 KiB/s 95 KiB/s 2.96 ms 336.40 us 2024-03-25T09:34:10.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 94 KiB/s 126 KiB/s 3.31 ms 394.38 us 2024-03-25T09:34:10.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 3/s 90 KiB/s 101 KiB/s 2.77 ms 301.87 us 2024-03-25T09:34:10.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 5/s 84 KiB/s 129 KiB/s 2.78 ms 328.91 us 2024-03-25T09:34:10.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 3/s 119 KiB/s 100 KiB/s 2.80 ms 347.47 us 2024-03-25T09:34:10.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 122 KiB/s 86 KiB/s 2.73 ms 335.04 us 2024-03-25T09:34:10.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 3/s 102 KiB/s 96 KiB/s 2.77 ms 306.25 us 2024-03-25T09:34:10.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 3/s 105 KiB/s 75 KiB/s 2.73 ms 320.39 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 93 KiB/s 150 KiB/s 2.92 ms 392.37 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 3/s 80 KiB/s 76 KiB/s 3.57 ms 338.82 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 3/s 78 KiB/s 102 KiB/s 2.64 ms 425.12 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 3/s 90 KiB/s 87 KiB/s 2.95 ms 291.82 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 3/s 108 KiB/s 128 KiB/s 3.14 ms 455.85 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 4/s 103 KiB/s 121 KiB/s 3.01 ms 339.07 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 5/s 82 KiB/s 129 KiB/s 3.20 ms 413.11 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 2/s 4/s 86 KiB/s 84 KiB/s 2.98 ms 266.85 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 2/s 3/s 64 KiB/s 96 KiB/s 2.80 ms 307.82 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 2/s 4/s 70 KiB/s 105 KiB/s 2.83 ms 425.54 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 2/s 4/s 83 KiB/s 120 KiB/s 3.02 ms 333.24 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 2/s 5/s 43 KiB/s 85 KiB/s 3.02 ms 365.60 us 2024-03-25T09:34:10.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 2/s 4/s 38 KiB/s 114 KiB/s 2.65 ms 309.34 us 2024-03-25T09:34:10.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 1/s 4/s 46 KiB/s 116 KiB/s 2.78 ms 486.84 us 2024-03-25T09:34:10.275 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:10.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:10 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 762 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:11.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:10 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 762 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:11.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:10 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 762 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:11.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:11.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:11.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:11.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-mon[29386]: pgmap v760: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 441 op/s 2024-03-25T09:34:11.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:11.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:11.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:11.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:11.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:11.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:11.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:11 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:12.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:11 smithi059 ceph-mon[32732]: pgmap v760: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 441 op/s 2024-03-25T09:34:12.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:11 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:12.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:11 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:12.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:11 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:12.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:11 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:12.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:11 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:12.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:11 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:12.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:11 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:12.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:11 smithi040 ceph-mon[33094]: pgmap v760: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 441 op/s 2024-03-25T09:34:12.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:11 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:12.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:11 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:12.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:11 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:12.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:11 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:12.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:11 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:12.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:11 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:12.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:11 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:12.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:12.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:12.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:13.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:12 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:12.822+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:13.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:13.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:13.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:13.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:13 smithi019 ceph-mon[29386]: pgmap v761: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 499 op/s 2024-03-25T09:34:14.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:13 smithi059 ceph-mon[32732]: pgmap v761: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 499 op/s 2024-03-25T09:34:14.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:13 smithi040 ceph-mon[33094]: pgmap v761: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 499 op/s 2024-03-25T09:34:14.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:14.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:14.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:15.269 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:15.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 3/s 154 KiB/s 70 KiB/s 2.79 ms 333.44 us 2024-03-25T09:34:15.269 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 5/s 3/s 170 KiB/s 78 KiB/s 2.81 ms 312.15 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 3/s 138 KiB/s 92 KiB/s 3.12 ms 343.41 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 3/s 161 KiB/s 66 KiB/s 2.94 ms 338.13 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 3/s 102 KiB/s 72 KiB/s 3.12 ms 344.50 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 2/s 126 KiB/s 72 KiB/s 2.68 ms 315.01 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 3/s 118 KiB/s 111 KiB/s 2.80 ms 414.33 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 4/s 106 KiB/s 118 KiB/s 2.60 ms 315.54 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 124 KiB/s 90 KiB/s 3.05 ms 396.82 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 2/s 113 KiB/s 53 KiB/s 2.87 ms 300.30 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 2/s 84 KiB/s 49 KiB/s 2.62 ms 331.76 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 4/s 3/s 143 KiB/s 99 KiB/s 2.43 ms 539.58 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 3/s 115 KiB/s 76 KiB/s 3.35 ms 396.54 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 3/s 118 KiB/s 92 KiB/s 2.79 ms 345.02 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 3/s 126 KiB/s 94 KiB/s 2.77 ms 426.15 us 2024-03-25T09:34:15.270 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 4/s 140 KiB/s 98 KiB/s 3.73 ms 494.89 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 2/s 118 KiB/s 49 KiB/s 2.77 ms 334.24 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 4/s 3/s 101 KiB/s 86 KiB/s 3.01 ms 463.32 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 112 KiB/s 96 KiB/s 2.90 ms 359.87 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 4/s 118 KiB/s 141 KiB/s 2.64 ms 369.36 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 3/s 97 KiB/s 63 KiB/s 2.78 ms 321.92 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 4/s 3/s 81 KiB/s 115 KiB/s 2.81 ms 325.16 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 98 KiB/s 110 KiB/s 2.81 ms 318.85 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 85 KiB/s 123 KiB/s 2.69 ms 327.98 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 84 KiB/s 104 KiB/s 2.92 ms 341.88 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 3/s 4/s 110 KiB/s 96 KiB/s 2.96 ms 303.55 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 4/s 100 KiB/s 158 KiB/s 2.88 ms 388.89 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 3/s 114 KiB/s 81 KiB/s 2.78 ms 314.22 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 4/s 91 KiB/s 92 KiB/s 3.29 ms 343.00 us 2024-03-25T09:34:15.271 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 3/s 115 KiB/s 110 KiB/s 3.58 ms 453.52 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 4/s 95 KiB/s 95 KiB/s 2.81 ms 338.55 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 4/s 100 KiB/s 154 KiB/s 3.03 ms 343.25 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 3/s 82 KiB/s 77 KiB/s 2.83 ms 293.39 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 79 KiB/s 109 KiB/s 3.39 ms 394.16 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 3/s 107 KiB/s 62 KiB/s 2.85 ms 341.18 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 4/s 97 KiB/s 136 KiB/s 3.32 ms 374.57 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 4/s 120 KiB/s 110 KiB/s 2.92 ms 358.66 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 3/s 85 KiB/s 101 KiB/s 2.91 ms 346.26 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 3/s 83 KiB/s 119 KiB/s 2.94 ms 430.05 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 88 KiB/s 150 KiB/s 2.89 ms 362.23 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 4/s 77 KiB/s 94 KiB/s 2.66 ms 412.24 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 88 KiB/s 95 KiB/s 3.22 ms 352.89 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 4/s 78 KiB/s 106 KiB/s 2.77 ms 317.86 us 2024-03-25T09:34:15.272 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 4/s 88 KiB/s 116 KiB/s 3.23 ms 333.44 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 114 KiB/s 98 KiB/s 2.70 ms 313.75 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 3/s 93 KiB/s 86 KiB/s 2.76 ms 401.46 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 4/s 91 KiB/s 84 KiB/s 3.66 ms 326.85 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 4/s 62 KiB/s 108 KiB/s 2.52 ms 322.06 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 4/s 96 KiB/s 118 KiB/s 2.97 ms 347.27 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 4/s 58 KiB/s 118 KiB/s 2.49 ms 417.26 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 85 KiB/s 139 KiB/s 3.90 ms 467.43 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 4/s 65 KiB/s 129 KiB/s 3.13 ms 337.32 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 83 KiB/s 108 KiB/s 3.72 ms 383.20 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 67 KiB/s 125 KiB/s 2.69 ms 306.18 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 2/s 4/s 50 KiB/s 92 KiB/s 2.75 ms 327.75 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 2/s 4/s 49 KiB/s 102 KiB/s 2.70 ms 307.11 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 2/s 5/s 40 KiB/s 149 KiB/s 2.33 ms 339.86 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 2/s 4/s 81 KiB/s 149 KiB/s 3.06 ms 341.06 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 2/s 3/s 27 KiB/s 94 KiB/s 2.70 ms 399.02 us 2024-03-25T09:34:15.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 2/s 5/s 45 KiB/s 150 KiB/s 3.14 ms 335.91 us 2024-03-25T09:34:15.274 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:15.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:15.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:15.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:15 smithi019 ceph-mon[29386]: pgmap v762: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 439 op/s 2024-03-25T09:34:15.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:15 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 767 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:16.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:15 smithi059 ceph-mon[32732]: pgmap v762: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 439 op/s 2024-03-25T09:34:16.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:15 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 767 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:16.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:15 smithi040 ceph-mon[33094]: pgmap v762: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 439 op/s 2024-03-25T09:34:16.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:15 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 767 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:16.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:16.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:16.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:16 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:16 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:16 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:16 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:16.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:16 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:16.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:16 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:16.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:16 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:17.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:16 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:17.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:16 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:17.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:16 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:17.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:16 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:17.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:16 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:17.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:16 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:17.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:16 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:17.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:16 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:17.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:16 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:17.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:16 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:17.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:16 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:17.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:16 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:17.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:16 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:17.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:16 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:17.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:17.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:17.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:17.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:17 smithi019 ceph-mon[29386]: pgmap v763: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.0 MiB/s wr, 484 op/s 2024-03-25T09:34:18.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:17 smithi059 ceph-mon[32732]: pgmap v763: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.0 MiB/s wr, 484 op/s 2024-03-25T09:34:18.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:17 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:17.823+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:18.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:17 smithi040 ceph-mon[33094]: pgmap v763: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.0 MiB/s wr, 484 op/s 2024-03-25T09:34:18.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:18.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:18.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:19.609 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:19.609 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:19.610 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:19.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:34:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 88.4k 80.0k 0.0k 884.0k 800.0k 0.0k nvme2n1 2024-03-25T09:34:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 83.6k 98.8k 0.0k 836.0k 988.0k 0.0k nvme2n10 2024-03-25T09:34:19.688 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 124.0k 110.8k 0.0k 1.2M 1.1M 0.0k nvme2n11 2024-03-25T09:34:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 107.6k 112.0k 0.0k 1.1M 1.1M 0.0k nvme2n12 2024-03-25T09:34:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 107.2k 78.4k 0.0k 1.0M 784.0k 0.0k nvme2n13 2024-03-25T09:34:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 92.4k 88.4k 0.0k 924.0k 884.0k 0.0k nvme2n14 2024-03-25T09:34:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 96.0k 92.8k 0.0k 960.0k 928.0k 0.0k nvme2n15 2024-03-25T09:34:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 94.4k 90.0k 0.0k 944.0k 900.0k 0.0k nvme2n16 2024-03-25T09:34:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 112.8k 75.2k 0.0k 1.1M 752.0k 0.0k nvme2n17 2024-03-25T09:34:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 92.8k 86.0k 0.0k 928.0k 860.0k 0.0k nvme2n18 2024-03-25T09:34:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 98.4k 104.0k 0.0k 984.0k 1.0M 0.0k nvme2n19 2024-03-25T09:34:19.689 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 116.4k 77.6k 0.0k 1.1M 776.0k 0.0k nvme2n2 2024-03-25T09:34:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 98.4k 70.0k 0.0k 984.0k 700.0k 0.0k nvme2n20 2024-03-25T09:34:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 95.6k 80.0k 0.0k 956.0k 800.0k 0.0k nvme2n3 2024-03-25T09:34:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 122.8k 86.0k 0.0k 1.2M 860.0k 0.0k nvme2n4 2024-03-25T09:34:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 132.0k 91.2k 0.0k 1.3M 912.0k 0.0k nvme2n5 2024-03-25T09:34:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 82.8k 95.6k 0.0k 828.0k 956.0k 0.0k nvme2n6 2024-03-25T09:34:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 86.4k 94.0k 0.0k 864.0k 940.0k 0.0k nvme2n7 2024-03-25T09:34:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 96.4k 96.0k 0.0k 964.0k 960.0k 0.0k nvme2n8 2024-03-25T09:34:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 83.6k 84.4k 0.0k 836.0k 844.0k 0.0k nvme2n9 2024-03-25T09:34:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 49.2k 109.2k 0.0k 492.0k 1.1M 0.0k nvme5n1 2024-03-25T09:34:19.690 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 68.8k 138.8k 0.0k 688.0k 1.4M 0.0k nvme5n10 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 94.0k 105.6k 0.0k 940.0k 1.0M 0.0k nvme5n11 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 82.0k 104.4k 0.0k 820.0k 1.0M 0.0k nvme5n12 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 88.8k 82.8k 0.0k 888.0k 828.0k 0.0k nvme5n13 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 86.4k 80.4k 0.0k 864.0k 804.0k 0.0k nvme5n14 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 100.0k 119.2k 0.0k 1000.0k 1.2M 0.0k nvme5n15 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 100.0k 97.2k 0.0k 1000.0k 972.0k 0.0k nvme5n16 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 116.0k 74.0k 0.0k 1.1M 740.0k 0.0k nvme5n17 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 98.8k 106.0k 0.0k 988.0k 1.0M 0.0k nvme5n18 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 99.2k 78.8k 0.0k 992.0k 788.0k 0.0k nvme5n19 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 86.8k 91.6k 0.0k 868.0k 916.0k 0.0k nvme5n2 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 97.2k 93.6k 0.0k 972.0k 936.0k 0.0k nvme5n20 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 78.4k 88.0k 0.0k 784.0k 880.0k 0.0k nvme5n3 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 115.6k 77.6k 0.0k 1.1M 776.0k 0.0k nvme5n4 2024-03-25T09:34:19.691 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 79.6k 112.4k 0.0k 796.0k 1.1M 0.0k nvme5n5 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 110.4k 111.2k 0.0k 1.1M 1.1M 0.0k nvme5n6 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 96.4k 109.2k 0.0k 964.0k 1.1M 0.0k nvme5n7 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 81.6k 118.4k 0.0k 816.0k 1.2M 0.0k nvme5n8 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 107.6k 102.8k 0.0k 1.1M 1.0M 0.0k nvme5n9 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 87.2k 95.6k 0.0k 872.0k 956.0k 0.0k nvme8n1 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 86.8k 71.2k 0.0k 868.0k 712.0k 0.0k nvme8n10 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 100.4k 81.2k 0.0k 1004.0k 812.0k 0.0k nvme8n11 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 99.2k 72.4k 0.0k 992.0k 724.0k 0.0k nvme8n12 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 126.8k 86.4k 0.0k 1.2M 864.0k 0.0k nvme8n13 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 100.0k 65.6k 0.0k 1000.0k 656.0k 0.0k nvme8n14 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 102.4k 106.4k 0.0k 1.0M 1.0M 0.0k nvme8n15 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 96.8k 102.0k 0.0k 968.0k 1020.0k 0.0k nvme8n16 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 63.2k 134.8k 0.0k 632.0k 1.3M 0.0k nvme8n17 2024-03-25T09:34:19.692 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 86.8k 101.2k 0.0k 868.0k 1012.0k 0.0k nvme8n18 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 101.2k 86.8k 0.0k 1012.0k 868.0k 0.0k nvme8n19 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 108.8k 71.2k 0.0k 1.1M 712.0k 0.0k nvme8n2 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 118.8k 82.0k 0.0k 1.2M 820.0k 0.0k nvme8n20 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 101.6k 82.4k 0.0k 1016.0k 824.0k 0.0k nvme8n3 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 90.0k 96.0k 0.0k 900.0k 960.0k 0.0k nvme8n4 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 147.2k 83.6k 0.0k 1.4M 836.0k 0.0k nvme8n5 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 95.2k 63.2k 0.0k 952.0k 632.0k 0.0k nvme8n6 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 124.4k 74.0k 0.0k 1.2M 740.0k 0.0k nvme8n7 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 108.4k 100.0k 0.0k 1.1M 1000.0k 0.0k nvme8n8 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 7.60 132.4k 112.0k 0.0k 1.3M 1.1M 0.0k nvme8n9 2024-03-25T09:34:19.693 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:19.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:19 smithi019 ceph-mon[29386]: pgmap v764: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 452 op/s 2024-03-25T09:34:20.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:19 smithi059 ceph-mon[32732]: pgmap v764: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 452 op/s 2024-03-25T09:34:20.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:19 smithi040 ceph-mon[33094]: pgmap v764: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 452 op/s 2024-03-25T09:34:20.273 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:20.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 2/s 124 KiB/s 55 KiB/s 3.17 ms 294.55 us 2024-03-25T09:34:20.273 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 5/s 3/s 145 KiB/s 90 KiB/s 3.40 ms 322.43 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 5/s 2/s 134 KiB/s 69 KiB/s 2.84 ms 256.24 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 5/s 3/s 154 KiB/s 104 KiB/s 3.54 ms 333.12 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 3/s 90 KiB/s 89 KiB/s 2.46 ms 321.92 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 2/s 110 KiB/s 50 KiB/s 3.34 ms 369.93 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 2/s 156 KiB/s 83 KiB/s 2.97 ms 363.58 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 3/s 109 KiB/s 100 KiB/s 3.89 ms 367.33 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 3/s 106 KiB/s 89 KiB/s 3.57 ms 317.38 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 2/s 109 KiB/s 49 KiB/s 2.95 ms 375.38 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 2/s 128 KiB/s 53 KiB/s 2.97 ms 479.17 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 101 KiB/s 81 KiB/s 2.67 ms 403.38 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 121 KiB/s 104 KiB/s 3.03 ms 389.66 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 4/s 2/s 106 KiB/s 76 KiB/s 3.03 ms 325.50 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 3/s 120 KiB/s 85 KiB/s 3.16 ms 391.63 us 2024-03-25T09:34:20.274 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 135 KiB/s 78 KiB/s 2.90 ms 284.17 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 2/s 96 KiB/s 79 KiB/s 2.50 ms 446.95 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 4/s 78 KiB/s 95 KiB/s 3.14 ms 412.08 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 3/s 110 KiB/s 102 KiB/s 3.93 ms 335.00 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 98 KiB/s 110 KiB/s 2.86 ms 504.44 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 4/s 86 KiB/s 78 KiB/s 2.72 ms 321.40 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 3/s 100 KiB/s 84 KiB/s 3.21 ms 302.39 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 126 KiB/s 83 KiB/s 2.76 ms 502.64 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 3/s 81 KiB/s 82 KiB/s 3.10 ms 320.17 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 3/s 110 KiB/s 94 KiB/s 3.08 ms 442.70 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 4/s 87 KiB/s 110 KiB/s 3.00 ms 379.56 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 4/s 106 KiB/s 125 KiB/s 2.75 ms 389.09 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 3/s 87 KiB/s 115 KiB/s 2.98 ms 472.03 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 4/s 77 KiB/s 75 KiB/s 3.19 ms 339.05 us 2024-03-25T09:34:20.275 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 2/s 116 KiB/s 53 KiB/s 2.65 ms 275.42 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 3/s 70 KiB/s 50 KiB/s 2.78 ms 298.29 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 4/s 90 KiB/s 111 KiB/s 2.69 ms 344.81 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 100 KiB/s 110 KiB/s 3.32 ms 411.45 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 85 KiB/s 114 KiB/s 3.20 ms 334.67 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 92 KiB/s 123 KiB/s 2.81 ms 341.51 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 100 KiB/s 126 KiB/s 2.73 ms 336.85 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 3/s 106 KiB/s 74 KiB/s 2.58 ms 317.42 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 5/s 80 KiB/s 114 KiB/s 2.75 ms 395.34 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 4/s 91 KiB/s 120 KiB/s 2.59 ms 364.86 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 4/s 130 KiB/s 170 KiB/s 2.98 ms 469.65 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 88 KiB/s 134 KiB/s 2.76 ms 330.51 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 3/s 93 KiB/s 112 KiB/s 3.18 ms 351.72 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 92 KiB/s 100 KiB/s 2.40 ms 301.60 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 84 KiB/s 92 KiB/s 2.78 ms 342.95 us 2024-03-25T09:34:20.276 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 76 KiB/s 108 KiB/s 3.16 ms 361.82 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 5/s 60 KiB/s 113 KiB/s 3.19 ms 349.73 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 4/s 78 KiB/s 102 KiB/s 3.21 ms 539.99 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 4/s 111 KiB/s 147 KiB/s 3.39 ms 383.26 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 77 KiB/s 91 KiB/s 2.74 ms 325.22 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 62 KiB/s 98 KiB/s 3.21 ms 350.05 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 5/s 89 KiB/s 103 KiB/s 2.99 ms 448.50 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 3/s 82 KiB/s 62 KiB/s 2.76 ms 340.67 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 4/s 82 KiB/s 120 KiB/s 2.96 ms 335.57 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 4/s 78 KiB/s 92 KiB/s 3.21 ms 337.45 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 4/s 57 KiB/s 102 KiB/s 2.95 ms 374.96 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 2/s 4/s 70 KiB/s 97 KiB/s 3.10 ms 346.19 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 2/s 4/s 75 KiB/s 111 KiB/s 3.06 ms 330.50 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 2/s 4/s 46 KiB/s 98 KiB/s 2.68 ms 344.97 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 2/s 5/s 55 KiB/s 93 KiB/s 2.80 ms 284.61 us 2024-03-25T09:34:20.277 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 2/s 4/s 49 KiB/s 111 KiB/s 2.80 ms 316.94 us 2024-03-25T09:34:20.278 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:20.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:20.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:20.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:20.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:20 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 772 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:21.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:20 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 772 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:21.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:20 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 772 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:21.616 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:21.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:21.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-mon[29386]: pgmap v765: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 445 op/s 2024-03-25T09:34:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:21.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:21 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:21.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:21 smithi059 ceph-mon[32732]: pgmap v765: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 445 op/s 2024-03-25T09:34:21.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:21 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:21.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:21 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:21.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:21 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:21.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:21 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:21.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:21 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:21.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:21 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:21.911 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:21 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:21 smithi040 ceph-mon[33094]: pgmap v765: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 445 op/s 2024-03-25T09:34:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:21 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:21 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:21 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:21 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:21 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:21 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:22.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:21 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:22.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:22.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:22.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:23.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:22 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:22.823+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:23.618 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:23.618 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:23.618 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:23.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:23 smithi019 ceph-mon[29386]: pgmap v766: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 5.9 MiB/s wr, 497 op/s 2024-03-25T09:34:24.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:23 smithi059 ceph-mon[32732]: pgmap v766: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 5.9 MiB/s wr, 497 op/s 2024-03-25T09:34:24.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:23 smithi040 ceph-mon[33094]: pgmap v766: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 5.9 MiB/s wr, 497 op/s 2024-03-25T09:34:24.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:24.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:24.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:25.278 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:25.278 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 5/s 2/s 137 KiB/s 52 KiB/s 3.39 ms 311.61 us 2024-03-25T09:34:25.278 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 5/s 3/s 162 KiB/s 86 KiB/s 3.04 ms 335.33 us 2024-03-25T09:34:25.278 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 5/s 2/s 87 KiB/s 53 KiB/s 2.52 ms 268.95 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 5/s 3/s 143 KiB/s 93 KiB/s 2.85 ms 326.47 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 5/s 3/s 128 KiB/s 62 KiB/s 2.98 ms 291.62 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 2/s 131 KiB/s 66 KiB/s 3.17 ms 428.63 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 2/s 118 KiB/s 46 KiB/s 3.13 ms 289.80 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 3/s 107 KiB/s 75 KiB/s 3.72 ms 352.36 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 105 KiB/s 70 KiB/s 2.65 ms 371.52 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 4/s 75 KiB/s 100 KiB/s 3.10 ms 365.86 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 4/s 3/s 96 KiB/s 65 KiB/s 2.85 ms 411.32 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 122 KiB/s 94 KiB/s 2.82 ms 312.32 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 108 KiB/s 69 KiB/s 3.01 ms 434.81 us 2024-03-25T09:34:25.279 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 3/s 99 KiB/s 75 KiB/s 3.48 ms 319.80 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 3/s 110 KiB/s 106 KiB/s 3.06 ms 444.32 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 3/s 87 KiB/s 81 KiB/s 3.04 ms 357.94 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 4/s 108 KiB/s 143 KiB/s 2.95 ms 364.28 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 4/s 105 KiB/s 108 KiB/s 2.92 ms 310.32 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 112 KiB/s 71 KiB/s 2.95 ms 300.07 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 3/s 3/s 80 KiB/s 111 KiB/s 2.95 ms 384.67 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 3/s 99 KiB/s 102 KiB/s 3.15 ms 369.59 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 4/s 104 KiB/s 91 KiB/s 3.08 ms 390.70 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 3/s 58 KiB/s 80 KiB/s 3.36 ms 461.20 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 4/s 75 KiB/s 107 KiB/s 2.61 ms 399.01 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 88 KiB/s 82 KiB/s 2.76 ms 339.59 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 91 KiB/s 89 KiB/s 3.03 ms 374.32 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 116 KiB/s 128 KiB/s 3.19 ms 362.52 us 2024-03-25T09:34:25.280 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 3/s 97 KiB/s 87 KiB/s 2.51 ms 306.47 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 70 KiB/s 110 KiB/s 3.14 ms 338.75 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 90 KiB/s 106 KiB/s 2.89 ms 352.60 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 4/s 75 KiB/s 108 KiB/s 2.51 ms 350.72 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 3/s 52 KiB/s 77 KiB/s 3.14 ms 345.34 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 3/s 90 KiB/s 103 KiB/s 3.32 ms 360.00 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 3/s 114 KiB/s 86 KiB/s 3.48 ms 353.67 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 4/s 87 KiB/s 138 KiB/s 2.67 ms 354.18 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 4/s 94 KiB/s 126 KiB/s 3.05 ms 348.17 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 76 KiB/s 121 KiB/s 2.91 ms 332.55 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 3/s 46 KiB/s 99 KiB/s 2.72 ms 431.40 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 3/s 94 KiB/s 75 KiB/s 2.90 ms 373.09 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 4/s 82 KiB/s 80 KiB/s 2.97 ms 322.86 us 2024-03-25T09:34:25.281 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 3/s 117 KiB/s 117 KiB/s 2.93 ms 347.44 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 3/s 74 KiB/s 87 KiB/s 3.44 ms 362.99 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 95 KiB/s 145 KiB/s 2.79 ms 427.13 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 5/s 66 KiB/s 124 KiB/s 2.76 ms 319.99 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 4/s 95 KiB/s 96 KiB/s 3.05 ms 354.49 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 2/s 4/s 41 KiB/s 66 KiB/s 2.56 ms 298.94 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 2/s 4/s 75 KiB/s 130 KiB/s 3.36 ms 451.71 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 2/s 4/s 56 KiB/s 108 KiB/s 2.48 ms 446.63 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 2/s 4/s 73 KiB/s 126 KiB/s 3.25 ms 340.35 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 2/s 4/s 61 KiB/s 113 KiB/s 3.16 ms 342.43 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 2/s 5/s 70 KiB/s 102 KiB/s 2.62 ms 324.83 us 2024-03-25T09:34:25.282 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 2/s 4/s 66 KiB/s 101 KiB/s 3.61 ms 341.57 us 2024-03-25T09:34:25.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 2/s 4/s 62 KiB/s 100 KiB/s 2.94 ms 424.46 us 2024-03-25T09:34:25.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 2/s 3/s 74 KiB/s 98 KiB/s 3.66 ms 381.13 us 2024-03-25T09:34:25.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 2/s 5/s 49 KiB/s 148 KiB/s 2.76 ms 361.83 us 2024-03-25T09:34:25.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 2/s 5/s 48 KiB/s 126 KiB/s 2.92 ms 317.91 us 2024-03-25T09:34:25.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 2/s 4/s 55 KiB/s 74 KiB/s 3.07 ms 329.20 us 2024-03-25T09:34:25.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 2/s 5/s 43 KiB/s 114 KiB/s 2.66 ms 389.99 us 2024-03-25T09:34:25.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 2/s 5/s 70 KiB/s 135 KiB/s 2.94 ms 294.45 us 2024-03-25T09:34:25.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 2/s 4/s 51 KiB/s 125 KiB/s 4.14 ms 451.52 us 2024-03-25T09:34:25.283 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:25.622 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:25.622 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:25.622 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:25.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:25 smithi019 ceph-mon[29386]: pgmap v767: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.1 MiB/s wr, 431 op/s 2024-03-25T09:34:25.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:25 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 777 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:26.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:25 smithi059 ceph-mon[32732]: pgmap v767: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.1 MiB/s wr, 431 op/s 2024-03-25T09:34:26.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:25 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 777 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:26.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:25 smithi040 ceph-mon[33094]: pgmap v767: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.1 MiB/s wr, 431 op/s 2024-03-25T09:34:26.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:25 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 777 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:26.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:26.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:26.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:26.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:26 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:26.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:26 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:26.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:26 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:26.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:26 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:26.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:26 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:26.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:26 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:26.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:26 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:27.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:26 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:27.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:26 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:27.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:26 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:27.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:26 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:27.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:26 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:27.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:26 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:27.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:26 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:26 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:26 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:26 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:26 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:26 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:26 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:27.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:26 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:27.624 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:27.625 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:27.625 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:27.907 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:27 smithi019 ceph-mon[29386]: pgmap v768: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.6 MiB/s wr, 476 op/s 2024-03-25T09:34:28.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:27 smithi059 ceph-mon[32732]: pgmap v768: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.6 MiB/s wr, 476 op/s 2024-03-25T09:34:28.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:27 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:27.823+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:28.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:27 smithi040 ceph-mon[33094]: pgmap v768: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.6 MiB/s wr, 476 op/s 2024-03-25T09:34:28.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:28.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:28.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:29.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:29.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:29.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:29.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:34:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 87.6k 71.6k 0.0k 876.0k 716.0k 0.0k nvme2n1 2024-03-25T09:34:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 74.4k 82.4k 0.0k 744.0k 824.0k 0.0k nvme2n10 2024-03-25T09:34:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 116.0k 78.0k 0.0k 1.1M 780.0k 0.0k nvme2n11 2024-03-25T09:34:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 109.2k 111.6k 0.0k 1.1M 1.1M 0.0k nvme2n12 2024-03-25T09:34:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 70.4k 64.8k 0.0k 704.0k 648.0k 0.0k nvme2n13 2024-03-25T09:34:29.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 72.8k 88.4k 0.0k 728.0k 884.0k 0.0k nvme2n14 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 89.2k 86.4k 0.0k 892.0k 864.0k 0.0k nvme2n15 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 92.8k 103.2k 0.0k 928.0k 1.0M 0.0k nvme2n16 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 84.8k 92.4k 0.0k 848.0k 924.0k 0.0k nvme2n17 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 95.6k 102.4k 0.0k 956.0k 1.0M 0.0k nvme2n18 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 92.4k 78.0k 0.0k 924.0k 780.0k 0.0k nvme2n19 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 61.2k 104.4k 0.0k 612.0k 1.0M 0.0k nvme2n2 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 65.2k 74.8k 0.0k 652.0k 748.0k 0.0k nvme2n20 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 77.2k 78.0k 0.0k 772.0k 780.0k 0.0k nvme2n3 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 70.0k 81.2k 0.0k 700.0k 812.0k 0.0k nvme2n4 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 95.2k 87.6k 0.0k 952.0k 876.0k 0.0k nvme2n5 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 74.8k 86.0k 0.0k 748.0k 860.0k 0.0k nvme2n6 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 90.0k 84.4k 0.0k 900.0k 844.0k 0.0k nvme2n7 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 70.4k 118.4k 0.0k 704.0k 1.2M 0.0k nvme2n8 2024-03-25T09:34:29.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 92.8k 74.0k 0.0k 928.0k 740.0k 0.0k nvme2n9 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 82.0k 86.8k 0.0k 820.0k 868.0k 0.0k nvme5n1 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 103.6k 95.2k 0.0k 1.0M 952.0k 0.0k nvme5n10 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 84.8k 86.0k 0.0k 848.0k 860.0k 0.0k nvme5n11 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 87.2k 98.8k 0.0k 872.0k 988.0k 0.0k nvme5n12 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 99.2k 61.2k 0.0k 992.0k 612.0k 0.0k nvme5n13 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 72.8k 95.6k 0.0k 728.0k 956.0k 0.0k nvme5n14 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 74.0k 104.8k 0.0k 740.0k 1.0M 0.0k nvme5n15 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 80.4k 83.6k 0.0k 804.0k 836.0k 0.0k nvme5n16 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 94.0k 72.0k 0.0k 940.0k 720.0k 0.0k nvme5n17 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 92.4k 91.6k 0.0k 924.0k 916.0k 0.0k nvme5n18 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 103.6k 74.4k 0.0k 1.0M 744.0k 0.0k nvme5n19 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 127.6k 79.2k 0.0k 1.2M 792.0k 0.0k nvme5n2 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 60.4k 99.2k 0.0k 604.0k 992.0k 0.0k nvme5n20 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 88.4k 105.2k 0.0k 884.0k 1.0M 0.0k nvme5n3 2024-03-25T09:34:29.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 78.8k 93.2k 0.0k 788.0k 932.0k 0.0k nvme5n4 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 76.4k 92.8k 0.0k 764.0k 928.0k 0.0k nvme5n5 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 94.0k 88.8k 0.0k 940.0k 888.0k 0.0k nvme5n6 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 115.2k 64.8k 0.0k 1.1M 648.0k 0.0k nvme5n7 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 93.2k 71.6k 0.0k 932.0k 716.0k 0.0k nvme5n8 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 95.6k 60.0k 0.0k 956.0k 600.0k 0.0k nvme5n9 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 81.6k 108.0k 0.0k 816.0k 1.1M 0.0k nvme8n1 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 92.8k 93.6k 0.0k 928.0k 936.0k 0.0k nvme8n10 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.30 95.6k 76.0k 0.0k 956.0k 760.0k 0.0k nvme8n11 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 79.2k 62.0k 0.0k 792.0k 620.0k 0.0k nvme8n12 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 93.2k 120.0k 0.0k 932.0k 1.2M 0.0k nvme8n13 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 76.4k 82.0k 0.0k 764.0k 820.0k 0.0k nvme8n14 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 116.4k 62.0k 0.0k 1.1M 620.0k 0.0k nvme8n15 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 82.8k 74.4k 0.0k 828.0k 744.0k 0.0k nvme8n16 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 74.0k 120.4k 0.0k 740.0k 1.2M 0.0k nvme8n17 2024-03-25T09:34:29.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 81.2k 75.2k 0.0k 812.0k 752.0k 0.0k nvme8n18 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 112.4k 52.0k 0.0k 1.1M 520.0k 0.0k nvme8n19 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 88.8k 100.4k 0.0k 888.0k 1004.0k 0.0k nvme8n2 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 96.0k 76.0k 0.0k 960.0k 760.0k 0.0k nvme8n20 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 88.4k 88.8k 0.0k 884.0k 888.0k 0.0k nvme8n3 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 83.6k 90.8k 0.0k 836.0k 908.0k 0.0k nvme8n4 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 106.4k 71.6k 0.0k 1.0M 716.0k 0.0k nvme8n5 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 82.4k 78.4k 0.0k 824.0k 784.0k 0.0k nvme8n6 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 86.4k 84.0k 0.0k 864.0k 840.0k 0.0k nvme8n7 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 96.8k 80.0k 0.0k 968.0k 800.0k 0.0k nvme8n8 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 88.4k 114.0k 0.0k 884.0k 1.1M 0.0k nvme8n9 2024-03-25T09:34:29.686 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:29.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:29 smithi019 ceph-mon[29386]: pgmap v769: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 444 op/s 2024-03-25T09:34:30.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:29 smithi059 ceph-mon[32732]: pgmap v769: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 444 op/s 2024-03-25T09:34:30.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:29 smithi040 ceph-mon[33094]: pgmap v769: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 444 op/s 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 5/s 1/s 134 KiB/s 54 KiB/s 2.95 ms 335.72 us 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 5/s 2/s 133 KiB/s 54 KiB/s 2.95 ms 322.50 us 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 5/s 3/s 147 KiB/s 56 KiB/s 3.28 ms 318.81 us 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 1/s 103 KiB/s 28 KiB/s 2.73 ms 263.46 us 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 2/s 97 KiB/s 78 KiB/s 3.05 ms 332.08 us 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 3/s 90 KiB/s 71 KiB/s 2.64 ms 329.36 us 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 4/s 3/s 88 KiB/s 83 KiB/s 2.90 ms 324.37 us 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 2/s 86 KiB/s 61 KiB/s 2.85 ms 310.73 us 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 4/s 4/s 90 KiB/s 71 KiB/s 3.32 ms 329.65 us 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 3/s 82 KiB/s 94 KiB/s 3.41 ms 337.18 us 2024-03-25T09:34:30.283 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 2/s 115 KiB/s 78 KiB/s 3.15 ms 501.78 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 3/s 71 KiB/s 66 KiB/s 3.03 ms 345.76 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 4/s 2/s 105 KiB/s 73 KiB/s 3.44 ms 350.03 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 3/s 129 KiB/s 50 KiB/s 2.71 ms 316.91 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 2/s 88 KiB/s 75 KiB/s 3.06 ms 370.02 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 3/s 115 KiB/s 58 KiB/s 2.98 ms 332.80 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 75 KiB/s 82 KiB/s 3.95 ms 335.50 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 4/s 109 KiB/s 94 KiB/s 2.81 ms 302.26 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 3/s 84 KiB/s 91 KiB/s 2.42 ms 314.64 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 80 KiB/s 88 KiB/s 2.63 ms 304.89 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 91 KiB/s 98 KiB/s 3.70 ms 350.41 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 3/s 85 KiB/s 62 KiB/s 3.07 ms 300.00 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 4/s 101 KiB/s 115 KiB/s 3.13 ms 375.26 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 3/s 63 KiB/s 86 KiB/s 2.88 ms 335.47 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 4/s 83 KiB/s 107 KiB/s 2.74 ms 343.25 us 2024-03-25T09:34:30.284 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 106 KiB/s 98 KiB/s 3.41 ms 966.20 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 3/s 74 KiB/s 82 KiB/s 2.87 ms 318.40 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 3/s 75 KiB/s 92 KiB/s 3.76 ms 347.30 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 80 KiB/s 106 KiB/s 3.11 ms 332.96 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 3/s 82 KiB/s 65 KiB/s 2.79 ms 295.87 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 3/s 86 KiB/s 88 KiB/s 2.87 ms 339.92 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 102 KiB/s 74 KiB/s 3.16 ms 352.53 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 3/s 79 KiB/s 91 KiB/s 3.14 ms 425.10 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 3/s 3/s 78 KiB/s 109 KiB/s 3.07 ms 340.31 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 3/s 98 KiB/s 81 KiB/s 2.88 ms 383.18 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 3/s 102 KiB/s 70 KiB/s 3.27 ms 402.74 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 3/s 75 KiB/s 63 KiB/s 2.61 ms 309.33 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 3/s 83 KiB/s 85 KiB/s 3.41 ms 332.50 us 2024-03-25T09:34:30.285 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 78 KiB/s 101 KiB/s 2.64 ms 314.33 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 3/s 61 KiB/s 63 KiB/s 2.50 ms 319.85 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 74 KiB/s 102 KiB/s 2.81 ms 338.37 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 3/s 96 KiB/s 70 KiB/s 3.13 ms 466.53 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 3/s 66 KiB/s 74 KiB/s 2.96 ms 303.08 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 3/s 88 KiB/s 76 KiB/s 2.46 ms 305.50 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 5/s 79 KiB/s 134 KiB/s 2.87 ms 393.51 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 73 KiB/s 93 KiB/s 3.05 ms 307.38 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 4/s 72 KiB/s 98 KiB/s 2.75 ms 389.51 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 3/s 103 KiB/s 96 KiB/s 3.05 ms 398.41 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 83 KiB/s 96 KiB/s 2.81 ms 311.85 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 4/s 69 KiB/s 153 KiB/s 2.90 ms 332.62 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 77 KiB/s 102 KiB/s 2.95 ms 395.56 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 63 KiB/s 144 KiB/s 2.51 ms 359.53 us 2024-03-25T09:34:30.286 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 4/s 62 KiB/s 108 KiB/s 2.93 ms 316.79 us 2024-03-25T09:34:30.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 3/s 50 KiB/s 78 KiB/s 3.30 ms 347.52 us 2024-03-25T09:34:30.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 5/s 46 KiB/s 135 KiB/s 2.83 ms 340.98 us 2024-03-25T09:34:30.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 5/s 47 KiB/s 126 KiB/s 3.41 ms 342.33 us 2024-03-25T09:34:30.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 2/s 5/s 66 KiB/s 108 KiB/s 2.82 ms 318.74 us 2024-03-25T09:34:30.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 2/s 4/s 74 KiB/s 100 KiB/s 3.03 ms 302.46 us 2024-03-25T09:34:30.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 2/s 3/s 78 KiB/s 90 KiB/s 3.00 ms 379.02 us 2024-03-25T09:34:30.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 2/s 4/s 59 KiB/s 86 KiB/s 2.65 ms 331.65 us 2024-03-25T09:34:30.287 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:30.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:30 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 782 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:31.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:30 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 782 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:31.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:30 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 782 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:31.634 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:31.634 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:31.634 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-mon[29386]: pgmap v770: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 430 op/s 2024-03-25T09:34:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:31.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:31 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:31 smithi059 ceph-mon[32732]: pgmap v770: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 430 op/s 2024-03-25T09:34:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:31 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:31 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:31 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:31 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:31 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:31 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:32.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:31 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:32.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:31 smithi040 ceph-mon[33094]: pgmap v770: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 430 op/s 2024-03-25T09:34:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:31 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:31 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:31 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:31 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:31 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:31 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:32.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:31 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:32.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:32.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:32.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:33.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:32.824+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:33.636 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:33.636 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:33.636 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:33.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:33 smithi019 ceph-mon[29386]: pgmap v771: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 482 op/s 2024-03-25T09:34:34.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:33 smithi059 ceph-mon[32732]: pgmap v771: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 482 op/s 2024-03-25T09:34:34.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:33 smithi040 ceph-mon[33094]: pgmap v771: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 482 op/s 2024-03-25T09:34:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:35.287 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:35.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 5/s 3/s 132 KiB/s 64 KiB/s 2.85 ms 313.55 us 2024-03-25T09:34:35.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 5/s 3/s 101 KiB/s 56 KiB/s 3.11 ms 301.24 us 2024-03-25T09:34:35.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 5/s 2/s 88 KiB/s 52 KiB/s 2.62 ms 363.44 us 2024-03-25T09:34:35.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 4/s 3/s 113 KiB/s 70 KiB/s 4.22 ms 472.77 us 2024-03-25T09:34:35.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 3/s 92 KiB/s 110 KiB/s 3.00 ms 308.29 us 2024-03-25T09:34:35.287 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 4/s 2/s 118 KiB/s 26 KiB/s 2.81 ms 286.72 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 4/s 3/s 106 KiB/s 94 KiB/s 2.82 ms 333.30 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 100 KiB/s 61 KiB/s 2.73 ms 380.69 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 68 KiB/s 82 KiB/s 3.09 ms 337.06 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 3/s 62 KiB/s 59 KiB/s 3.44 ms 382.24 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 3/s 85 KiB/s 88 KiB/s 2.77 ms 325.17 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 4/s 3/s 114 KiB/s 70 KiB/s 2.90 ms 428.93 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 3/s 116 KiB/s 74 KiB/s 2.93 ms 331.93 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 110 KiB/s 73 KiB/s 3.05 ms 458.90 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 110 KiB/s 89 KiB/s 2.96 ms 391.60 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 4/s 4/s 104 KiB/s 106 KiB/s 2.83 ms 328.36 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 4/s 3/s 104 KiB/s 96 KiB/s 2.74 ms 315.65 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 4/s 3/s 57 KiB/s 65 KiB/s 3.15 ms 326.86 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 96 KiB/s 86 KiB/s 2.98 ms 334.56 us 2024-03-25T09:34:35.288 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 3/s 129 KiB/s 88 KiB/s 3.35 ms 339.80 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 5/s 69 KiB/s 101 KiB/s 3.10 ms 397.78 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 4/s 107 KiB/s 106 KiB/s 3.05 ms 326.76 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 4/s 3/s 102 KiB/s 113 KiB/s 3.08 ms 376.44 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 3/s 106 KiB/s 85 KiB/s 3.12 ms 436.04 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 3/s 102 KiB/s 64 KiB/s 3.29 ms 312.56 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 70 KiB/s 62 KiB/s 2.66 ms 341.86 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 3/s 87 KiB/s 73 KiB/s 3.26 ms 367.45 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 101 KiB/s 111 KiB/s 2.85 ms 332.73 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 4/s 76 KiB/s 93 KiB/s 3.01 ms 304.27 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 3/s 85 KiB/s 69 KiB/s 2.86 ms 414.87 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 3/s 86 KiB/s 69 KiB/s 3.03 ms 313.81 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 72 KiB/s 93 KiB/s 2.87 ms 475.71 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 3/s 107 KiB/s 102 KiB/s 2.97 ms 441.63 us 2024-03-25T09:34:35.289 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 3/s 84 KiB/s 71 KiB/s 3.54 ms 341.18 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 3/s 83 KiB/s 80 KiB/s 3.31 ms 349.32 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 4/s 56 KiB/s 106 KiB/s 2.41 ms 315.62 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 3/s 80 KiB/s 67 KiB/s 3.68 ms 374.12 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 4/s 94 KiB/s 94 KiB/s 2.91 ms 331.10 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 58 KiB/s 115 KiB/s 2.86 ms 330.82 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 80 KiB/s 86 KiB/s 3.48 ms 357.34 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 4/s 80 KiB/s 105 KiB/s 2.86 ms 403.19 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 4/s 86 KiB/s 118 KiB/s 2.96 ms 434.03 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 3/s 61 KiB/s 74 KiB/s 2.71 ms 333.71 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 86 KiB/s 103 KiB/s 2.78 ms 303.39 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 3/s 75 KiB/s 58 KiB/s 2.89 ms 305.00 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 3/s 58 KiB/s 65 KiB/s 2.79 ms 331.48 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 4/s 78 KiB/s 108 KiB/s 3.41 ms 371.83 us 2024-03-25T09:34:35.290 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 59 KiB/s 76 KiB/s 3.19 ms 340.56 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 75 KiB/s 71 KiB/s 3.62 ms 326.43 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 60 KiB/s 83 KiB/s 3.21 ms 339.69 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 2/s 4/s 60 KiB/s 90 KiB/s 3.07 ms 319.59 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 2/s 4/s 64 KiB/s 65 KiB/s 3.02 ms 328.85 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 2/s 4/s 57 KiB/s 134 KiB/s 2.78 ms 370.07 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 2/s 4/s 66 KiB/s 75 KiB/s 2.63 ms 422.14 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 2/s 4/s 65 KiB/s 110 KiB/s 2.81 ms 350.36 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 2/s 5/s 66 KiB/s 106 KiB/s 2.47 ms 323.80 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 2/s 4/s 47 KiB/s 91 KiB/s 2.78 ms 315.01 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 2/s 4/s 62 KiB/s 109 KiB/s 3.12 ms 427.63 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 2/s 4/s 41 KiB/s 98 KiB/s 2.48 ms 338.56 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 2/s 5/s 46 KiB/s 109 KiB/s 3.11 ms 307.26 us 2024-03-25T09:34:35.291 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:35.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:35.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:35.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:35.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:35 smithi019 ceph-mon[29386]: pgmap v772: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.7 MiB/s wr, 424 op/s 2024-03-25T09:34:35.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:35 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 787 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:36.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:35 smithi059 ceph-mon[32732]: pgmap v772: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.7 MiB/s wr, 424 op/s 2024-03-25T09:34:36.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:35 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 787 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:36.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:35 smithi040 ceph-mon[33094]: pgmap v772: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.7 MiB/s wr, 424 op/s 2024-03-25T09:34:36.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:35 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 787 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:36.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:36.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:36.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:36.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:36 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:36.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:36 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:36.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:36 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:36.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:36 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:36.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:36 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:36.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:36 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:36.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:36 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:37.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:36 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:36 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:36 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:36 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:36 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:36 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:37.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:36 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:36 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:36 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:36 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:36 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:36 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:36 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:37.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:36 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:37.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:37.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:37.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:37.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:37 smithi019 ceph-mon[29386]: pgmap v773: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 472 op/s 2024-03-25T09:34:38.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:37 smithi059 ceph-mon[32732]: pgmap v773: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 472 op/s 2024-03-25T09:34:38.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:37.824+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:38.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:37 smithi040 ceph-mon[33094]: pgmap v773: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 472 op/s 2024-03-25T09:34:38.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:38.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:38.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:39.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:39.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:39.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:39.672 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-25T09:34:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 68.0k 72.4k 0.0k 680.0k 724.0k 0.0k nvme2n1 2024-03-25T09:34:39.682 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 78.0k 85.2k 0.0k 780.0k 852.0k 0.0k nvme2n10 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 117.2k 85.6k 0.0k 1.1M 856.0k 0.0k nvme2n11 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 87.2k 96.0k 0.0k 872.0k 960.0k 0.0k nvme2n12 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 80.8k 84.4k 0.0k 808.0k 844.0k 0.0k nvme2n13 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 92.0k 74.0k 0.0k 920.0k 740.0k 0.0k nvme2n14 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 83.6k 79.6k 0.0k 836.0k 796.0k 0.0k nvme2n15 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 65.6k 104.8k 0.0k 656.0k 1.0M 0.0k nvme2n16 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 76.8k 96.0k 0.0k 768.0k 960.0k 0.0k nvme2n17 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 98.8k 58.8k 0.0k 988.0k 588.0k 0.0k nvme2n18 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 68.8k 90.8k 0.0k 688.0k 908.0k 0.0k nvme2n19 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 86.0k 75.6k 0.0k 860.0k 756.0k 0.0k nvme2n2 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 49.2k 85.2k 0.0k 492.0k 852.0k 0.0k nvme2n20 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 78.4k 86.8k 0.0k 784.0k 868.0k 0.0k nvme2n3 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 59.2k 84.8k 0.0k 592.0k 848.0k 0.0k nvme2n4 2024-03-25T09:34:39.683 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 81.2k 94.8k 0.0k 812.0k 948.0k 0.0k nvme2n5 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 70.8k 77.6k 0.0k 708.0k 776.0k 0.0k nvme2n6 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 81.2k 62.0k 0.0k 812.0k 620.0k 0.0k nvme2n7 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 108.0k 67.6k 0.0k 1.1M 676.0k 0.0k nvme2n8 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 91.2k 67.6k 0.0k 912.0k 676.0k 0.0k nvme2n9 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 74.0k 78.0k 0.0k 740.0k 780.0k 0.0k nvme5n1 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 77.2k 106.8k 0.0k 772.0k 1.0M 0.0k nvme5n10 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 90.4k 63.2k 0.0k 904.0k 632.0k 0.0k nvme5n11 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 71.2k 110.8k 0.0k 712.0k 1.1M 0.0k nvme5n12 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 77.2k 82.0k 0.0k 772.0k 820.0k 0.0k nvme5n13 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 60.0k 120.4k 0.0k 600.0k 1.2M 0.0k nvme5n14 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 88.4k 76.0k 0.0k 884.0k 760.0k 0.0k nvme5n15 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 76.4k 88.8k 0.0k 764.0k 888.0k 0.0k nvme5n16 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 81.2k 74.4k 0.0k 812.0k 744.0k 0.0k nvme5n17 2024-03-25T09:34:39.684 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 103.2k 70.4k 0.0k 1.0M 704.0k 0.0k nvme5n18 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 85.2k 69.2k 0.0k 852.0k 692.0k 0.0k nvme5n19 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 80.4k 76.8k 0.0k 804.0k 768.0k 0.0k nvme5n2 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 60.0k 95.2k 0.0k 600.0k 952.0k 0.0k nvme5n20 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 57.2k 126.0k 0.0k 572.0k 1.2M 0.0k nvme5n3 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 116.0k 75.6k 0.0k 1.1M 756.0k 0.0k nvme5n4 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 76.0k 78.8k 0.0k 760.0k 788.0k 0.0k nvme5n5 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 78.4k 87.2k 0.0k 784.0k 872.0k 0.0k nvme5n6 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 52.4k 96.8k 0.0k 524.0k 968.0k 0.0k nvme5n7 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 75.6k 83.6k 0.0k 756.0k 836.0k 0.0k nvme5n8 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 80.0k 85.2k 0.0k 800.0k 852.0k 0.0k nvme5n9 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 82.8k 76.0k 0.0k 828.0k 760.0k 0.0k nvme8n1 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 79.2k 97.6k 0.0k 792.0k 976.0k 0.0k nvme8n10 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 86.0k 77.6k 0.0k 860.0k 776.0k 0.0k nvme8n11 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 113.6k 70.0k 0.0k 1.1M 700.0k 0.0k nvme8n12 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 111.6k 71.6k 0.0k 1.1M 716.0k 0.0k nvme8n13 2024-03-25T09:34:39.685 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 63.6k 66.0k 0.0k 636.0k 660.0k 0.0k nvme8n14 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 83.6k 86.4k 0.0k 836.0k 864.0k 0.0k nvme8n15 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 60.0k 92.4k 0.0k 600.0k 924.0k 0.0k nvme8n16 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 92.8k 80.4k 0.0k 928.0k 804.0k 0.0k nvme8n17 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 89.2k 84.0k 0.0k 892.0k 840.0k 0.0k nvme8n18 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 107.2k 83.6k 0.0k 1.0M 836.0k 0.0k nvme8n19 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 70.0k 98.4k 0.0k 700.0k 984.0k 0.0k nvme8n2 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.50 83.6k 75.2k 0.0k 836.0k 752.0k 0.0k nvme8n20 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 74.8k 88.8k 0.0k 748.0k 888.0k 0.0k nvme8n3 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 84.8k 83.6k 0.0k 848.0k 836.0k 0.0k nvme8n4 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 96.4k 62.8k 0.0k 964.0k 628.0k 0.0k nvme8n5 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 91.2k 70.0k 0.0k 912.0k 700.0k 0.0k nvme8n6 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 62.0k 98.8k 0.0k 620.0k 988.0k 0.0k nvme8n7 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 86.4k 83.6k 0.0k 864.0k 836.0k 0.0k nvme8n8 2024-03-25T09:34:39.686 INFO:tasks.workunit.client.3.smithi129.stdout: 7.40 88.8k 94.4k 0.0k 888.0k 944.0k 0.0k nvme8n9 2024-03-25T09:34:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:39.687 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:39.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:39 smithi019 ceph-mon[29386]: pgmap v774: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 435 op/s 2024-03-25T09:34:40.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:39 smithi059 ceph-mon[32732]: pgmap v774: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 435 op/s 2024-03-25T09:34:40.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:39 smithi040 ceph-mon[33094]: pgmap v774: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 435 op/s 2024-03-25T09:34:40.290 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 6/s 2/s 148 KiB/s 42 KiB/s 2.56 ms 403.82 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 5/s 2/s 138 KiB/s 45 KiB/s 2.90 ms 288.18 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 5/s 3/s 137 KiB/s 58 KiB/s 2.98 ms 430.34 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 4/s 3/s 90 KiB/s 42 KiB/s 2.29 ms 508.87 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 3/s 91 KiB/s 74 KiB/s 3.21 ms 349.71 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 4/s 3/s 80 KiB/s 70 KiB/s 2.69 ms 425.68 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 4/s 4/s 114 KiB/s 115 KiB/s 2.98 ms 357.86 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 131 KiB/s 62 KiB/s 3.10 ms 356.42 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 2/s 109 KiB/s 76 KiB/s 3.03 ms 487.04 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 158 KiB/s 84 KiB/s 3.10 ms 329.31 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 3/s 102 KiB/s 72 KiB/s 3.16 ms 424.07 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 102 KiB/s 82 KiB/s 2.61 ms 441.45 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 3/s 85 KiB/s 66 KiB/s 3.11 ms 333.89 us 2024-03-25T09:34:40.291 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 102 KiB/s 85 KiB/s 2.95 ms 316.56 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 3/s 98 KiB/s 58 KiB/s 2.50 ms 291.20 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 3/s 100 KiB/s 52 KiB/s 3.67 ms 310.48 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 134 KiB/s 57 KiB/s 3.06 ms 467.22 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 2/s 119 KiB/s 47 KiB/s 3.49 ms 322.17 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 4/s 3/s 78 KiB/s 62 KiB/s 3.41 ms 341.75 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 4/s 98 KiB/s 93 KiB/s 3.65 ms 332.42 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 4/s 2/s 60 KiB/s 61 KiB/s 3.50 ms 371.85 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 68 KiB/s 87 KiB/s 2.92 ms 332.06 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 4/s 92 KiB/s 97 KiB/s 3.36 ms 346.09 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 91 KiB/s 90 KiB/s 3.15 ms 334.92 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 3/s 74 KiB/s 98 KiB/s 3.02 ms 402.24 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 3/s 88 KiB/s 86 KiB/s 2.86 ms 435.59 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 3/s 87 KiB/s 75 KiB/s 2.97 ms 325.91 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 4/s 66 KiB/s 98 KiB/s 2.90 ms 414.57 us 2024-03-25T09:34:40.292 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 3/s 77 KiB/s 66 KiB/s 3.60 ms 354.33 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 4/s 99 KiB/s 110 KiB/s 3.63 ms 351.51 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 2/s 90 KiB/s 46 KiB/s 2.89 ms 277.63 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 4/s 72 KiB/s 85 KiB/s 3.12 ms 317.12 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 3/s 100 KiB/s 78 KiB/s 2.67 ms 380.53 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 3/s 80 KiB/s 58 KiB/s 2.65 ms 325.13 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 4/s 66 KiB/s 82 KiB/s 3.45 ms 346.74 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 2/s 62 KiB/s 54 KiB/s 4.22 ms 342.12 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 3/s 70 KiB/s 55 KiB/s 2.62 ms 395.59 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 3/s 58 KiB/s 102 KiB/s 2.82 ms 349.40 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 2/s 89 KiB/s 78 KiB/s 2.99 ms 369.22 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 4/s 64 KiB/s 87 KiB/s 3.36 ms 335.59 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 3/s 65 KiB/s 84 KiB/s 2.70 ms 361.03 us 2024-03-25T09:34:40.293 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 4/s 66 KiB/s 110 KiB/s 3.39 ms 419.00 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 3/s 3/s 48 KiB/s 81 KiB/s 3.05 ms 320.35 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 5/s 86 KiB/s 112 KiB/s 2.65 ms 356.35 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 79 KiB/s 134 KiB/s 2.86 ms 375.28 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 5/s 84 KiB/s 106 KiB/s 3.13 ms 388.07 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 74 KiB/s 100 KiB/s 3.22 ms 340.85 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 102 KiB/s 76 KiB/s 3.15 ms 358.13 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 53 KiB/s 76 KiB/s 2.81 ms 396.66 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 3/s 4/s 93 KiB/s 120 KiB/s 2.87 ms 350.59 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 80 KiB/s 66 KiB/s 3.73 ms 325.90 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 69 KiB/s 102 KiB/s 2.87 ms 375.88 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 67 KiB/s 93 KiB/s 2.73 ms 354.31 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 4/s 78 KiB/s 96 KiB/s 2.99 ms 444.90 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 2/s 4/s 63 KiB/s 71 KiB/s 2.45 ms 283.25 us 2024-03-25T09:34:40.294 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 2/s 4/s 60 KiB/s 103 KiB/s 2.97 ms 319.65 us 2024-03-25T09:34:40.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 2/s 4/s 58 KiB/s 90 KiB/s 2.72 ms 356.70 us 2024-03-25T09:34:40.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 2/s 4/s 67 KiB/s 93 KiB/s 3.09 ms 345.06 us 2024-03-25T09:34:40.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 2/s 4/s 64 KiB/s 79 KiB/s 2.88 ms 336.14 us 2024-03-25T09:34:40.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 1/s 4/s 42 KiB/s 97 KiB/s 2.94 ms 396.71 us 2024-03-25T09:34:40.295 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:40.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:40.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:40.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:40.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:40 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 792 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:41.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:40 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 792 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:41.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:40 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 792 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:41.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:41.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:41.652 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-mon[29386]: pgmap v775: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 426 op/s 2024-03-25T09:34:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:41.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:41 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:41 smithi059 ceph-mon[32732]: pgmap v775: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 426 op/s 2024-03-25T09:34:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:41 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:41 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:41 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:41 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:41 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:41 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:42.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:41 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:42.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:41 smithi040 ceph-mon[33094]: pgmap v775: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 426 op/s 2024-03-25T09:34:42.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:41 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:42.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:41 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:42.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:41 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:42.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:41 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:42.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:41 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:42.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:41 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:42.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:41 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:42.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:42.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:42.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:42.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:42 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:34:43.010 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:42 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:34:43.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:42.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:43.012 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:42 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-25T09:34:43.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:43.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:43.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:44.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:43 smithi059 ceph-mon[32732]: pgmap v776: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 484 op/s 2024-03-25T09:34:44.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:34:44.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:34:44.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:43 smithi059 ceph-mon[32732]: pgmap v777: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 439 op/s 2024-03-25T09:34:44.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:43 smithi059 ceph-mon[32732]: pgmap v778: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 5.1 MiB/s wr, 468 op/s 2024-03-25T09:34:44.011 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:43 smithi059 ceph-mon[32732]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:34:44.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:43 smithi040 ceph-mon[33094]: pgmap v776: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 484 op/s 2024-03-25T09:34:44.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:34:44.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:34:44.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:43 smithi040 ceph-mon[33094]: pgmap v777: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 439 op/s 2024-03-25T09:34:44.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:43 smithi040 ceph-mon[33094]: pgmap v778: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 5.1 MiB/s wr, 468 op/s 2024-03-25T09:34:44.013 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:43 smithi040 ceph-mon[33094]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:34:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:43 smithi019 ceph-mon[29386]: pgmap v776: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.3 MiB/s wr, 484 op/s 2024-03-25T09:34:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-25T09:34:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-25T09:34:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:43 smithi019 ceph-mon[29386]: pgmap v777: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 439 op/s 2024-03-25T09:34:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:43 smithi019 ceph-mon[29386]: pgmap v778: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 5.1 MiB/s wr, 468 op/s 2024-03-25T09:34:44.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:43 smithi019 ceph-mon[29386]: from='mgr.14150 172.21.15.19:0/1293370644' entity='mgr.x' 2024-03-25T09:34:44.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:44.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:44.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:45.295 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:45.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 5/s 2/s 126 KiB/s 46 KiB/s 3.44 ms 337.78 us 2024-03-25T09:34:45.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 5/s 2/s 110 KiB/s 50 KiB/s 2.71 ms 345.54 us 2024-03-25T09:34:45.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 1/s 137 KiB/s 25 KiB/s 2.88 ms 315.63 us 2024-03-25T09:34:45.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 98 KiB/s 68 KiB/s 2.62 ms 529.40 us 2024-03-25T09:34:45.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 4/s 2/s 79 KiB/s 50 KiB/s 3.28 ms 538.37 us 2024-03-25T09:34:45.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 2/s 82 KiB/s 51 KiB/s 2.99 ms 325.77 us 2024-03-25T09:34:45.295 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 2/s 92 KiB/s 61 KiB/s 3.06 ms 295.95 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 4/s 3/s 92 KiB/s 104 KiB/s 3.17 ms 432.37 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 4/s 3/s 83 KiB/s 50 KiB/s 3.01 ms 314.75 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 3/s 100 KiB/s 69 KiB/s 3.13 ms 355.60 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 4/s 3/s 88 KiB/s 72 KiB/s 2.85 ms 291.43 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 4/s 3/s 77 KiB/s 70 KiB/s 2.64 ms 428.90 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 3/s 74 KiB/s 63 KiB/s 2.77 ms 339.55 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 4/s 3/s 94 KiB/s 86 KiB/s 3.09 ms 359.83 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 4/s 3/s 102 KiB/s 67 KiB/s 2.84 ms 346.95 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 3/s 116 KiB/s 75 KiB/s 3.00 ms 326.80 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 4/s 75 KiB/s 86 KiB/s 3.14 ms 385.36 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 4/s 58 KiB/s 78 KiB/s 4.09 ms 325.31 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 3/s 2/s 63 KiB/s 42 KiB/s 2.56 ms 358.36 us 2024-03-25T09:34:45.296 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 3/s 96 KiB/s 58 KiB/s 3.12 ms 341.04 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 3/s 81 KiB/s 75 KiB/s 3.64 ms 389.21 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 3/s 79 KiB/s 84 KiB/s 3.15 ms 333.23 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 3/s 3/s 82 KiB/s 63 KiB/s 2.69 ms 340.96 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 61 KiB/s 61 KiB/s 3.41 ms 343.00 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 3/s 5/s 90 KiB/s 119 KiB/s 2.95 ms 337.12 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 3/s 3/s 98 KiB/s 58 KiB/s 3.11 ms 294.80 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 3/s 87 KiB/s 87 KiB/s 2.59 ms 451.73 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 3/s 5/s 79 KiB/s 105 KiB/s 2.98 ms 366.08 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 3/s 90 KiB/s 80 KiB/s 2.92 ms 319.55 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 4/s 88 KiB/s 132 KiB/s 2.96 ms 470.31 us 2024-03-25T09:34:45.297 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 3/s 107 KiB/s 60 KiB/s 3.06 ms 314.47 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 3/s 92 KiB/s 80 KiB/s 3.27 ms 329.70 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 3/s 78 KiB/s 58 KiB/s 3.37 ms 315.86 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 3/s 74 KiB/s 54 KiB/s 3.05 ms 294.27 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 3/s 4/s 80 KiB/s 71 KiB/s 2.90 ms 385.03 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 4/s 58 KiB/s 78 KiB/s 2.90 ms 311.68 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 3/s 3/s 81 KiB/s 87 KiB/s 2.95 ms 378.39 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 75 KiB/s 74 KiB/s 2.75 ms 315.90 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 3/s 50 KiB/s 61 KiB/s 2.91 ms 288.96 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 3/s 99 KiB/s 93 KiB/s 2.99 ms 337.25 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 3/s 4/s 68 KiB/s 102 KiB/s 3.21 ms 336.05 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 3/s 3/s 59 KiB/s 52 KiB/s 2.89 ms 326.43 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 4/s 77 KiB/s 95 KiB/s 3.13 ms 322.96 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 4/s 65 KiB/s 118 KiB/s 2.80 ms 324.72 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 3/s 48 KiB/s 49 KiB/s 2.69 ms 422.55 us 2024-03-25T09:34:45.298 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 3/s 4/s 54 KiB/s 81 KiB/s 3.21 ms 345.12 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 4/s 60 KiB/s 74 KiB/s 3.08 ms 318.62 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 67 KiB/s 82 KiB/s 2.51 ms 315.92 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 3/s 90 KiB/s 85 KiB/s 2.83 ms 324.86 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 3/s 90 KiB/s 71 KiB/s 3.19 ms 307.30 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 3/s 74 KiB/s 50 KiB/s 3.42 ms 340.02 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 4/s 56 KiB/s 130 KiB/s 2.88 ms 355.97 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 3/s 3/s 49 KiB/s 61 KiB/s 2.87 ms 311.78 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 4/s 78 KiB/s 115 KiB/s 2.89 ms 357.68 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 2/s 3/s 42 KiB/s 80 KiB/s 2.97 ms 343.71 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 2/s 5/s 58 KiB/s 141 KiB/s 2.83 ms 357.70 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 2/s 4/s 39 KiB/s 89 KiB/s 2.91 ms 342.52 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 2/s 4/s 65 KiB/s 77 KiB/s 3.40 ms 327.20 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 2/s 5/s 39 KiB/s 130 KiB/s 2.76 ms 378.71 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 2/s 4/s 62 KiB/s 82 KiB/s 3.72 ms 363.94 us 2024-03-25T09:34:45.299 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:45.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:45.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:45.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:46 smithi019 ceph-mon[29386]: pgmap v779: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.2 MiB/s rd, 4.3 MiB/s wr, 404 op/s 2024-03-25T09:34:46.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:46 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 802 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:46.510 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:46 smithi059 ceph-mon[32732]: pgmap v779: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.2 MiB/s rd, 4.3 MiB/s wr, 404 op/s 2024-03-25T09:34:46.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:46 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 802 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:46 smithi040 ceph-mon[33094]: pgmap v779: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.2 MiB/s rd, 4.3 MiB/s wr, 404 op/s 2024-03-25T09:34:46.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:46 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 802 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:46.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:46.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:46.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:47.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:47 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:47.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:47 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:47.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:47 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:47.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:47 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:47.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:47 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:47.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:47 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:47.367 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:47 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:47 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:47 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:47 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:47 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:47 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:47 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:47 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:47.512 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:47 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:47.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:47 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:47.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:47 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:47.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:47 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:47.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:47 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:47.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:47 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:47.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:47 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:47.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:47.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:47.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:48.078 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:47.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:48.407 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:48 smithi019 ceph-mon[29386]: pgmap v780: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 470 op/s 2024-03-25T09:34:48.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:48 smithi040 ceph-mon[33094]: pgmap v780: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 470 op/s 2024-03-25T09:34:48.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:48.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:48.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:48.510 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:48 smithi059 ceph-mon[32732]: pgmap v780: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 470 op/s 2024-03-25T09:34:49.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:49.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:49.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:50.299 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:50.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 5/s 2/s 144 KiB/s 57 KiB/s 3.10 ms 348.06 us 2024-03-25T09:34:50.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 5/s 2/s 118 KiB/s 87 KiB/s 3.59 ms 389.18 us 2024-03-25T09:34:50.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 4/s 3/s 97 KiB/s 66 KiB/s 3.25 ms 334.45 us 2024-03-25T09:34:50.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 3/s 93 KiB/s 101 KiB/s 3.06 ms 392.75 us 2024-03-25T09:34:50.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 4/s 3/s 90 KiB/s 62 KiB/s 3.49 ms 313.47 us 2024-03-25T09:34:50.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 2/s 112 KiB/s 34 KiB/s 3.19 ms 411.06 us 2024-03-25T09:34:50.299 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 2/s 87 KiB/s 62 KiB/s 3.19 ms 309.74 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 3/s 76 KiB/s 57 KiB/s 2.97 ms 321.87 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 4/s 3/s 91 KiB/s 84 KiB/s 3.01 ms 319.58 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 4/s 3/s 80 KiB/s 84 KiB/s 3.89 ms 390.84 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 4/s 3/s 80 KiB/s 82 KiB/s 3.48 ms 349.91 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 4/s 3/s 94 KiB/s 70 KiB/s 3.17 ms 323.64 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 3/s 98 KiB/s 69 KiB/s 3.31 ms 340.26 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 4/s 4/s 114 KiB/s 78 KiB/s 3.03 ms 318.23 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 3/s 66 KiB/s 53 KiB/s 2.92 ms 340.39 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 4/s 3/s 102 KiB/s 83 KiB/s 2.88 ms 327.88 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 4/s 3/s 63 KiB/s 56 KiB/s 3.08 ms 329.03 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 4/s 3/s 90 KiB/s 95 KiB/s 2.77 ms 382.53 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 109 KiB/s 75 KiB/s 2.91 ms 395.90 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 3/s 3/s 86 KiB/s 90 KiB/s 2.93 ms 311.57 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 3/s 68 KiB/s 43 KiB/s 2.60 ms 320.55 us 2024-03-25T09:34:50.300 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 3/s 4/s 64 KiB/s 67 KiB/s 2.69 ms 401.91 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 3/s 3/s 88 KiB/s 44 KiB/s 2.68 ms 422.36 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 3/s 73 KiB/s 66 KiB/s 2.74 ms 317.95 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 3/s 3/s 75 KiB/s 78 KiB/s 3.15 ms 335.47 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 3/s 3/s 97 KiB/s 58 KiB/s 3.24 ms 371.71 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 3/s 69 KiB/s 71 KiB/s 3.56 ms 449.87 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 3/s 3/s 70 KiB/s 66 KiB/s 3.82 ms 371.49 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 4/s 49 KiB/s 109 KiB/s 3.10 ms 347.41 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 3/s 3/s 66 KiB/s 90 KiB/s 2.81 ms 341.76 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 4/s 78 KiB/s 74 KiB/s 3.99 ms 326.56 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 4/s 99 KiB/s 99 KiB/s 2.92 ms 322.17 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 3/s 69 KiB/s 67 KiB/s 3.20 ms 417.96 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 3/s 3/s 85 KiB/s 67 KiB/s 3.20 ms 388.71 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 3/s 3/s 67 KiB/s 70 KiB/s 2.68 ms 317.78 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 4/s 73 KiB/s 98 KiB/s 3.12 ms 341.59 us 2024-03-25T09:34:50.301 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 3/s 3/s 73 KiB/s 96 KiB/s 2.86 ms 344.63 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 3/s 4/s 93 KiB/s 78 KiB/s 3.45 ms 416.22 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 3/s 4/s 75 KiB/s 83 KiB/s 2.91 ms 473.58 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 3/s 4/s 56 KiB/s 85 KiB/s 3.43 ms 338.28 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 4/s 70 KiB/s 87 KiB/s 2.93 ms 285.89 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 4/s 74 KiB/s 114 KiB/s 3.01 ms 442.25 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 3/s 58 KiB/s 73 KiB/s 2.58 ms 343.72 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 5/s 80 KiB/s 103 KiB/s 3.58 ms 407.38 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 3/s 74 KiB/s 77 KiB/s 2.89 ms 555.40 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 4/s 60 KiB/s 90 KiB/s 2.57 ms 331.52 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 55 KiB/s 78 KiB/s 3.09 ms 343.77 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 3/s 61 KiB/s 83 KiB/s 2.81 ms 399.89 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 4/s 70 KiB/s 93 KiB/s 2.96 ms 493.18 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 3/s 5/s 78 KiB/s 110 KiB/s 2.62 ms 336.91 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 4/s 58 KiB/s 101 KiB/s 2.89 ms 330.12 us 2024-03-25T09:34:50.302 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 4/s 58 KiB/s 97 KiB/s 2.84 ms 336.38 us 2024-03-25T09:34:50.303 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 3/s 52 KiB/s 58 KiB/s 3.75 ms 366.23 us 2024-03-25T09:34:50.303 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 2/s 4/s 83 KiB/s 104 KiB/s 2.90 ms 357.30 us 2024-03-25T09:34:50.303 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 2/s 4/s 69 KiB/s 102 KiB/s 3.13 ms 331.25 us 2024-03-25T09:34:50.303 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 2/s 4/s 65 KiB/s 70 KiB/s 3.50 ms 332.90 us 2024-03-25T09:34:50.303 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 2/s 4/s 27 KiB/s 85 KiB/s 4.54 ms 396.38 us 2024-03-25T09:34:50.303 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 2/s 5/s 42 KiB/s 123 KiB/s 3.29 ms 409.15 us 2024-03-25T09:34:50.303 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 2/s 4/s 50 KiB/s 80 KiB/s 2.98 ms 391.34 us 2024-03-25T09:34:50.303 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 2/s 4/s 51 KiB/s 72 KiB/s 3.32 ms 297.07 us 2024-03-25T09:34:50.303 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:50.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:50 smithi019 ceph-mon[29386]: pgmap v781: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 453 op/s 2024-03-25T09:34:50.510 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:50 smithi059 ceph-mon[32732]: pgmap v781: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 453 op/s 2024-03-25T09:34:50.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:50 smithi040 ceph-mon[33094]: pgmap v781: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 453 op/s 2024-03-25T09:34:50.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:50.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:50.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:51.390 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:51.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:51.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:51.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:51.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:51.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:51.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:51.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-mon[29386]: pgmap v782: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 441 op/s 2024-03-25T09:34:51.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 807 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:51.411 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:51 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:51.411 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:51 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:51.411 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:51 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:51.411 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:51 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:51.411 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:51 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:51.412 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:51 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:51.412 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:51 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:51.412 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:51 smithi059 ceph-mon[32732]: pgmap v782: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 441 op/s 2024-03-25T09:34:51.412 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:51 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 807 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:51 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:51 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:51 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:51 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:51 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:51 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:51 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:51 smithi040 ceph-mon[33094]: pgmap v782: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 441 op/s 2024-03-25T09:34:51.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:51 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 807 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:34:51.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:51.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:51.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:52.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:53.418 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:52.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:53.418 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:53.418 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:53.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:53.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:53.660 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:53.779 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:53.780 INFO:tasks.workunit.client.3.smithi129.stdout:nvmeof-fio-test: (groupid=0, jobs=1): err= 0: pid=48542: Mon Mar 25 09:34:53 2024 2024-03-25T09:34:53.780 INFO:tasks.workunit.client.3.smithi129.stdout: read: IOPS=280, BW=6848KiB/s (7012kB/s)(4012MiB/600004msec) 2024-03-25T09:34:53.780 INFO:tasks.workunit.client.3.smithi129.stdout: clat (usec): min=78, max=22050, avg=776.99, stdev=269.90 2024-03-25T09:34:53.780 INFO:tasks.workunit.client.3.smithi129.stdout: lat (usec): min=78, max=22050, avg=777.34, stdev=269.91 2024-03-25T09:34:53.780 INFO:tasks.workunit.client.3.smithi129.stdout: clat percentiles (usec): 2024-03-25T09:34:53.780 INFO:tasks.workunit.client.3.smithi129.stdout: | 1.00th=[ 445], 5.00th=[ 502], 10.00th=[ 545], 20.00th=[ 619], 2024-03-25T09:34:53.780 INFO:tasks.workunit.client.3.smithi129.stdout: | 30.00th=[ 668], 40.00th=[ 709], 50.00th=[ 750], 60.00th=[ 791], 2024-03-25T09:34:53.780 INFO:tasks.workunit.client.3.smithi129.stdout: | 70.00th=[ 832], 80.00th=[ 881], 90.00th=[ 971], 95.00th=[ 1074], 2024-03-25T09:34:53.780 INFO:tasks.workunit.client.3.smithi129.stdout: | 99.00th=[ 2180], 99.50th=[ 2540], 99.90th=[ 2835], 99.95th=[ 2966], 2024-03-25T09:34:53.780 INFO:tasks.workunit.client.3.smithi129.stdout: | 99.99th=[ 5211] 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: bw ( KiB/s): min= 8, max=16720, per=100.00%, avg=7133.01, stdev=2343.54, samples=1152 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: iops : min= 2, max= 534, avg=291.92, stdev=80.23, samples=1152 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: write: IOPS=280, BW=6832KiB/s (6996kB/s)(4003MiB/600004msec); 0 zone resets 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: clat (usec): min=1037, max=13772k, avg=2695.22, stdev=35196.77 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: lat (usec): min=1045, max=13772k, avg=2779.14, stdev=35196.86 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: clat percentiles (usec): 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: | 1.00th=[ 1287], 5.00th=[ 1434], 10.00th=[ 1565], 20.00th=[ 1795], 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: | 30.00th=[ 1991], 40.00th=[ 2212], 50.00th=[ 2409], 60.00th=[ 2606], 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: | 70.00th=[ 2868], 80.00th=[ 3130], 90.00th=[ 3523], 95.00th=[ 3916], 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: | 99.00th=[ 4752], 99.50th=[ 5145], 99.90th=[ 5866], 99.95th=[ 6783], 2024-03-25T09:34:53.781 INFO:tasks.workunit.client.3.smithi129.stdout: | 99.99th=[985662] 2024-03-25T09:34:53.782 INFO:tasks.workunit.client.3.smithi129.stdout: bw ( KiB/s): min= 8, max=16864, per=100.00%, avg=7111.28, stdev=2292.42, samples=1153 2024-03-25T09:34:53.782 INFO:tasks.workunit.client.3.smithi129.stdout: iops : min= 2, max= 512, avg=291.54, stdev=76.75, samples=1153 2024-03-25T09:34:53.782 INFO:tasks.workunit.client.3.smithi129.stdout: lat (usec) : 100=0.01%, 250=0.07%, 500=2.26%, 750=22.55%, 1000=21.11% 2024-03-25T09:34:53.782 INFO:tasks.workunit.client.3.smithi129.stdout: lat (msec) : 2=18.54%, 4=33.35%, 10=2.12%, 20=0.01%, 50=0.01% 2024-03-25T09:34:53.782 INFO:tasks.workunit.client.3.smithi129.stdout: lat (msec) : 250=0.01%, 1000=0.01%, 2000=0.01%, >=2000=0.01% 2024-03-25T09:34:53.782 INFO:tasks.workunit.client.3.smithi129.stdout: cpu : usr=2.78%, sys=1.30%, ctx=336506, majf=0, minf=4674 2024-03-25T09:34:53.782 INFO:tasks.workunit.client.3.smithi129.stdout: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 2024-03-25T09:34:53.782 INFO:tasks.workunit.client.3.smithi129.stdout: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 2024-03-25T09:34:53.782 INFO:tasks.workunit.client.3.smithi129.stdout: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 2024-03-25T09:34:53.782 INFO:tasks.workunit.client.3.smithi129.stdout: issued rwts: total=168212,168125,0,0 short=0,0,0,0 dropped=0,0,0,0 2024-03-25T09:34:53.783 INFO:tasks.workunit.client.3.smithi129.stdout: latency : target=0, window=0, percentile=100.00%, depth=1 2024-03-25T09:34:53.783 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:53.783 INFO:tasks.workunit.client.3.smithi129.stdout:Run status group 0 (all jobs): 2024-03-25T09:34:53.783 INFO:tasks.workunit.client.3.smithi129.stdout: READ: bw=6848KiB/s (7012kB/s), 6848KiB/s-6848KiB/s (7012kB/s-7012kB/s), io=4012MiB (4207MB), run=600004-600004msec 2024-03-25T09:34:53.783 INFO:tasks.workunit.client.3.smithi129.stdout: WRITE: bw=6832KiB/s (6996kB/s), 6832KiB/s-6832KiB/s (6996kB/s-6996kB/s), io=4003MiB (4198MB), run=600004-600004msec 2024-03-25T09:34:53.783 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:53.783 INFO:tasks.workunit.client.3.smithi129.stdout:Disk stats (read/write): 2024-03-25T09:34:53.783 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n1: ios=2736/2870, merge=0/0, ticks=1902/7985, in_queue=9887, util=2.57% 2024-03-25T09:34:53.783 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n1: ios=2807/2799, merge=0/0, ticks=2147/6553, in_queue=8700, util=2.38% 2024-03-25T09:34:53.783 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n1: ios=2760/2846, merge=0/0, ticks=2094/7281, in_queue=9375, util=2.49% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n2: ios=2849/2757, merge=0/0, ticks=2043/6503, in_queue=8546, util=2.35% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n2: ios=2794/2812, merge=0/0, ticks=2085/6669, in_queue=8754, util=2.39% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n2: ios=2792/2814, merge=0/0, ticks=2115/7860, in_queue=9975, util=2.59% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n3: ios=2814/2792, merge=0/0, ticks=2077/6881, in_queue=8958, util=2.42% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n3: ios=2834/2772, merge=0/0, ticks=2118/8281, in_queue=10399, util=2.66% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n3: ios=2790/2816, merge=0/0, ticks=1991/7174, in_queue=9165, util=2.46% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n4: ios=2771/2835, merge=0/0, ticks=2101/7723, in_queue=9824, util=2.57% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n4: ios=2772/2834, merge=0/0, ticks=1979/7463, in_queue=9442, util=2.50% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n4: ios=2835/2771, merge=0/0, ticks=2098/7699, in_queue=9797, util=2.56% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n5: ios=2861/2745, merge=0/0, ticks=2104/6879, in_queue=8983, util=2.43% 2024-03-25T09:34:53.784 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n5: ios=2798/2808, merge=0/0, ticks=2009/7146, in_queue=9155, util=2.46% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n5: ios=2815/2792, merge=0/0, ticks=2107/7359, in_queue=9466, util=26.61% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n6: ios=2767/2839, merge=0/0, ticks=2202/7110, in_queue=9312, util=2.48% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n6: ios=2813/2793, merge=0/0, ticks=2098/8432, in_queue=10530, util=2.69% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n6: ios=2853/2753, merge=0/0, ticks=2085/6519, in_queue=8604, util=2.37% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n7: ios=2865/2741, merge=0/0, ticks=2080/9038, in_queue=11118, util=2.78% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n7: ios=2822/2784, merge=0/0, ticks=2079/7089, in_queue=9168, util=2.46% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n7: ios=2795/2811, merge=0/0, ticks=2079/6598, in_queue=8677, util=2.38% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n8: ios=2786/2820, merge=0/0, ticks=2072/6809, in_queue=8881, util=2.41% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n8: ios=2768/2838, merge=0/0, ticks=2068/6888, in_queue=8956, util=2.43% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n8: ios=2809/2797, merge=0/0, ticks=2014/7645, in_queue=9659, util=2.54% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n9: ios=2771/2835, merge=0/0, ticks=2046/6664, in_queue=8710, util=2.38% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n9: ios=2888/2718, merge=0/0, ticks=2063/7704, in_queue=9767, util=2.56% 2024-03-25T09:34:53.785 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n9: ios=2842/2764, merge=0/0, ticks=2172/6972, in_queue=9144, util=2.46% 2024-03-25T09:34:53.786 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n10: ios=2771/2835, merge=0/0, ticks=2063/7731, in_queue=9794, util=2.57% 2024-03-25T09:34:53.786 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n10: ios=2724/2882, merge=0/0, ticks=2008/7255, in_queue=9263, util=2.48% 2024-03-25T09:34:53.786 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n10: ios=2844/2762, merge=0/0, ticks=2007/6622, in_queue=8629, util=2.37% 2024-03-25T09:34:53.786 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n11: ios=2774/2832, merge=0/0, ticks=2013/7429, in_queue=9442, util=2.51% 2024-03-25T09:34:53.786 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n11: ios=2823/2783, merge=0/0, ticks=2128/7016, in_queue=9144, util=2.46% 2024-03-25T09:34:53.786 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n11: ios=2823/2783, merge=0/0, ticks=2118/8081, in_queue=10199, util=2.63% 2024-03-25T09:34:53.786 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n12: ios=2796/2810, merge=0/0, ticks=2009/7250, in_queue=9259, util=2.48% 2024-03-25T09:34:53.786 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n12: ios=2770/2836, merge=0/0, ticks=2000/7962, in_queue=9962, util=2.60% 2024-03-25T09:34:53.786 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n12: ios=2789/2816, merge=0/0, ticks=2101/6330, in_queue=8431, util=2.34% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n13: ios=2840/2765, merge=0/0, ticks=2023/7668, in_queue=9691, util=2.55% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n13: ios=2857/2748, merge=0/0, ticks=2066/6753, in_queue=8819, util=2.40% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n13: ios=2822/2783, merge=0/0, ticks=2070/6643, in_queue=8713, util=2.39% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n14: ios=2790/2815, merge=0/0, ticks=2010/7033, in_queue=9043, util=2.44% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n14: ios=2808/2797, merge=0/0, ticks=2064/6991, in_queue=9055, util=2.44% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n14: ios=2880/2725, merge=0/0, ticks=2115/7243, in_queue=9358, util=2.50% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n15: ios=2846/2759, merge=0/0, ticks=2122/7449, in_queue=9571, util=2.53% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n15: ios=2761/2844, merge=0/0, ticks=2060/7491, in_queue=9551, util=2.53% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n15: ios=2779/2826, merge=0/0, ticks=2099/6716, in_queue=8815, util=2.41% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n16: ios=2797/2808, merge=0/0, ticks=2167/8681, in_queue=10848, util=2.75% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n16: ios=2809/2796, merge=0/0, ticks=2058/7076, in_queue=9134, util=2.46% 2024-03-25T09:34:53.787 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n16: ios=2872/2733, merge=0/0, ticks=2200/7329, in_queue=9529, util=2.53% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n17: ios=2798/2807, merge=0/0, ticks=1965/7160, in_queue=9125, util=2.46% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n17: ios=2814/2791, merge=0/0, ticks=2055/6447, in_queue=8502, util=2.35% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n17: ios=2737/2868, merge=0/0, ticks=1864/8055, in_queue=9919, util=2.59% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n18: ios=2811/2794, merge=0/0, ticks=2016/6754, in_queue=8770, util=2.40% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n18: ios=2768/2837, merge=0/0, ticks=2021/7790, in_queue=9811, util=2.57% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n18: ios=2742/2863, merge=0/0, ticks=2060/7078, in_queue=9138, util=2.46% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n19: ios=2800/2805, merge=0/0, ticks=2170/7388, in_queue=9558, util=2.53% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n19: ios=2818/2787, merge=0/0, ticks=2085/6440, in_queue=8525, util=2.36% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n19: ios=2838/2767, merge=0/0, ticks=2110/6704, in_queue=8814, util=2.41% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme5n20: ios=2714/2891, merge=0/0, ticks=1847/6917, in_queue=8764, util=2.40% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme2n20: ios=2799/2806, merge=0/0, ticks=2054/6436, in_queue=8490, util=2.36% 2024-03-25T09:34:53.788 INFO:tasks.workunit.client.3.smithi129.stdout: nvme8n20: ios=2790/2815, merge=0/0, ticks=1976/7258, in_queue=9234, util=2.48% 2024-03-25T09:34:53.790 INFO:tasks.workunit.client.3.smithi129.stderr:+ wait 2024-03-25T09:34:54.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:54 smithi019 ceph-mon[29386]: pgmap v783: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 442 op/s 2024-03-25T09:34:54.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:54 smithi059 ceph-mon[32732]: pgmap v783: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 442 op/s 2024-03-25T09:34:54.512 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:54 smithi040 ceph-mon[33094]: pgmap v783: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 442 op/s 2024-03-25T09:34:54.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:54.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:54.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:55.303 INFO:tasks.workunit.client.3.smithi129.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-25T09:34:55.303 INFO:tasks.workunit.client.3.smithi129.stdout:myimage52 5/s 7/s 91 KiB/s 172 KiB/s 2.64 ms 449.11 us 2024-03-25T09:34:55.303 INFO:tasks.workunit.client.3.smithi129.stdout:myimage22 5/s 7/s 65 KiB/s 146 KiB/s 2.72 ms 362.13 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage10 4/s 3/s 102 KiB/s 55 KiB/s 3.00 ms 301.56 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage42 4/s 2/s 91 KiB/s 57 KiB/s 3.01 ms 362.65 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage2 4/s 2/s 90 KiB/s 58 KiB/s 2.90 ms 376.66 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage14 4/s 3/s 82 KiB/s 69 KiB/s 3.27 ms 415.98 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage4 4/s 2/s 77 KiB/s 47 KiB/s 3.42 ms 318.53 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage5 4/s 6/s 86 KiB/s 138 KiB/s 2.94 ms 515.17 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage21 4/s 7/s 76 KiB/s 164 KiB/s 3.02 ms 373.63 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage41 4/s 6/s 98 KiB/s 154 KiB/s 3.11 ms 455.54 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage1 4/s 3/s 68 KiB/s 62 KiB/s 2.82 ms 344.80 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage30 4/s 3/s 100 KiB/s 52 KiB/s 3.01 ms 283.38 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage32 4/s 4/s 102 KiB/s 86 KiB/s 3.45 ms 323.05 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage47 4/s 2/s 95 KiB/s 44 KiB/s 2.55 ms 312.93 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage54 4/s 7/s 84 KiB/s 165 KiB/s 2.68 ms 423.91 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage9 4/s 3/s 67 KiB/s 57 KiB/s 3.10 ms 333.80 us 2024-03-25T09:34:55.304 INFO:tasks.workunit.client.3.smithi129.stdout:myimage28 4/s 7/s 84 KiB/s 171 KiB/s 3.09 ms 485.79 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage57 4/s 3/s 100 KiB/s 96 KiB/s 3.05 ms 389.10 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage15 4/s 3/s 92 KiB/s 53 KiB/s 2.66 ms 292.29 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage23 4/s 3/s 77 KiB/s 52 KiB/s 3.14 ms 319.73 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage48 4/s 7/s 82 KiB/s 165 KiB/s 2.76 ms 422.92 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage49 4/s 3/s 62 KiB/s 81 KiB/s 3.28 ms 354.71 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage7 3/s 7/s 66 KiB/s 160 KiB/s 3.11 ms 524.19 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage27 3/s 7/s 67 KiB/s 186 KiB/s 4.24 ms 501.88 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage6 3/s 3/s 92 KiB/s 42 KiB/s 3.58 ms 340.01 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage12 3/s 3/s 86 KiB/s 54 KiB/s 3.04 ms 312.94 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage13 3/s 3/s 106 KiB/s 82 KiB/s 3.19 ms 401.37 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage29 3/s 3/s 70 KiB/s 62 KiB/s 2.96 ms 325.87 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage43 3/s 3/s 93 KiB/s 66 KiB/s 3.25 ms 314.50 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage56 3/s 3/s 103 KiB/s 74 KiB/s 3.23 ms 391.11 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage11 3/s 3/s 102 KiB/s 73 KiB/s 3.15 ms 320.29 us 2024-03-25T09:34:55.305 INFO:tasks.workunit.client.3.smithi129.stdout:myimage40 3/s 7/s 82 KiB/s 166 KiB/s 2.81 ms 444.17 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage51 3/s 3/s 58 KiB/s 82 KiB/s 3.18 ms 353.02 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage53 3/s 3/s 74 KiB/s 76 KiB/s 2.85 ms 381.71 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage55 3/s 7/s 46 KiB/s 196 KiB/s 2.80 ms 505.01 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage58 3/s 7/s 73 KiB/s 146 KiB/s 3.20 ms 462.83 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage3 3/s 3/s 48 KiB/s 70 KiB/s 3.08 ms 351.98 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage18 3/s 2/s 48 KiB/s 42 KiB/s 2.91 ms 327.11 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage26 3/s 3/s 67 KiB/s 72 KiB/s 3.04 ms 387.22 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage36 3/s 4/s 70 KiB/s 97 KiB/s 4.01 ms 338.25 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage46 3/s 3/s 73 KiB/s 52 KiB/s 2.88 ms 323.41 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage59 3/s 8/s 74 KiB/s 220 KiB/s 2.84 ms 438.47 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage25 3/s 3/s 51 KiB/s 67 KiB/s 3.26 ms 350.35 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage33 3/s 3/s 77 KiB/s 86 KiB/s 3.00 ms 293.58 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage60 3/s 8/s 53 KiB/s 186 KiB/s 2.66 ms 424.71 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage20 3/s 5/s 44 KiB/s 121 KiB/s 2.61 ms 342.65 us 2024-03-25T09:34:55.306 INFO:tasks.workunit.client.3.smithi129.stdout:myimage39 3/s 4/s 68 KiB/s 106 KiB/s 2.52 ms 332.66 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage31 3/s 3/s 66 KiB/s 73 KiB/s 3.41 ms 517.78 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage50 3/s 8/s 61 KiB/s 182 KiB/s 2.72 ms 457.28 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage37 3/s 8/s 65 KiB/s 194 KiB/s 3.35 ms 448.12 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage44 3/s 8/s 42 KiB/s 170 KiB/s 3.54 ms 554.21 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage35 3/s 3/s 55 KiB/s 54 KiB/s 3.69 ms 348.27 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage19 2/s 4/s 72 KiB/s 81 KiB/s 2.89 ms 297.46 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage8 2/s 7/s 61 KiB/s 184 KiB/s 2.89 ms 427.73 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage38 2/s 9/s 54 KiB/s 241 KiB/s 3.06 ms 457.32 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage34 2/s 7/s 84 KiB/s 152 KiB/s 2.91 ms 376.73 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage16 2/s 4/s 54 KiB/s 108 KiB/s 2.97 ms 358.09 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage24 2/s 4/s 58 KiB/s 94 KiB/s 2.77 ms 376.01 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage17 2/s 8/s 38 KiB/s 210 KiB/s 2.71 ms 640.81 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout:myimage45 2/s 5/s 32 KiB/s 107 KiB/s 3.35 ms 367.81 us 2024-03-25T09:34:55.307 INFO:tasks.workunit.client.3.smithi129.stdout: 2024-03-25T09:34:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:56.407 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:56 smithi019 ceph-mon[29386]: pgmap v784: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 458 op/s 2024-03-25T09:34:56.510 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:56 smithi059 ceph-mon[32732]: pgmap v784: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 458 op/s 2024-03-25T09:34:56.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:56 smithi040 ceph-mon[33094]: pgmap v784: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 458 op/s 2024-03-25T09:34:56.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:56.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:56.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:57 smithi019 ceph-mon[29386]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:57 smithi019 ceph-mon[29386]: { 2024-03-25T09:34:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:57 smithi019 ceph-mon[29386]: "prefix": "rbd perf image stats", 2024-03-25T09:34:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:57 smithi019 ceph-mon[29386]: "pool_spec": "mypool", 2024-03-25T09:34:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:57 smithi019 ceph-mon[29386]: "sort_by": "write_ops", 2024-03-25T09:34:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:57 smithi019 ceph-mon[29386]: "format": "json" 2024-03-25T09:34:57.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:57 smithi019 ceph-mon[29386]: }"]: dispatch 2024-03-25T09:34:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:57 smithi059 ceph-mon[32732]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:57 smithi059 ceph-mon[32732]: { 2024-03-25T09:34:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:57 smithi059 ceph-mon[32732]: "prefix": "rbd perf image stats", 2024-03-25T09:34:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:57 smithi059 ceph-mon[32732]: "pool_spec": "mypool", 2024-03-25T09:34:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:57 smithi059 ceph-mon[32732]: "sort_by": "write_ops", 2024-03-25T09:34:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:57 smithi059 ceph-mon[32732]: "format": "json" 2024-03-25T09:34:57.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:57 smithi059 ceph-mon[32732]: }"]: dispatch 2024-03-25T09:34:57.512 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:57 smithi040 ceph-mon[33094]: from='client.24934 -' entity='client.admin' cmd=[ 2024-03-25T09:34:57.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:57 smithi040 ceph-mon[33094]: { 2024-03-25T09:34:57.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:57 smithi040 ceph-mon[33094]: "prefix": "rbd perf image stats", 2024-03-25T09:34:57.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:57 smithi040 ceph-mon[33094]: "pool_spec": "mypool", 2024-03-25T09:34:57.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:57 smithi040 ceph-mon[33094]: "sort_by": "write_ops", 2024-03-25T09:34:57.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:57 smithi040 ceph-mon[33094]: "format": "json" 2024-03-25T09:34:57.513 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:57 smithi040 ceph-mon[33094]: }"]: dispatch 2024-03-25T09:34:57.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:57.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:57.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:58.084 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:34:57.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:34:58.407 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:58 smithi019 ceph-mon[29386]: pgmap v785: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 4.3 MiB/s wr, 531 op/s 2024-03-25T09:34:58.414 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:58 smithi040 ceph-mon[33094]: pgmap v785: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 4.3 MiB/s wr, 531 op/s 2024-03-25T09:34:58.414 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:58.414 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:34:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:58.415 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:34:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:34:58.511 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:58 smithi059 ceph-mon[32732]: pgmap v785: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 4.3 MiB/s wr, 531 op/s 2024-03-25T09:34:59.408 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:34:59 smithi019 ceph-mon[29386]: pgmap v786: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 3.3 MiB/s wr, 439 op/s 2024-03-25T09:34:59.510 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:34:59 smithi059 ceph-mon[32732]: pgmap v786: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 3.3 MiB/s wr, 439 op/s 2024-03-25T09:34:59.512 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:34:59 smithi040 ceph-mon[33094]: pgmap v786: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 3.3 MiB/s wr, 439 op/s 2024-03-25T09:34:59.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:34:59.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:34:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:34:59.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:34:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:00.316 INFO:tasks.workunit.client.3.smithi129.stdout:[nvmeo.fio] fio test successful! 2024-03-25T09:35:00.317 INFO:tasks.workunit.client.3.smithi129.stderr:+ echo '[nvmeo.fio] fio test successful!' 2024-03-25T09:35:00.317 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-25T09:35:00.317 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.3/client.3/tmp 2024-03-25T09:35:00.351 INFO:tasks.workunit:Stopping ['rbd/nvmeof_fio_test.sh --rbd_iostat'] on client.3... 2024-03-25T09:35:00.351 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.3 /home/ubuntu/cephtest/clone.client.3 2024-03-25T09:35:00.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:00 smithi019 ceph-mon[29386]: Health check update: 4 slow ops, oldest one blocked for 812 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:35:00.676 DEBUG:teuthology.parallel:result is None 2024-03-25T09:35:00.676 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.3/client.3 2024-03-25T09:35:00.703 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.3/client.3 2024-03-25T09:35:00.703 DEBUG:teuthology.orchestra.run.smithi129:> rmdir -- /home/ubuntu/cephtest/mnt.3 2024-03-25T09:35:00.757 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.3/client.3 2024-03-25T09:35:00.757 DEBUG:teuthology.run_tasks:Unwinding manager nvmeof.thrash 2024-03-25T09:35:00.768 INFO:tasks.nvmeof:joining nvmeof.thrash 2024-03-25T09:35:00.768 ERROR:teuthology.run_tasks:Manager failed: nvmeof.thrash Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_vallariag_ceph_fb51d73931124de2f09457eaa7f1219e2aeb2c0d/qa/tasks/nvmeof.py", line 282, in end raise RuntimeError('error during thrashing') RuntimeError: error during thrashing 2024-03-25T09:35:00.768 DEBUG:teuthology.run_tasks:Unwinding manager nvmeof 2024-03-25T09:35:00.777 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-25T09:35:00.786 INFO:tasks.cephadm:Teardown begin 2024-03-25T09:35:00.786 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_vallariag_ceph_fb51d73931124de2f09457eaa7f1219e2aeb2c0d/qa/tasks/cephadm.py", line 1807, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_vallariag_ceph_fb51d73931124de2f09457eaa7f1219e2aeb2c0d/qa/tasks/nvmeof.py", line 282, in end raise RuntimeError('error during thrashing') RuntimeError: error during thrashing 2024-03-25T09:35:00.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:35:00.792 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:00 smithi040 ceph-mon[33094]: Health check update: 4 slow ops, oldest one blocked for 812 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:35:00.792 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:00 smithi059 ceph-mon[32732]: Health check update: 4 slow ops, oldest one blocked for 812 sec, mon.c has slow ops (SLOW_OPS) 2024-03-25T09:35:00.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:00.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:00.793 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:00.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:35:00.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:35:00.882 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:35:00.908 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-25T09:35:00.909 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-25T09:35:00.923 DEBUG:teuthology.orchestra.run.smithi040:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-25T09:35:00.936 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-25T09:35:00.953 DEBUG:teuthology.orchestra.run.smithi129:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-25T09:35:00.967 INFO:tasks.cephadm:Stopping all daemons... 2024-03-25T09:35:00.967 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-25T09:35:00.967 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.a 2024-03-25T09:35:01.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 systemd[1]: Stopping Ceph mon.a for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:01.608 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:01.608 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:01.608 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:01.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.266+0000 7f8692419700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:01.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.266+0000 7f8692419700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-25T09:35:01.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f8692419700 time 2024-03-25T09:35:01.266904+0000 2024-03-25T09:35:01.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:01.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:01.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f869a8783db] 2024-03-25T09:35:01.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f869a8785a1] 2024-03-25T09:35:01.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x5652f2865cb6] 2024-03-25T09:35:01.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x5652f294dcd2] 2024-03-25T09:35:01.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 5: (Monitor::shutdown()+0x2bc) [0x5652f283653c] 2024-03-25T09:35:01.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 6: (SignalHandler::entry()+0x659) [0x5652f2b18cb9] 2024-03-25T09:35:01.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f869805f1ca] 2024-03-25T09:35:01.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 8: clone() 2024-03-25T09:35:01.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.267+0000 7f8692419700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f8692419700 time 2024-03-25T09:35:01.266904+0000 2024-03-25T09:35:01.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f869a8783db] 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f869a8785a1] 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x5652f2865cb6] 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x5652f294dcd2] 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 5: (Monitor::shutdown()+0x2bc) [0x5652f283653c] 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 6: (SignalHandler::entry()+0x659) [0x5652f2b18cb9] 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f869805f1ca] 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 8: clone() 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: *** Caught signal (Aborted) ** 2024-03-25T09:35:01.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: in thread 7f8692419700 thread_name:signal_handler 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8698069d20] 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2: gsignal() 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 3: abort() 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f869a878435] 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f869a8785a1] 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x5652f2865cb6] 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x5652f294dcd2] 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 8: (Monitor::shutdown()+0x2bc) [0x5652f283653c] 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 9: (SignalHandler::entry()+0x659) [0x5652f2b18cb9] 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f869805f1ca] 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 11: clone() 2024-03-25T09:35:01.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.269+0000 7f8692419700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: in thread 7f8692419700 thread_name:signal_handler 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8698069d20] 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2: gsignal() 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 3: abort() 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f869a878435] 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f869a8785a1] 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x5652f2865cb6] 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x5652f294dcd2] 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 8: (Monitor::shutdown()+0x2bc) [0x5652f283653c] 2024-03-25T09:35:01.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 9: (SignalHandler::entry()+0x659) [0x5652f2b18cb9] 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f869805f1ca] 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 11: clone() 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: -31> 2024-03-25T09:35:01.266+0000 7f8692419700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: -30> 2024-03-25T09:35:01.266+0000 7f8692419700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: -1> 2024-03-25T09:35:01.267+0000 7f8692419700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f8692419700 time 2024-03-25T09:35:01.266904+0000 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:01.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f869a8783db] 2024-03-25T09:35:01.615 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f869a8785a1] 2024-03-25T09:35:01.615 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x5652f2865cb6] 2024-03-25T09:35:01.615 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x5652f294dcd2] 2024-03-25T09:35:01.615 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 5: (Monitor::shutdown()+0x2bc) [0x5652f283653c] 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 6: (SignalHandler::entry()+0x659) [0x5652f2b18cb9] 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f869805f1ca] 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 8: clone() 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 0> 2024-03-25T09:35:01.269+0000 7f8692419700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: in thread 7f8692419700 thread_name:signal_handler 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8698069d20] 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2: gsignal() 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 3: abort() 2024-03-25T09:35:01.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f869a878435] 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f869a8785a1] 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x5652f2865cb6] 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x5652f294dcd2] 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 8: (Monitor::shutdown()+0x2bc) [0x5652f283653c] 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 9: (SignalHandler::entry()+0x659) [0x5652f2b18cb9] 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f869805f1ca] 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 11: clone() 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: -31> 2024-03-25T09:35:01.266+0000 7f8692419700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: -30> 2024-03-25T09:35:01.266+0000 7f8692419700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-25T09:35:01.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: -1> 2024-03-25T09:35:01.267+0000 7f8692419700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f8692419700 time 2024-03-25T09:35:01.266904+0000 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f869a8783db] 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f869a8785a1] 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x5652f2865cb6] 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x5652f294dcd2] 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 5: (Monitor::shutdown()+0x2bc) [0x5652f283653c] 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 6: (SignalHandler::entry()+0x659) [0x5652f2b18cb9] 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f869805f1ca] 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 8: clone() 2024-03-25T09:35:01.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 0> 2024-03-25T09:35:01.269+0000 7f8692419700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: in thread 7f8692419700 thread_name:signal_handler 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8698069d20] 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2: gsignal() 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 3: abort() 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f869a878435] 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f869a8785a1] 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x5652f2865cb6] 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x5652f294dcd2] 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 8: (Monitor::shutdown()+0x2bc) [0x5652f283653c] 2024-03-25T09:35:01.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 9: (SignalHandler::entry()+0x659) [0x5652f2b18cb9] 2024-03-25T09:35:01.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f869805f1ca] 2024-03-25T09:35:01.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 11: clone() 2024-03-25T09:35:01.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:35:01.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a[29382]: 2024-03-25T09:35:01.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 podman[73949]: 2024-03-25 09:35:01.307224268 +0000 UTC m=+0.144092857 container died a34efeb6eefd58a0439146752455174ae3fb865a50b845af477cff7b691cfcfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=ceph-nvmeof-mon-47ea673, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-25T09:35:01.859 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 podman[73949]: 2024-03-25 09:35:01.85849958 +0000 UTC m=+0.695368168 container cleanup a34efeb6eefd58a0439146752455174ae3fb865a50b845af477cff7b691cfcfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307) 2024-03-25T09:35:01.859 INFO:journalctl@ceph.mon.a.smithi019.stdout:Mar 25 09:35:01 smithi019 bash[73949]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-a 2024-03-25T09:35:02.328 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.a.service' 2024-03-25T09:35:02.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:35:02.377 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-25T09:35:02.377 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-03-25T09:35:02.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.b 2024-03-25T09:35:02.667 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 systemd[1]: Stopping Ceph mon.b for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:02.668 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:02.668 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:02.668 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:02.943 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.667+0000 7ff9603af700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:02.943 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7ff9603af700 time 2024-03-25T09:35:02.668239+0000 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.667+0000 7ff9603af700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff96880e3db] 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7ff96880e5a1] 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x564a4cd93cb6] 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x564a4ce7bcd2] 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 5: (Monitor::shutdown()+0x2bc) [0x564a4cd6453c] 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 6: (SignalHandler::entry()+0x659) [0x564a4d046cb9] 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7ff965ff51ca] 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 8: clone() 2024-03-25T09:35:02.944 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.668+0000 7ff9603af700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7ff9603af700 time 2024-03-25T09:35:02.668239+0000 2024-03-25T09:35:02.945 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff96880e3db] 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7ff96880e5a1] 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x564a4cd93cb6] 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x564a4ce7bcd2] 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 5: (Monitor::shutdown()+0x2bc) [0x564a4cd6453c] 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 6: (SignalHandler::entry()+0x659) [0x564a4d046cb9] 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7ff965ff51ca] 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 8: clone() 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: *** Caught signal (Aborted) ** 2024-03-25T09:35:02.946 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: in thread 7ff9603af700 thread_name:signal_handler 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff965fffd20] 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2: gsignal() 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 3: abort() 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff96880e435] 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7ff96880e5a1] 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x564a4cd93cb6] 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x564a4ce7bcd2] 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 8: (Monitor::shutdown()+0x2bc) [0x564a4cd6453c] 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 9: (SignalHandler::entry()+0x659) [0x564a4d046cb9] 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7ff965ff51ca] 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 11: clone() 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.669+0000 7ff9603af700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:35:02.947 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: in thread 7ff9603af700 thread_name:signal_handler 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff965fffd20] 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2: gsignal() 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 3: abort() 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff96880e435] 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7ff96880e5a1] 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x564a4cd93cb6] 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x564a4ce7bcd2] 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 8: (Monitor::shutdown()+0x2bc) [0x564a4cd6453c] 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 9: (SignalHandler::entry()+0x659) [0x564a4d046cb9] 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7ff965ff51ca] 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 11: clone() 2024-03-25T09:35:02.948 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: -26> 2024-03-25T09:35:02.667+0000 7ff9603af700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: -25> 2024-03-25T09:35:02.667+0000 7ff9603af700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: -1> 2024-03-25T09:35:02.668+0000 7ff9603af700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7ff9603af700 time 2024-03-25T09:35:02.668239+0000 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff96880e3db] 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7ff96880e5a1] 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x564a4cd93cb6] 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x564a4ce7bcd2] 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 5: (Monitor::shutdown()+0x2bc) [0x564a4cd6453c] 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 6: (SignalHandler::entry()+0x659) [0x564a4d046cb9] 2024-03-25T09:35:02.949 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7ff965ff51ca] 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 8: clone() 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 0> 2024-03-25T09:35:02.669+0000 7ff9603af700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: in thread 7ff9603af700 thread_name:signal_handler 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff965fffd20] 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2: gsignal() 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 3: abort() 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff96880e435] 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7ff96880e5a1] 2024-03-25T09:35:02.950 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x564a4cd93cb6] 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x564a4ce7bcd2] 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 8: (Monitor::shutdown()+0x2bc) [0x564a4cd6453c] 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 9: (SignalHandler::entry()+0x659) [0x564a4d046cb9] 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7ff965ff51ca] 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 11: clone() 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: -26> 2024-03-25T09:35:02.667+0000 7ff9603af700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: -25> 2024-03-25T09:35:02.667+0000 7ff9603af700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: -1> 2024-03-25T09:35:02.668+0000 7ff9603af700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7ff9603af700 time 2024-03-25T09:35:02.668239+0000 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.951 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff96880e3db] 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7ff96880e5a1] 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x564a4cd93cb6] 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x564a4ce7bcd2] 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 5: (Monitor::shutdown()+0x2bc) [0x564a4cd6453c] 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 6: (SignalHandler::entry()+0x659) [0x564a4d046cb9] 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7ff965ff51ca] 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 8: clone() 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 0> 2024-03-25T09:35:02.669+0000 7ff9603af700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: in thread 7ff9603af700 thread_name:signal_handler 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff965fffd20] 2024-03-25T09:35:02.952 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2: gsignal() 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 3: abort() 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff96880e435] 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7ff96880e5a1] 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x564a4cd93cb6] 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x564a4ce7bcd2] 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 8: (Monitor::shutdown()+0x2bc) [0x564a4cd6453c] 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 9: (SignalHandler::entry()+0x659) [0x564a4d046cb9] 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7ff965ff51ca] 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 11: clone() 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b[33090]: 2024-03-25T09:35:02.953 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:02 smithi040 podman[57448]: 2024-03-25 09:35:02.708368468 +0000 UTC m=+0.138798159 container died 726d19e6d6722bc0943a457d3b28d5a993bf4c4f901ecb3e85e1a944f1919075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-47ea673, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, ceph=True) 2024-03-25T09:35:03.261 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:02.826+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:03 smithi040 podman[57448]: 2024-03-25 09:35:03.118178582 +0000 UTC m=+0.548608279 container cleanup 726d19e6d6722bc0943a457d3b28d5a993bf4c4f901ecb3e85e1a944f1919075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-47ea673, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307) 2024-03-25T09:35:03.263 INFO:journalctl@ceph.mon.b.smithi040.stdout:Mar 25 09:35:03 smithi040 bash[57448]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-b 2024-03-25T09:35:03.466 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.b.service' 2024-03-25T09:35:03.511 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:35:03.511 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-03-25T09:35:03.511 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-03-25T09:35:03.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.c 2024-03-25T09:35:03.809 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 systemd[1]: Stopping Ceph mon.c for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:03.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:03.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:03.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:04.093 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:03.809+0000 7f8929779700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:04.094 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:03.809+0000 7f8929779700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-25T09:35:04.094 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f8929779700 time 2024-03-25T09:35:03.810573+0000 2024-03-25T09:35:04.094 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:04.094 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:04.094 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8931bd83db] 2024-03-25T09:35:04.094 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f8931bd85a1] 2024-03-25T09:35:04.094 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x561ea5e05cb6] 2024-03-25T09:35:04.094 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x561ea5eedcd2] 2024-03-25T09:35:04.094 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 5: (Monitor::shutdown()+0x2bc) [0x561ea5dd653c] 2024-03-25T09:35:04.095 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 6: (SignalHandler::entry()+0x659) [0x561ea60b8cb9] 2024-03-25T09:35:04.095 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f892f3bf1ca] 2024-03-25T09:35:04.095 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 8: clone() 2024-03-25T09:35:04.095 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:03.810+0000 7f8929779700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f8929779700 time 2024-03-25T09:35:03.810573+0000 2024-03-25T09:35:04.096 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:04.096 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.096 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:04.096 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8931bd83db] 2024-03-25T09:35:04.096 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f8931bd85a1] 2024-03-25T09:35:04.096 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x561ea5e05cb6] 2024-03-25T09:35:04.096 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x561ea5eedcd2] 2024-03-25T09:35:04.096 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 5: (Monitor::shutdown()+0x2bc) [0x561ea5dd653c] 2024-03-25T09:35:04.096 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 6: (SignalHandler::entry()+0x659) [0x561ea60b8cb9] 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f892f3bf1ca] 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 8: clone() 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: *** Caught signal (Aborted) ** 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: in thread 7f8929779700 thread_name:signal_handler 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f892f3c9d20] 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2: gsignal() 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 3: abort() 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8931bd8435] 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f8931bd85a1] 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x561ea5e05cb6] 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x561ea5eedcd2] 2024-03-25T09:35:04.097 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 8: (Monitor::shutdown()+0x2bc) [0x561ea5dd653c] 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 9: (SignalHandler::entry()+0x659) [0x561ea60b8cb9] 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f892f3bf1ca] 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 11: clone() 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:03.812+0000 7f8929779700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: in thread 7f8929779700 thread_name:signal_handler 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f892f3c9d20] 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2: gsignal() 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 3: abort() 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8931bd8435] 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f8931bd85a1] 2024-03-25T09:35:04.098 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x561ea5e05cb6] 2024-03-25T09:35:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x561ea5eedcd2] 2024-03-25T09:35:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 8: (Monitor::shutdown()+0x2bc) [0x561ea5dd653c] 2024-03-25T09:35:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 9: (SignalHandler::entry()+0x659) [0x561ea60b8cb9] 2024-03-25T09:35:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f892f3bf1ca] 2024-03-25T09:35:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 11: clone() 2024-03-25T09:35:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:35:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -9434> 2024-03-25T09:34:17.823+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -8521> 2024-03-25T09:34:22.823+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -7628> 2024-03-25T09:34:27.823+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -6607> 2024-03-25T09:34:32.824+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -5714> 2024-03-25T09:34:37.824+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -4714> 2024-03-25T09:34:42.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -3720> 2024-03-25T09:34:47.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -2887> 2024-03-25T09:34:52.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -2001> 2024-03-25T09:34:57.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -61> 2024-03-25T09:35:02.826+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -26> 2024-03-25T09:35:03.809+0000 7f8929779700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -25> 2024-03-25T09:35:03.809+0000 7f8929779700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -1> 2024-03-25T09:35:03.810+0000 7f8929779700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f8929779700 time 2024-03-25T09:35:03.810573+0000 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8931bd83db] 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f8931bd85a1] 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x561ea5e05cb6] 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x561ea5eedcd2] 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 5: (Monitor::shutdown()+0x2bc) [0x561ea5dd653c] 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 6: (SignalHandler::entry()+0x659) [0x561ea60b8cb9] 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f892f3bf1ca] 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 8: clone() 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 0> 2024-03-25T09:35:03.812+0000 7f8929779700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: in thread 7f8929779700 thread_name:signal_handler 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:04.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f892f3c9d20] 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2: gsignal() 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 3: abort() 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8931bd8435] 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f8931bd85a1] 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x561ea5e05cb6] 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x561ea5eedcd2] 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 8: (Monitor::shutdown()+0x2bc) [0x561ea5dd653c] 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 9: (SignalHandler::entry()+0x659) [0x561ea60b8cb9] 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f892f3bf1ca] 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 11: clone() 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -9434> 2024-03-25T09:34:17.823+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -8521> 2024-03-25T09:34:22.823+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -7628> 2024-03-25T09:34:27.823+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -6607> 2024-03-25T09:34:32.824+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -5714> 2024-03-25T09:34:37.824+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -4714> 2024-03-25T09:34:42.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -3720> 2024-03-25T09:34:47.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -2887> 2024-03-25T09:34:52.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -2001> 2024-03-25T09:34:57.825+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -61> 2024-03-25T09:35:02.826+0000 7f8926773700 -1 mon.c@1(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-25T09:35:04.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -26> 2024-03-25T09:35:03.809+0000 7f8929779700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:04.103 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -25> 2024-03-25T09:35:03.809+0000 7f8929779700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: -1> 2024-03-25T09:35:03.810+0000 7f8929779700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f8929779700 time 2024-03-25T09:35:03.810573+0000 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-1997-g47ea673a/rpm/el8/BUILD/ceph-19.0.0-1997-g47ea673a/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8931bd83db] 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f8931bd85a1] 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x561ea5e05cb6] 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x561ea5eedcd2] 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 5: (Monitor::shutdown()+0x2bc) [0x561ea5dd653c] 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 6: (SignalHandler::entry()+0x659) [0x561ea60b8cb9] 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f892f3bf1ca] 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 8: clone() 2024-03-25T09:35:04.104 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 0> 2024-03-25T09:35:03.812+0000 7f8929779700 -1 *** Caught signal (Aborted) ** 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: in thread 7f8929779700 thread_name:signal_handler 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: ceph version 19.0.0-1997-g47ea673a (47ea673ae9ebf51b2ebc505093bd7272422045e4) squid (dev) 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f892f3c9d20] 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2: gsignal() 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 3: abort() 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8931bd8435] 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d95a1) [0x7f8931bd85a1] 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x561ea5e05cb6] 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x561ea5eedcd2] 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 8: (Monitor::shutdown()+0x2bc) [0x561ea5dd653c] 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 9: (SignalHandler::entry()+0x659) [0x561ea60b8cb9] 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f892f3bf1ca] 2024-03-25T09:35:04.105 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 11: clone() 2024-03-25T09:35:04.106 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-25T09:35:04.106 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c[32705]: 2024-03-25T09:35:04.106 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:03 smithi059 podman[57326]: 2024-03-25 09:35:03.850801639 +0000 UTC m=+0.142666873 container died f17d31bfc7ad4d2a45f3420187caca15c3c1402f48f10a1e4a36a777db854b4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-47ea673, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-25T09:35:04.452 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:04 smithi059 podman[57326]: 2024-03-25 09:35:04.26010964 +0000 UTC m=+0.551974879 container cleanup f17d31bfc7ad4d2a45f3420187caca15c3c1402f48f10a1e4a36a777db854b4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-47ea673, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-25T09:35:04.453 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:04 smithi059 bash[57326]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c 2024-03-25T09:35:04.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:04.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:04.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:04.681 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.c.service' 2024-03-25T09:35:04.706 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:04 smithi059 podman[57340]: 2024-03-25 09:35:04.453127671 +0000 UTC m=+0.606283234 container remove f17d31bfc7ad4d2a45f3420187caca15c3c1402f48f10a1e4a36a777db854b4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mon-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-47ea673, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-25T09:35:04.706 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:04 smithi059 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.c.service: Main process exited, code=exited, status=134/n/a 2024-03-25T09:35:04.706 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:04 smithi059 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.c.service: Failed with result 'exit-code'. 2024-03-25T09:35:04.706 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:04 smithi059 systemd[1]: Stopped Ceph mon.c for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:35:04.706 INFO:journalctl@ceph.mon.c.smithi059.stdout:Mar 25 09:35:04 smithi059 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@mon.c.service: Consumed 9.040s CPU time. 2024-03-25T09:35:04.720 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:35:04.721 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-03-25T09:35:04.721 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-25T09:35:04.721 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@mgr.x 2024-03-25T09:35:04.996 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:35:04 smithi019 systemd[1]: Stopping Ceph mgr.x for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:05.405 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:35:04 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x[29635]: 2024-03-25T09:35:04.996+0000 7fcd07056700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:05.405 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:35:05 smithi019 podman[74078]: 2024-03-25 09:35:05.027235101 +0000 UTC m=+0.118979740 container died c5caafa6dd4bd61dbf53d3dd46ed9166ffb7a5d5a11d6e44e9f13e390b30c270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240307, RELEASE=ceph-nvmeof-mon-47ea673, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-25T09:35:05.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:35:05 smithi019 podman[74078]: 2024-03-25 09:35:05.479857214 +0000 UTC m=+0.571601853 container cleanup c5caafa6dd4bd61dbf53d3dd46ed9166ffb7a5d5a11d6e44e9f13e390b30c270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=) 2024-03-25T09:35:05.658 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:35:05 smithi019 bash[74078]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x 2024-03-25T09:35:05.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:05.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:05.659 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:05.899 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@mgr.x.service' 2024-03-25T09:35:05.922 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:35:05 smithi019 podman[74092]: 2024-03-25 09:35:05.781383188 +0000 UTC m=+0.754450682 container remove c5caafa6dd4bd61dbf53d3dd46ed9166ffb7a5d5a11d6e44e9f13e390b30c270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:47ea673ae9ebf51b2ebc505093bd7272422045e4, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-mgr-x, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-25T09:35:05.922 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:35:05 smithi019 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@mgr.x.service: Deactivated successfully. 2024-03-25T09:35:05.923 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:35:05 smithi019 systemd[1]: Stopped Ceph mgr.x for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:35:05.923 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Mar 25 09:35:05 smithi019 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@mgr.x.service: Consumed 1min 15.484s CPU time. 2024-03-25T09:35:05.935 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:35:05.935 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-25T09:35:05.936 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-25T09:35:05.936 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.0 2024-03-25T09:35:06.275 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:06 smithi019 systemd[1]: Stopping Ceph osd.0 for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:06.658 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0[44071]: 2024-03-25T09:35:06.275+0000 7f044f865700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:06.658 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0[44071]: 2024-03-25T09:35:06.275+0000 7f044f865700 -1 osd.0 81 *** Got signal Terminated *** 2024-03-25T09:35:06.658 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:06 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0[44071]: 2024-03-25T09:35:06.275+0000 7f044f865700 -1 osd.0 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-25T09:35:06.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:06.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:06.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:07.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:07.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:07.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:08.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:08.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:08.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:09.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:09.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:09.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:10.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:10.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:10.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:11.908 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:11 smithi019 podman[74201]: 2024-03-25 09:35:11.710275457 +0000 UTC m=+5.533392769 container died 723f431e898b148ee19d96ef635c7bd2c01e39685d5c922bfd8ecedf038618c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=ceph-nvmeof-mon-47ea673, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-25T09:35:11.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:11.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:11.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:12.318 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:12 smithi019 podman[74201]: 2024-03-25 09:35:12.084269021 +0000 UTC m=+5.907386329 container cleanup 723f431e898b148ee19d96ef635c7bd2c01e39685d5c922bfd8ecedf038618c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-47ea673, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-25T09:35:12.318 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:12 smithi019 bash[74201]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0 2024-03-25T09:35:12.658 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:12 smithi019 podman[74239]: 2024-03-25 09:35:12.318749567 +0000 UTC m=+0.606348196 container remove 723f431e898b148ee19d96ef635c7bd2c01e39685d5c922bfd8ecedf038618c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-25T09:35:12.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:12.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:12.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:12.921 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:12 smithi019 podman[74330]: 2024-03-25 09:35:12.561972296 +0000 UTC m=+0.019118202 image pull 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca 2024-03-25T09:35:12.922 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:12 smithi019 podman[74330]: 2024-03-25 09:35:12.686302342 +0000 UTC m=+0.143448239 container create a4f9fd6a15116a7cabe6f7739a038b016fe31c7da2c17fc0a7d7e49339fd7d49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=ceph-nvmeof-mon-47ea673, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-25T09:35:12.922 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:12 smithi019 podman[74330]: 2024-03-25 09:35:12.922128657 +0000 UTC m=+0.379274573 container init a4f9fd6a15116a7cabe6f7739a038b016fe31c7da2c17fc0a7d7e49339fd7d49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=ceph-nvmeof-mon-47ea673, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-25T09:35:13.223 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:12 smithi019 podman[74330]: 2024-03-25 09:35:12.925435539 +0000 UTC m=+0.382581439 container start a4f9fd6a15116a7cabe6f7739a038b016fe31c7da2c17fc0a7d7e49339fd7d49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, RELEASE=ceph-nvmeof-mon-47ea673, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-25T09:35:13.223 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:13 smithi019 podman[74330]: 2024-03-25 09:35:13.047297061 +0000 UTC m=+0.504442962 container attach a4f9fd6a15116a7cabe6f7739a038b016fe31c7da2c17fc0a7d7e49339fd7d49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=ceph-nvmeof-mon-47ea673, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-03-25T09:35:13.508 INFO:journalctl@ceph.osd.0.smithi019.stdout:Mar 25 09:35:13 smithi019 podman[74330]: 2024-03-25 09:35:13.223879956 +0000 UTC m=+0.681025855 container died a4f9fd6a15116a7cabe6f7739a038b016fe31c7da2c17fc0a7d7e49339fd7d49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-0-deactivate, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-03-25T09:35:13.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:13.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:13.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:13.789 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.0.service' 2024-03-25T09:35:13.828 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:35:13.828 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-25T09:35:13.828 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-25T09:35:13.828 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.1 2024-03-25T09:35:14.153 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:13 smithi019 systemd[1]: Stopping Ceph osd.1 for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:14.408 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1[49893]: 2024-03-25T09:35:14.153+0000 7fae13f8e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:14.408 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1[49893]: 2024-03-25T09:35:14.153+0000 7fae13f8e700 -1 osd.1 81 *** Got signal Terminated *** 2024-03-25T09:35:14.408 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:14 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1[49893]: 2024-03-25T09:35:14.153+0000 7fae13f8e700 -1 osd.1 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-25T09:35:14.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:14.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:14.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:15.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:15.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:15.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:16.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:16.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:16.665 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:17.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:17.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:17.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:18.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:18.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:18.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:19.908 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:19 smithi019 podman[74437]: 2024-03-25 09:35:19.7516233 +0000 UTC m=+5.703635309 container died 6451e7299b07c7ed2a5f88c10f2b224a5252cd17122ac7300c4a9c13084eeca1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-47ea673, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307) 2024-03-25T09:35:19.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:19] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:19.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:19] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:19.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:19 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:20.212 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:20 smithi019 podman[74437]: 2024-03-25 09:35:20.061509211 +0000 UTC m=+6.013521218 container cleanup 6451e7299b07c7ed2a5f88c10f2b224a5252cd17122ac7300c4a9c13084eeca1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-03-25T09:35:20.212 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:20 smithi019 bash[74437]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1 2024-03-25T09:35:20.625 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:20 smithi019 podman[74464]: 2024-03-25 09:35:20.212487785 +0000 UTC m=+0.459318792 container remove 6451e7299b07c7ed2a5f88c10f2b224a5252cd17122ac7300c4a9c13084eeca1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-25T09:35:20.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:20.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:20.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:20.877 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:20 smithi019 podman[74552]: 2024-03-25 09:35:20.528336583 +0000 UTC m=+0.017924069 image pull 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca 2024-03-25T09:35:20.877 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:20 smithi019 podman[74552]: 2024-03-25 09:35:20.630027224 +0000 UTC m=+0.119614699 container create 85a67965682765d02386f046e3e5c948418c3a45b0b1a21a552e1ea01a01b2cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-47ea673, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-25T09:35:20.877 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:20 smithi019 podman[74552]: 2024-03-25 09:35:20.874374457 +0000 UTC m=+0.363961936 container init 85a67965682765d02386f046e3e5c948418c3a45b0b1a21a552e1ea01a01b2cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-47ea673, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux ) 2024-03-25T09:35:20.877 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:20 smithi019 podman[74552]: 2024-03-25 09:35:20.877771159 +0000 UTC m=+0.367358641 container start 85a67965682765d02386f046e3e5c948418c3a45b0b1a21a552e1ea01a01b2cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, RELEASE=ceph-nvmeof-mon-47ea673) 2024-03-25T09:35:21.158 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:20 smithi019 podman[74552]: 2024-03-25 09:35:20.982555944 +0000 UTC m=+0.472143424 container attach 85a67965682765d02386f046e3e5c948418c3a45b0b1a21a552e1ea01a01b2cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-03-25T09:35:21.452 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:21 smithi019 podman[74552]: 2024-03-25 09:35:21.182490872 +0000 UTC m=+0.672078356 container died 85a67965682765d02386f046e3e5c948418c3a45b0b1a21a552e1ea01a01b2cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=ceph-nvmeof-mon-47ea673, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True) 2024-03-25T09:35:21.686 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.1.service' 2024-03-25T09:35:21.710 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:21 smithi019 podman[74579]: 2024-03-25 09:35:21.669179684 +0000 UTC m=+0.481807152 container remove 85a67965682765d02386f046e3e5c948418c3a45b0b1a21a552e1ea01a01b2cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-47ea673, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-25T09:35:21.710 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:21 smithi019 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.1.service: Deactivated successfully. 2024-03-25T09:35:21.710 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:21 smithi019 systemd[1]: Stopped Ceph osd.1 for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:35:21.710 INFO:journalctl@ceph.osd.1.smithi019.stdout:Mar 25 09:35:21 smithi019 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.1.service: Consumed 2min 38.535s CPU time. 2024-03-25T09:35:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:21] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:21] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:21 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:21.724 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:35:21.724 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-25T09:35:21.724 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-25T09:35:21.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.2 2024-03-25T09:35:22.005 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:21 smithi040 systemd[1]: Stopping Ceph osd.2 for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:22.263 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2[36742]: 2024-03-25T09:35:22.005+0000 7f1ea50f6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:22.263 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2[36742]: 2024-03-25T09:35:22.005+0000 7f1ea50f6700 -1 osd.2 81 *** Got signal Terminated *** 2024-03-25T09:35:22.263 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2[36742]: 2024-03-25T09:35:22.005+0000 7f1ea50f6700 -1 osd.2 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-25T09:35:22.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:22.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:22.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:23.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:23] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:23.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:23] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:23.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:23 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:24.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:24.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:24.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:25.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:25] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:25.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:25] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:25.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:25 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:26.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:26.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:26.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:27.763 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:27 smithi040 podman[57600]: 2024-03-25 09:35:27.461752826 +0000 UTC m=+5.556324113 container died af48004ed4a8493ca9e521a667e4568a6f37371624453187f138aef3176d19db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=ceph-nvmeof-mon-47ea673) 2024-03-25T09:35:27.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:27] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:27.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:27] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:27.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:27 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:28.263 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:27 smithi040 podman[57600]: 2024-03-25 09:35:27.771788072 +0000 UTC m=+5.866359357 container cleanup af48004ed4a8493ca9e521a667e4568a6f37371624453187f138aef3176d19db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2, RELEASE=ceph-nvmeof-mon-47ea673, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-25T09:35:28.263 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:27 smithi040 bash[57600]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2 2024-03-25T09:35:28.263 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:27 smithi040 podman[57639]: 2024-03-25 09:35:27.98131889 +0000 UTC m=+0.514199288 container remove af48004ed4a8493ca9e521a667e4568a6f37371624453187f138aef3176d19db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2) 2024-03-25T09:35:28.618 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:28.619 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:28 smithi040 podman[57732]: 2024-03-25 09:35:28.215200015 +0000 UTC m=+0.017188585 image pull 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca 2024-03-25T09:35:28.619 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:28 smithi040 podman[57732]: 2024-03-25 09:35:28.340863572 +0000 UTC m=+0.142852134 container create 6346b82d28a0db2c42b8a4622480ea7d22d017f1d0acc8c57177033da9df0450 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=ceph-nvmeof-mon-47ea673, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-03-25T09:35:28.619 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:28 smithi040 podman[57732]: 2024-03-25 09:35:28.535791794 +0000 UTC m=+0.337780371 container init 6346b82d28a0db2c42b8a4622480ea7d22d017f1d0acc8c57177033da9df0450 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, RELEASE=ceph-nvmeof-mon-47ea673, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-25T09:35:28.619 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:28 smithi040 podman[57732]: 2024-03-25 09:35:28.539119538 +0000 UTC m=+0.341108110 container start 6346b82d28a0db2c42b8a4622480ea7d22d017f1d0acc8c57177033da9df0450 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=ceph-nvmeof-mon-47ea673, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-03-25T09:35:28.619 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:28 smithi040 podman[57732]: 2024-03-25 09:35:28.618400172 +0000 UTC m=+0.420388765 container attach 6346b82d28a0db2c42b8a4622480ea7d22d017f1d0acc8c57177033da9df0450 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=ceph-nvmeof-mon-47ea673, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307) 2024-03-25T09:35:28.619 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:28.620 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:29.013 INFO:journalctl@ceph.osd.2.smithi040.stdout:Mar 25 09:35:28 smithi040 podman[57732]: 2024-03-25 09:35:28.83478609 +0000 UTC m=+0.636774657 container died 6346b82d28a0db2c42b8a4622480ea7d22d017f1d0acc8c57177033da9df0450 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240307, RELEASE=ceph-nvmeof-mon-47ea673, GIT_BRANCH=HEAD) 2024-03-25T09:35:29.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.2.service' 2024-03-25T09:35:29.453 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:35:29.454 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-25T09:35:29.454 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-25T09:35:29.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.3 2024-03-25T09:35:29.763 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:29 smithi040 systemd[1]: Stopping Ceph osd.3 for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:29.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:29] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:29.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:29] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:29.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:29 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:30.263 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3[42245]: 2024-03-25T09:35:29.798+0000 7f5863c78700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:30.263 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3[42245]: 2024-03-25T09:35:29.798+0000 7f5863c78700 -1 osd.3 81 *** Got signal Terminated *** 2024-03-25T09:35:30.263 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:29 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3[42245]: 2024-03-25T09:35:29.798+0000 7f5863c78700 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-25T09:35:30.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:30.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:30.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:31.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:31] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:31.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:31] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:31.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:31 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:32.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:32 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:32.189+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:32.763 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:32.475+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:05.842136+0000 front 2024-03-25T09:35:05.842108+0000 (oldest deadline 2024-03-25T09:35:31.742088+0000) 2024-03-25T09:35:32.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:32] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:32.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:32] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:32.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:32 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:33.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:33 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:33.218+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:33.903 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:33.519+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:05.842136+0000 front 2024-03-25T09:35:05.842108+0000 (oldest deadline 2024-03-25T09:35:31.742088+0000) 2024-03-25T09:35:33.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:33] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:33.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:33] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:33.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:33 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:34.263 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:33 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3[42245]: 2024-03-25T09:35:33.903+0000 7f585c264700 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:07.067785+0000 front 2024-03-25T09:35:07.067823+0000 (oldest deadline 2024-03-25T09:35:32.967897+0000) 2024-03-25T09:35:34.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:34.169+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:35.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:34.744+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:35.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:34 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:34.716+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:35.012 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:34.566+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:05.842136+0000 front 2024-03-25T09:35:05.842108+0000 (oldest deadline 2024-03-25T09:35:31.742088+0000) 2024-03-25T09:35:35.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:34] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:35.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:34] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:35.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:34 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:35.482 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:35 smithi040 podman[57838]: 2024-03-25 09:35:35.242358858 +0000 UTC m=+5.560907961 container died e8e9e51fefda46937418694903b3692dc8550da96ad432553d3f763bb26c64b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-47ea673, ceph=True, CEPH_POINT_RELEASE=) 2024-03-25T09:35:35.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:35.207+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:35.763 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:35 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:35.547+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:05.842136+0000 front 2024-03-25T09:35:05.842108+0000 (oldest deadline 2024-03-25T09:35:31.742088+0000) 2024-03-25T09:35:35.763 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:35 smithi040 podman[57838]: 2024-03-25 09:35:35.582610505 +0000 UTC m=+5.901159606 container cleanup e8e9e51fefda46937418694903b3692dc8550da96ad432553d3f763bb26c64b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-47ea673, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-25T09:35:35.763 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:35 smithi040 bash[57838]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3 2024-03-25T09:35:36.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:35.772+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:36.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:35 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:35.744+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:36.135 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:35 smithi040 podman[57864]: 2024-03-25 09:35:35.800695898 +0000 UTC m=+0.559970699 container remove e8e9e51fefda46937418694903b3692dc8550da96ad432553d3f763bb26c64b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, maintainer=Guillaume Abrioux , RELEASE=ceph-nvmeof-mon-47ea673, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-25T09:35:36.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:35] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:36.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:35] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:36.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:35 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:36.453 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:36 smithi040 podman[57952]: 2024-03-25 09:35:36.038791837 +0000 UTC m=+0.017629531 image pull 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca 2024-03-25T09:35:36.454 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:36 smithi040 podman[57952]: 2024-03-25 09:35:36.176670051 +0000 UTC m=+0.155507732 container create db0088fbf5103dda0451ad6b50953076b8f69634a7ff30d3fb9b5cbc3700ae1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-47ea673, CEPH_POINT_RELEASE=) 2024-03-25T09:35:36.454 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:36 smithi040 podman[57952]: 2024-03-25 09:35:36.370645309 +0000 UTC m=+0.349482993 container init db0088fbf5103dda0451ad6b50953076b8f69634a7ff30d3fb9b5cbc3700ae1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-25T09:35:36.454 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:36 smithi040 podman[57952]: 2024-03-25 09:35:36.373905279 +0000 UTC m=+0.352742960 container start db0088fbf5103dda0451ad6b50953076b8f69634a7ff30d3fb9b5cbc3700ae1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0) 2024-03-25T09:35:36.454 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:36 smithi040 podman[57952]: 2024-03-25 09:35:36.453992549 +0000 UTC m=+0.432830263 container attach db0088fbf5103dda0451ad6b50953076b8f69634a7ff30d3fb9b5cbc3700ae1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-25T09:35:36.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:36.173+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:36.763 INFO:journalctl@ceph.osd.3.smithi040.stdout:Mar 25 09:35:36 smithi040 podman[57952]: 2024-03-25 09:35:36.675275145 +0000 UTC m=+0.654112836 container died db0088fbf5103dda0451ad6b50953076b8f69634a7ff30d3fb9b5cbc3700ae1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-3-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, RELEASE=ceph-nvmeof-mon-47ea673, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-25T09:35:36.764 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:36.508+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:05.842136+0000 front 2024-03-25T09:35:05.842108+0000 (oldest deadline 2024-03-25T09:35:31.742088+0000) 2024-03-25T09:35:36.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:36] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:36.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:36] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:36.765 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:36 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:37.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:36.698+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:37.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:36 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:36.803+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:37.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.3.service' 2024-03-25T09:35:37.251 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:35:37.251 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-25T09:35:37.252 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-25T09:35:37.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.4 2024-03-25T09:35:37.473 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:37 smithi040 systemd[1]: Stopping Ceph osd.4 for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:37.473 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:37.472+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:05.842136+0000 front 2024-03-25T09:35:05.842108+0000 (oldest deadline 2024-03-25T09:35:31.742088+0000) 2024-03-25T09:35:37.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:37.137+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:37.763 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:37.601+0000 7fd58481a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:37.763 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:37.601+0000 7fd58481a700 -1 osd.4 81 *** Got signal Terminated *** 2024-03-25T09:35:37.763 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:37 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:37.601+0000 7fd58481a700 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-25T09:35:38.010 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:37.683+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:38.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:37 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:37.853+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:38.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:37] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:38.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:37] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:38.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:37 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:38.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:38.159+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:38.763 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:38.510+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:05.842136+0000 front 2024-03-25T09:35:05.842108+0000 (oldest deadline 2024-03-25T09:35:31.742088+0000) 2024-03-25T09:35:38.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:38] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:38.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:38] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:38.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:38 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:39.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:38.720+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:39.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:38 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:38.843+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:39.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:39.136+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:39.763 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:39 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:39.559+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:05.842136+0000 front 2024-03-25T09:35:05.842108+0000 (oldest deadline 2024-03-25T09:35:31.742088+0000) 2024-03-25T09:35:40.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:39.676+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:40.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:39 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:39.849+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:40.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:39] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:40.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:39] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:40.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:39 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:40.510 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:40 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:40.186+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:41.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:40 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:40.819+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:41.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:40 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:40.711+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:41.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:40 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:40.711+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.185275+0000 front 2024-03-25T09:35:14.185061+0000 (oldest deadline 2024-03-25T09:35:40.085142+0000) 2024-03-25T09:35:41.012 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:40.590+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:05.842136+0000 front 2024-03-25T09:35:05.842108+0000 (oldest deadline 2024-03-25T09:35:31.742088+0000) 2024-03-25T09:35:41.013 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:40.590+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.642708+0000 front 2024-03-25T09:35:14.642695+0000 (oldest deadline 2024-03-25T09:35:39.942712+0000) 2024-03-25T09:35:41.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:40] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:41.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:40] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:41.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:40 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:41.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:41.185+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:41.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:41.185+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:42.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:41.805+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:42.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:41.716+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:42.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:41 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:41.716+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.185275+0000 front 2024-03-25T09:35:14.185061+0000 (oldest deadline 2024-03-25T09:35:40.085142+0000) 2024-03-25T09:35:42.012 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:41.607+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:05.842136+0000 front 2024-03-25T09:35:05.842108+0000 (oldest deadline 2024-03-25T09:35:31.742088+0000) 2024-03-25T09:35:42.013 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:41 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4[47864]: 2024-03-25T09:35:41.607+0000 7fd580e0e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.642708+0000 front 2024-03-25T09:35:14.642695+0000 (oldest deadline 2024-03-25T09:35:39.942712+0000) 2024-03-25T09:35:42.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:41] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:42.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:41] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:42.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:41 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:42.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:42.195+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:42.513 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:42.196+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:42.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:42] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:42.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:42] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:42.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:42 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:43.010 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:42.818+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:43.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:42.755+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:43.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:42 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:42.755+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.185275+0000 front 2024-03-25T09:35:14.185061+0000 (oldest deadline 2024-03-25T09:35:40.085142+0000) 2024-03-25T09:35:43.243 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:42 smithi040 podman[58059]: 2024-03-25 09:35:42.984324762 +0000 UTC m=+5.490057872 container died b861261698c672d927c49bba18cd1c2ad56566b3b245090a5e16aa0af2d035da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-25T09:35:43.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:43.171+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:43.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:43.171+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:43.512 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:43 smithi040 podman[58059]: 2024-03-25 09:35:43.343526345 +0000 UTC m=+5.849259467 container cleanup b861261698c672d927c49bba18cd1c2ad56566b3b245090a5e16aa0af2d035da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=ceph-nvmeof-mon-47ea673, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-25T09:35:43.513 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:43 smithi040 bash[58059]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4 2024-03-25T09:35:43.945 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:43 smithi040 podman[58087]: 2024-03-25 09:35:43.611249063 +0000 UTC m=+0.626348526 container remove b861261698c672d927c49bba18cd1c2ad56566b3b245090a5e16aa0af2d035da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_CLEAN=True) 2024-03-25T09:35:44.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:43.712+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:44.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:43.712+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.185275+0000 front 2024-03-25T09:35:14.185061+0000 (oldest deadline 2024-03-25T09:35:40.085142+0000) 2024-03-25T09:35:44.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:43.851+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:44.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:43 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:43.851+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:44.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:43] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:44.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:43] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:44.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:43 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:44.263 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:43 smithi040 podman[58181]: 2024-03-25 09:35:43.94540108 +0000 UTC m=+0.096186008 container create 5a469baed9733f65befcc2dca682a86db29c6d1e8a0b74e9394be8d73dca55c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, RELEASE=ceph-nvmeof-mon-47ea673, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-03-25T09:35:44.263 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:43 smithi040 podman[58181]: 2024-03-25 09:35:43.869036746 +0000 UTC m=+0.019821705 image pull 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca 2024-03-25T09:35:44.263 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:44 smithi040 podman[58181]: 2024-03-25 09:35:44.097757573 +0000 UTC m=+0.248542531 container init 5a469baed9733f65befcc2dca682a86db29c6d1e8a0b74e9394be8d73dca55c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4-deactivate, ceph=True, RELEASE=ceph-nvmeof-mon-47ea673, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-25T09:35:44.263 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:44 smithi040 podman[58181]: 2024-03-25 09:35:44.101091258 +0000 UTC m=+0.251876187 container start 5a469baed9733f65befcc2dca682a86db29c6d1e8a0b74e9394be8d73dca55c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=ceph-nvmeof-mon-47ea673, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-25T09:35:44.263 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:44 smithi040 podman[58181]: 2024-03-25 09:35:44.172555582 +0000 UTC m=+0.323340511 container attach 5a469baed9733f65befcc2dca682a86db29c6d1e8a0b74e9394be8d73dca55c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-25T09:35:44.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:44.199+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:44.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:44.199+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:44.692 INFO:journalctl@ceph.osd.4.smithi040.stdout:Mar 25 09:35:44 smithi040 podman[58181]: 2024-03-25 09:35:44.401670684 +0000 UTC m=+0.552455619 container died 5a469baed9733f65befcc2dca682a86db29c6d1e8a0b74e9394be8d73dca55c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-47ea673, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-25T09:35:44.693 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:44] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:44.693 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:44] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:44.693 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:44 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:44.987 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.4.service' 2024-03-25T09:35:45.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:44.696+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:45.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:44.696+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.185275+0000 front 2024-03-25T09:35:14.185061+0000 (oldest deadline 2024-03-25T09:35:40.085142+0000) 2024-03-25T09:35:45.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:44.844+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:45.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:44 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:44.844+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:45.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:35:45.026 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-25T09:35:45.026 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-25T09:35:45.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.5 2024-03-25T09:35:45.328 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:45 smithi059 systemd[1]: Stopping Ceph osd.5 for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:45.328 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:45.328+0000 7f14e133f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:45.329 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:45.200+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:45.329 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:45.200+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:45.682 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:45.328+0000 7f14e133f700 -1 osd.5 81 *** Got signal Terminated *** 2024-03-25T09:35:45.682 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:45.328+0000 7f14e133f700 -1 osd.5 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-25T09:35:45.682 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:45.682+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:45.682 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:45.682+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.185275+0000 front 2024-03-25T09:35:14.185061+0000 (oldest deadline 2024-03-25T09:35:40.085142+0000) 2024-03-25T09:35:46.010 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:45.842+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:46.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:45 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:45.842+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:46.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:45] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:46.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:45] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:46.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:45 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:46.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:46.161+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:46.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:46.161+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:47.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:46.637+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:47.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:46.637+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.185275+0000 front 2024-03-25T09:35:14.185061+0000 (oldest deadline 2024-03-25T09:35:40.085142+0000) 2024-03-25T09:35:47.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:46.882+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:47.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:46 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:46.882+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:47.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:46] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:47.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:46] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:47.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:46 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:47.510 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:47.137+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:47.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:47.137+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:48.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:47.664+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:48.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:47.664+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.185275+0000 front 2024-03-25T09:35:14.185061+0000 (oldest deadline 2024-03-25T09:35:40.085142+0000) 2024-03-25T09:35:48.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:47.851+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:48.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:47 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:47.851+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:48.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:47] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:48.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:47] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:48.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:47 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:48.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:48 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:48.163+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:48.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:48 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:48.163+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:48.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:48 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:48.163+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:49.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:48 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:48.618+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:49.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:48 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:48.618+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.185275+0000 front 2024-03-25T09:35:14.185061+0000 (oldest deadline 2024-03-25T09:35:40.085142+0000) 2024-03-25T09:35:49.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:48 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:48.829+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:49.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:48 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:48.829+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:49.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:48] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:49.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:48] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:49.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:48 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:49.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:49.161+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:49.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:49.161+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:49.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:49.161+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:50.014 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:49.800+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:50.014 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:49.800+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:50.014 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:49.597+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:09.484569+0000 front 2024-03-25T09:35:09.484594+0000 (oldest deadline 2024-03-25T09:35:34.184714+0000) 2024-03-25T09:35:50.014 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:49.597+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:14.185275+0000 front 2024-03-25T09:35:14.185061+0000 (oldest deadline 2024-03-25T09:35:40.085142+0000) 2024-03-25T09:35:50.015 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:49 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5[37046]: 2024-03-25T09:35:49.597+0000 7f14d992b700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:25.985837+0000 front 2024-03-25T09:35:25.985902+0000 (oldest deadline 2024-03-25T09:35:48.885977+0000) 2024-03-25T09:35:50.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:49] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:50.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:49] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:50.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:49 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:50.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:50 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:50.133+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:50.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:50 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:50.133+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:50.511 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:50 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:50.133+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:51.011 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:50 smithi059 podman[57467]: 2024-03-25 09:35:50.745911817 +0000 UTC m=+5.517215114 container died 4bf36b4777667173174145667d1f20f42c7528a9752cce8427124ee22ff956da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-47ea673, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-25T09:35:51.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:50 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:50.831+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:51.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:50 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:50.831+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:51.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:50 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:50.831+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:35:51.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:50] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:51.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:50] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:51.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:50 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:51.354 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:51 smithi059 podman[57467]: 2024-03-25 09:35:51.111625691 +0000 UTC m=+5.882928943 container cleanup 4bf36b4777667173174145667d1f20f42c7528a9752cce8427124ee22ff956da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD) 2024-03-25T09:35:51.354 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:51 smithi059 bash[57467]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5 2024-03-25T09:35:51.354 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:51.100+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:51.354 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:51.100+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:51.354 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:51.100+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:51.671 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:51 smithi059 podman[57482]: 2024-03-25 09:35:51.354483818 +0000 UTC m=+0.601419334 container remove 4bf36b4777667173174145667d1f20f42c7528a9752cce8427124ee22ff956da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=ceph-nvmeof-mon-47ea673, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-25T09:35:51.957 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:51.871+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:51.957 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:51.871+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:51.957 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:51 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:51.871+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:35:51.957 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:51 smithi059 podman[57571]: 2024-03-25 09:35:51.671971998 +0000 UTC m=+0.111287517 container create 0bc74a655f4523a830edf78ad6e91089301947bb187bdee5c919a0d2fedd6bdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=ceph-nvmeof-mon-47ea673, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD) 2024-03-25T09:35:51.957 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:51 smithi059 podman[57571]: 2024-03-25 09:35:51.578249562 +0000 UTC m=+0.017565099 image pull 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca 2024-03-25T09:35:51.957 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:51 smithi059 podman[57571]: 2024-03-25 09:35:51.891387813 +0000 UTC m=+0.330703343 container init 0bc74a655f4523a830edf78ad6e91089301947bb187bdee5c919a0d2fedd6bdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, RELEASE=ceph-nvmeof-mon-47ea673, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-25T09:35:51.958 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:51 smithi059 podman[57571]: 2024-03-25 09:35:51.894356919 +0000 UTC m=+0.333672442 container start 0bc74a655f4523a830edf78ad6e91089301947bb187bdee5c919a0d2fedd6bdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0) 2024-03-25T09:35:51.958 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:51 smithi059 podman[57571]: 2024-03-25 09:35:51.957896208 +0000 UTC m=+0.397211728 container attach 0bc74a655f4523a830edf78ad6e91089301947bb187bdee5c919a0d2fedd6bdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-47ea673, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0) 2024-03-25T09:35:52.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:51] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:52.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:51] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:52.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:51 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:52.217 INFO:journalctl@ceph.osd.5.smithi059.stdout:Mar 25 09:35:52 smithi059 podman[57571]: 2024-03-25 09:35:52.193724534 +0000 UTC m=+0.633040063 container died 0bc74a655f4523a830edf78ad6e91089301947bb187bdee5c919a0d2fedd6bdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-5-deactivate, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-03-25T09:35:52.218 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:52.112+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:52.218 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:52.112+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:52.218 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:52.112+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:52.751 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.5.service' 2024-03-25T09:35:52.792 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:35:52.792 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-25T09:35:52.792 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-25T09:35:52.792 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.6 2024-03-25T09:35:53.011 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:52 smithi059 systemd[1]: Stopping Ceph osd.6 for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:35:53.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:52.867+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:53.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:52.867+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:53.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:52 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:52.867+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:35:53.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:52] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:53.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:52] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:53.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:52 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:53.488 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:53.078+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:53.488 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:53.078+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:53.488 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:53.078+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:53.488 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:53.163+0000 7fcc5e51b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:35:53.488 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:53.163+0000 7fcc5e51b700 -1 osd.6 81 *** Got signal Terminated *** 2024-03-25T09:35:53.488 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:53.163+0000 7fcc5e51b700 -1 osd.6 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-25T09:35:54.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:53] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:54.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:53] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:54.162 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:53 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:54.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:54.117+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:54.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:54.117+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:54.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:54.117+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:54.262 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:53.909+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:54.262 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:53.909+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:54.262 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:53 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:53.909+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:35:55.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:54] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:55.787 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:55.134+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:55.787 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:55.134+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:55.787 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:55.134+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:55.787 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:54] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:55.787 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:54 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:55.787 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:54.900+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:55.787 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:54.900+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:55.787 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:54 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:54.900+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:35:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:55] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:55] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:55 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:56.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:56.086+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:56.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:56.086+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:56.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:56.086+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:56.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:55.899+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:56.262 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:55.899+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:56.262 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:55 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:55.899+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:35:57.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:56] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:57.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:56] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:57.014 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:56 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:57.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:57.104+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:57.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:57.104+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:57.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:57.104+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:57.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:56.911+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:57.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:56.911+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:57.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:56.911+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:35:57.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:56 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:56.911+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6812 osd.3 since back 2024-03-25T09:35:30.772199+0000 front 2024-03-25T09:35:30.772316+0000 (oldest deadline 2024-03-25T09:35:56.672227+0000) 2024-03-25T09:35:58.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:57] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:58.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:57] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:58.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:57 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:58.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:58.063+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.090150+0000 front 2024-03-25T09:35:10.090303+0000 (oldest deadline 2024-03-25T09:35:31.790248+0000) 2024-03-25T09:35:58.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:58.063+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:17.091426+0000 front 2024-03-25T09:35:17.091465+0000 (oldest deadline 2024-03-25T09:35:40.591608+0000) 2024-03-25T09:35:58.261 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6[42979]: 2024-03-25T09:35:58.063+0000 7fcc56b07700 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:22.292789+0000 front 2024-03-25T09:35:22.292716+0000 (oldest deadline 2024-03-25T09:35:47.592676+0000) 2024-03-25T09:35:58.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:57.930+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:58.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:57.930+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:58.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:57.930+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:35:58.262 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:57 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:57.930+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6812 osd.3 since back 2024-03-25T09:35:30.772199+0000 front 2024-03-25T09:35:30.772316+0000 (oldest deadline 2024-03-25T09:35:56.672227+0000) 2024-03-25T09:35:58.761 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:58 smithi059 podman[57687]: 2024-03-25 09:35:58.508648085 +0000 UTC m=+5.455013551 container died 43c6358c86158368f3e378673923aba73bb393c9d99d3edf077852f2f2c3f463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-25T09:35:59.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:58] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:35:59.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:35:58] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:35:59.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:35:58 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:35:59.140 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:58 smithi059 podman[57687]: 2024-03-25 09:35:58.881244469 +0000 UTC m=+5.827609934 container cleanup 43c6358c86158368f3e378673923aba73bb393c9d99d3edf077852f2f2c3f463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-47ea673, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-25T09:35:59.140 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:58 smithi059 bash[57687]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6 2024-03-25T09:35:59.140 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:58.930+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:35:59.140 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:58.930+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:35:59.140 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:58.930+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:35:59.141 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:58 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:58.930+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6812 osd.3 since back 2024-03-25T09:35:30.772199+0000 front 2024-03-25T09:35:30.772316+0000 (oldest deadline 2024-03-25T09:35:56.672227+0000) 2024-03-25T09:35:59.496 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:59 smithi059 podman[57707]: 2024-03-25 09:35:59.140728673 +0000 UTC m=+0.623947682 container remove 43c6358c86158368f3e378673923aba73bb393c9d99d3edf077852f2f2c3f463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-47ea673, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, ceph=True) 2024-03-25T09:35:59.757 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:59 smithi059 podman[57801]: 2024-03-25 09:35:59.399159216 +0000 UTC m=+0.017565593 image pull 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca 2024-03-25T09:35:59.757 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:59 smithi059 podman[57801]: 2024-03-25 09:35:59.632147235 +0000 UTC m=+0.250553641 container create ed228ba99db0045a805f6294be6170474d57faed396b7c3901b3831085acf565 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240307, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-47ea673, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-25T09:36:00.145 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:59.900+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:36:00.145 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:59.900+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:36:00.145 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:59.900+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:36:00.145 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:35:59 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:35:59.900+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6812 osd.3 since back 2024-03-25T09:35:30.772199+0000 front 2024-03-25T09:35:30.772316+0000 (oldest deadline 2024-03-25T09:35:56.672227+0000) 2024-03-25T09:36:00.145 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:59 smithi059 podman[57801]: 2024-03-25 09:35:59.843761668 +0000 UTC m=+0.462168048 container init ed228ba99db0045a805f6294be6170474d57faed396b7c3901b3831085acf565 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-25T09:36:00.145 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:59 smithi059 podman[57801]: 2024-03-25 09:35:59.847080756 +0000 UTC m=+0.465487129 container start ed228ba99db0045a805f6294be6170474d57faed396b7c3901b3831085acf565 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-47ea673, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-25T09:36:00.146 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:35:59 smithi059 podman[57801]: 2024-03-25 09:35:59.917633099 +0000 UTC m=+0.536039466 container attach ed228ba99db0045a805f6294be6170474d57faed396b7c3901b3831085acf565 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-25T09:36:00.146 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:36:00 smithi059 podman[57801]: 2024-03-25 09:36:00.145818259 +0000 UTC m=+0.764224639 container died ed228ba99db0045a805f6294be6170474d57faed396b7c3901b3831085acf565 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-47ea673, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-25T09:36:00.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:59] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:00.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:35:59] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:00.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:35:59 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:00.691 INFO:journalctl@ceph.osd.6.smithi059.stdout:Mar 25 09:36:00 smithi059 podman[57827]: 2024-03-25 09:36:00.670867441 +0000 UTC m=+0.519539278 container remove ed228ba99db0045a805f6294be6170474d57faed396b7c3901b3831085acf565 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-6-deactivate, ceph=True, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-25T09:36:00.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.6.service' 2024-03-25T09:36:00.737 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:36:00.737 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-25T09:36:00.738 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-25T09:36:00.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.7 2024-03-25T09:36:01.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:00 smithi059 systemd[1]: Stopping Ceph osd.7 for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:36:01.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:00.922+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:36:01.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:00.922+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:36:01.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:00.922+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:36:01.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:00 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:00.922+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6812 osd.3 since back 2024-03-25T09:35:30.772199+0000 front 2024-03-25T09:35:30.772316+0000 (oldest deadline 2024-03-25T09:35:56.672227+0000) 2024-03-25T09:36:01.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:00] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:01.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:00] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:01.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:00 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:01.511 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:01.056+0000 7fa0ab472700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-25T09:36:01.511 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:01.056+0000 7fa0ab472700 -1 osd.7 81 *** Got signal Terminated *** 2024-03-25T09:36:01.511 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:01.056+0000 7fa0ab472700 -1 osd.7 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-25T09:36:02.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:01] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:02.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:01] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:02.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:01 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:02.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:01.931+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:36:02.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:01.931+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:36:02.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:01.931+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:36:02.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:01 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:01.931+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6812 osd.3 since back 2024-03-25T09:35:30.772199+0000 front 2024-03-25T09:35:30.772316+0000 (oldest deadline 2024-03-25T09:35:56.672227+0000) 2024-03-25T09:36:03.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:02] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:03.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:02] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:03.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:02 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:03.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:02.909+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:36:03.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:02.909+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:36:03.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:02.909+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:36:03.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:02 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:02.909+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6812 osd.3 since back 2024-03-25T09:35:30.772199+0000 front 2024-03-25T09:35:30.772316+0000 (oldest deadline 2024-03-25T09:35:56.672227+0000) 2024-03-25T09:36:04.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:03] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:04.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:03] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:04.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:03 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:04.260 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:03.911+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:36:04.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:03.911+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:36:04.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:03.911+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:36:04.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:03 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:03.911+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6812 osd.3 since back 2024-03-25T09:35:30.772199+0000 front 2024-03-25T09:35:30.772316+0000 (oldest deadline 2024-03-25T09:35:56.672227+0000) 2024-03-25T09:36:05.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:04] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:05.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:04] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:05.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:04 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:05.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:04.901+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:36:05.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:04.901+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:36:05.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:04.901+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:36:05.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:04 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:04.901+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6812 osd.3 since back 2024-03-25T09:35:30.772199+0000 front 2024-03-25T09:35:30.772316+0000 (oldest deadline 2024-03-25T09:35:56.672227+0000) 2024-03-25T09:36:06.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:05] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:06.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:05] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:06.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:05 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:06.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:05.891+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-03-25T09:35:10.969032+0000 front 2024-03-25T09:35:10.969048+0000 (oldest deadline 2024-03-25T09:35:34.469188+0000) 2024-03-25T09:36:06.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:05.891+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.19:6814 osd.1 since back 2024-03-25T09:35:19.070800+0000 front 2024-03-25T09:35:19.070730+0000 (oldest deadline 2024-03-25T09:35:43.170847+0000) 2024-03-25T09:36:06.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:05.891+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6804 osd.2 since back 2024-03-25T09:35:24.871670+0000 front 2024-03-25T09:35:24.871692+0000 (oldest deadline 2024-03-25T09:35:50.771859+0000) 2024-03-25T09:36:06.262 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:05 smithi059 ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7[48861]: 2024-03-25T09:36:05.891+0000 7fa0a7a66700 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.40:6812 osd.3 since back 2024-03-25T09:35:30.772199+0000 front 2024-03-25T09:35:30.772316+0000 (oldest deadline 2024-03-25T09:35:56.672227+0000) 2024-03-25T09:36:06.824 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:06 smithi059 podman[57906]: 2024-03-25 09:36:06.525843667 +0000 UTC m=+5.563351850 container died 216e80d878e1456daf49b72c5901f15314dc1e215931e47cae32cf79aa71ef11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True) 2024-03-25T09:36:06.824 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:06 smithi059 podman[57906]: 2024-03-25 09:36:06.823678918 +0000 UTC m=+5.861187100 container cleanup 216e80d878e1456daf49b72c5901f15314dc1e215931e47cae32cf79aa71ef11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7, RELEASE=ceph-nvmeof-mon-47ea673, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0) 2024-03-25T09:36:07.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:06] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:07.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:06] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:07.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:06 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:07.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:06 smithi059 bash[57906]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7 2024-03-25T09:36:07.261 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:06 smithi059 podman[57925]: 2024-03-25 09:36:06.999548815 +0000 UTC m=+0.476955220 container remove 216e80d878e1456daf49b72c5901f15314dc1e215931e47cae32cf79aa71ef11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-47ea673) 2024-03-25T09:36:07.693 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:07 smithi059 podman[58017]: 2024-03-25 09:36:07.305431229 +0000 UTC m=+0.018267853 image pull 57d5a95370c2fddc9d5ae5ff3047d025dbe5ae8fe3cbe5edad74f85e8b3e18da quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca 2024-03-25T09:36:07.693 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:07 smithi059 podman[58017]: 2024-03-25 09:36:07.40868547 +0000 UTC m=+0.121522070 container create f0de7eac6de51fa809be8c6430562d7d75c1688c443c571691ef6757a57242b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7-deactivate, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=ceph-nvmeof-mon-47ea673, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-25T09:36:07.694 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:07 smithi059 podman[58017]: 2024-03-25 09:36:07.619229262 +0000 UTC m=+0.332065876 container init f0de7eac6de51fa809be8c6430562d7d75c1688c443c571691ef6757a57242b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-47ea673) 2024-03-25T09:36:07.694 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:07 smithi059 podman[58017]: 2024-03-25 09:36:07.622254417 +0000 UTC m=+0.335091023 container start f0de7eac6de51fa809be8c6430562d7d75c1688c443c571691ef6757a57242b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7-deactivate, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=ceph-nvmeof-mon-47ea673, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-03-25T09:36:07.694 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:07 smithi059 podman[58017]: 2024-03-25 09:36:07.694135214 +0000 UTC m=+0.406971827 container attach f0de7eac6de51fa809be8c6430562d7d75c1688c443c571691ef6757a57242b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-47ea673) 2024-03-25T09:36:08.011 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:07 smithi059 podman[58017]: 2024-03-25 09:36:07.916226962 +0000 UTC m=+0.629063579 container died f0de7eac6de51fa809be8c6430562d7d75c1688c443c571691ef6757a57242b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, ceph=True, RELEASE=ceph-nvmeof-mon-47ea673, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-25T09:36:08.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:07] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:08.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:07] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:08.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:07 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:08.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.7.service' 2024-03-25T09:36:08.456 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:08 smithi059 podman[58043]: 2024-03-25 09:36:08.413772299 +0000 UTC m=+0.487699931 container remove f0de7eac6de51fa809be8c6430562d7d75c1688c443c571691ef6757a57242b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1a9b96a20b98717e450af815f0489e870ed7292b27aaabd7a9db9cff4f1db9ca, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-47ea673, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-25T09:36:08.456 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:08 smithi059 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.7.service: Deactivated successfully. 2024-03-25T09:36:08.456 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:08 smithi059 systemd[1]: Stopped Ceph osd.7 for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:36:08.456 INFO:journalctl@ceph.osd.7.smithi059.stdout:Mar 25 09:36:08 smithi059 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@osd.7.service: Consumed 3min 40.283s CPU time. 2024-03-25T09:36:08.469 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-25T09:36:08.469 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-25T09:36:08.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61da756e-ea87-11ee-95cd-87774f69a715 --force --keep-logs 2024-03-25T09:36:08.653 INFO:teuthology.orchestra.run.smithi019.stdout:Deleting cluster with fsid: 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:36:09.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:08] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:09.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:08] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:09.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:08 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:09.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:09 smithi019 systemd[1]: Stopping Ceph nvmeof.nvmeof.a for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:36:10.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:09] INFO utils.py:399: Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log.gz 2024-03-25T09:36:10.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:09] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:10.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:09] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:10.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:09 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:11.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:10] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:11.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:10] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:11.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:10 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:12.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:11] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:12.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:11] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:12.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:11 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:13.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:12] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:13.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:12] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:13.013 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:12 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:14.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:13] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:14.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:13] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:14.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:13 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:15.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:14] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:15.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:14] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:15.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:14 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:16.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:15] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:16.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:15] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:16.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:15 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:17.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:16] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:17.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:16] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:17.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:16 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:18.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:17] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:18.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: [25-Mar-2024 09:36:17] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:18.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:17 smithi019 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a[61696]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.19', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:19.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:18] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:19.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:18] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:19.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:18 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:20.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:19 smithi019 bash[74955]: time="2024-03-25T09:36:19Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a in 10 seconds, resorting to SIGKILL" 2024-03-25T09:36:20.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:19 smithi019 podman[74955]: 2024-03-25 09:36:19.767366839 +0000 UTC m=+10.138221916 container died 620438f45aa33930a36255fdeadd6f4ce9b4297affaad6ec5613b43a519ad56f (image=quay.io/ceph/nvmeof:1.1.0, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a, build-date=2024-03-13 14:41:08 UTC, io.spdk.git.repo=https://github.com/ceph/spdk.git, vcs-type=git, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, distribution-scope=public, maintainer=Ceph Developers , summary=Ceph NVMe over Fabrics Gateway, io.ceph.url=https://github.com/ceph/ceph-nvmeof, release=, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=tags/1.1.0, name=ceph-nvmeof, io.spdk.git.branch=ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.ceph.version=1.1.0, architecture=x86_64, io.spdk.git.commit=6769b6f51c9508981243042396ec2b2f097a5745, version=1.1.0, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.maintainer=Ceph Developers , io.spdk.build.makeflags=, io.spdk.build.ceph-release=18.2.2, io.spdk.version=23.01.1, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, vcs-ref=635ba2fc3c4eeee93025a0994decacf48590f9f1, com.redhat.component=ubi9-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.nvmeof=None, io.spdk.build.pkgdep-args=--rbd, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.buildah.version=1.29.0, org.centos.version=9.0-21.el9, io.ceph.git.commit=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.openshift.wants=ceph,rbd, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.build.target-arch=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof) 2024-03-25T09:36:20.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:20 smithi019 podman[74955]: 2024-03-25 09:36:20.094994527 +0000 UTC m=+10.465849597 container cleanup 620438f45aa33930a36255fdeadd6f4ce9b4297affaad6ec5613b43a519ad56f (image=quay.io/ceph/nvmeof:1.1.0, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a, summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.branch=tags/1.1.0, name=ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-21.el9, io.spdk.build.makeflags=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.nvmeof=None, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.pkgdep-args=--rbd, architecture=x86_64, io.spdk.git.repo=https://github.com/ceph/spdk.git, vcs-type=git, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, io.ceph.version=1.1.0, io.ceph.component=ceph-nvmeof, build-date=2024-03-13 14:41:08 UTC, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, io.spdk.build.ceph-release=18.2.2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.version=23.01.1, distribution-scope=public, vendor=Red Hat, Inc., vcs-ref=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd, release=, io.spdk.git.branch=ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , io.spdk.build.target-arch=, io.ceph.git.commit=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.ceph.maintainer=Ceph Developers , io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=6769b6f51c9508981243042396ec2b2f097a5745, version=1.1.0) 2024-03-25T09:36:20.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:20 smithi019 bash[74955]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a 2024-03-25T09:36:20.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:20 smithi019 podman[74997]: 2024-03-25 09:36:20.237886746 +0000 UTC m=+0.470359487 container remove 620438f45aa33930a36255fdeadd6f4ce9b4297affaad6ec5613b43a519ad56f (image=quay.io/ceph/nvmeof:1.1.0, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-a, io.spdk.git.commit=6769b6f51c9508981243042396ec2b2f097a5745, build-date=2024-03-13 14:41:08 UTC, io.ceph.version=1.1.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., name=ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, io.spdk.git.branch=ceph-nvmeof, io.ceph.git.commit=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.ceph.nvmeof=None, io.spdk.build.target-arch=, release=, io.openshift.wants=ceph,rbd, io.spdk.version=23.01.1, architecture=x86_64, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.maintainer=Ceph Developers , vcs-type=git, io.ceph.component=ceph-nvmeof, com.redhat.component=ubi9-container, io.buildah.version=1.29.0, maintainer=Ceph Developers , version=1.1.0, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.makeflags=, io.spdk.build.ceph-release=18.2.2, vendor=Red Hat, Inc., vcs-ref=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.ceph.git.branch=tags/1.1.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-21.el9) 2024-03-25T09:36:20.408 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:20 smithi019 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.a.service: Main process exited, code=exited, status=137/n/a 2024-03-25T09:36:20.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:20 smithi019 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.a.service: Failed with result 'exit-code'. 2024-03-25T09:36:20.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:20 smithi019 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:36:20.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi019.stdout:Mar 25 09:36:20 smithi019 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.a.service: Consumed 18min 46.264s CPU time. 2024-03-25T09:36:21.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61da756e-ea87-11ee-95cd-87774f69a715 --force --keep-logs 2024-03-25T09:36:21.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:20] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:21.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:20] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:21.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:20 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:Deleting cluster with fsid: 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:36:22.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:22 smithi040 systemd[1]: Stopping Ceph nvmeof.nvmeof.b for 61da756e-ea87-11ee-95cd-87774f69a715... 2024-03-25T09:36:22.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:22] INFO utils.py:399: Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log.gz 2024-03-25T09:36:23.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:22] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:23.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:22] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:23.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:22 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:25.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:24] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:25.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:24] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:25.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:24 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:27.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:26] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:27.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:26] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:27.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:26 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:29.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:28] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:29.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:28] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:29.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:28 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:31.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:30] INFO grpc.py:2244: Received request to get subsystems, context: 2024-03-25T09:36:31.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: [25-Mar-2024 09:36:30] INFO grpc.py:2248: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph48566432277082', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'name': 'bdev_9348e01d-cee8-403d-bb54-53970ff1ea16', 'nguid': '9348E01DCEE8403DBB5453970FF1EA16', 'uuid': '9348e01d-cee8-403d-bb54-53970ff1ea16', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'name': 'bdev_ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'nguid': 'EC2F99731E5146F2B483E3D5C29585FE', 'uuid': 'ec2f9973-1e51-46f2-b483-e3d5c29585fe', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'name': 'bdev_dad17cdf-8065-4627-8ab8-7463052c2015', 'nguid': 'DAD17CDF806546278AB87463052C2015', 'uuid': 'dad17cdf-8065-4627-8ab8-7463052c2015', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'name': 'bdev_35f3505f-88ed-414f-b648-59aa4a961c41', 'nguid': '35F3505F88ED414FB64859AA4A961C41', 'uuid': '35f3505f-88ed-414f-b648-59aa4a961c41', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'name': 'bdev_94a7c175-9506-4f46-951b-5cfcf9926b02', 'nguid': '94A7C17595064F46951B5CFCF9926B02', 'uuid': '94a7c175-9506-4f46-951b-5cfcf9926b02', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'name': 'bdev_5625280c-ac4b-4ac7-8303-2044d130bb4a', 'nguid': '5625280CAC4B4AC783032044D130BB4A', 'uuid': '5625280c-ac4b-4ac7-8303-2044d130bb4a', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'name': 'bdev_db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'nguid': 'DB665A65D3B04CC5B87CC623E77EA38A', 'uuid': 'db665a65-d3b0-4cc5-b87c-c623e77ea38a', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'name': 'bdev_c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'nguid': 'C84FFC5F63354B22858EF4E302C3CA1D', 'uuid': 'c84ffc5f-6335-4b22-858e-f4e302c3ca1d', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'name': 'bdev_cfac5177-80a6-48b3-9cfe-623acba5e940', 'nguid': 'CFAC517780A648B39CFE623ACBA5E940', 'uuid': 'cfac5177-80a6-48b3-9cfe-623acba5e940', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'name': 'bdev_1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'nguid': '1D4C97A4A95045BC95179E4618E2A30D', 'uuid': '1d4c97a4-a950-45bc-9517-9e4618e2a30d', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'name': 'bdev_abf15eea-7fca-456e-a25b-48d067aee8bd', 'nguid': 'ABF15EEA7FCA456EA25B48D067AEE8BD', 'uuid': 'abf15eea-7fca-456e-a25b-48d067aee8bd', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'name': 'bdev_3020f654-8f85-4773-b868-1e2603567d08', 'nguid': '3020F6548F854773B8681E2603567D08', 'uuid': '3020f654-8f85-4773-b868-1e2603567d08', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'name': 'bdev_8c66140e-b02b-4f7c-a095-3fba10f63656', 'nguid': '8C66140EB02B4F7CA0953FBA10F63656', 'uuid': '8c66140e-b02b-4f7c-a095-3fba10f63656', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'name': 'bdev_e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'nguid': 'E28EEDCEAD534FCBB8CAA4E93D49E613', 'uuid': 'e28eedce-ad53-4fcb-b8ca-a4e93d49e613', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'name': 'bdev_980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'nguid': '980BDBDA0D0442F7B22E3BF9062A7E97', 'uuid': '980bdbda-0d04-42f7-b22e-3bf9062a7e97', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'name': 'bdev_111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'nguid': '111FD48C55A64B8B8FC1AB645D2E177D', 'uuid': '111fd48c-55a6-4b8b-8fc1-ab645d2e177d', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'name': 'bdev_9042541e-2b4e-4b32-8722-3d8b54f30519', 'nguid': '9042541E2B4E4B3287223D8B54F30519', 'uuid': '9042541e-2b4e-4b32-8722-3d8b54f30519', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'name': 'bdev_ce6b322f-6392-498b-b5fa-c9cae8cff068', 'nguid': 'CE6B322F6392498BB5FAC9CAE8CFF068', 'uuid': 'ce6b322f-6392-498b-b5fa-c9cae8cff068', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'name': 'bdev_3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'nguid': '3372559D2E5C4244AB4315DFCC15B9FF', 'uuid': '3372559d-2e5c-4244-ab43-15dfcc15b9ff', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'name': 'bdev_a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'nguid': 'A1EF7B58CCEF4B5EB39DBA06291661F6', 'uuid': 'a1ef7b58-ccef-4b5e-b39d-ba06291661f6', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph21611557036653', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'name': 'bdev_0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'nguid': '0E7C9DF94E2B4D6E8C5ECDBCD8673FC8', 'uuid': '0e7c9df9-4e2b-4d6e-8c5e-cdbcd8673fc8', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'name': 'bdev_8152cee8-8d2b-415a-ac00-822531debce3', 'nguid': '8152CEE88D2B415AAC00822531DEBCE3', 'uuid': '8152cee8-8d2b-415a-ac00-822531debce3', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'name': 'bdev_1b4f6c4b-2e43-4361-953c-a9a83224db65', 'nguid': '1B4F6C4B2E434361953CA9A83224DB65', 'uuid': '1b4f6c4b-2e43-4361-953c-a9a83224db65', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'name': 'bdev_84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'nguid': '84B837FB53A048A09C3BD546BE3F13AD', 'uuid': '84b837fb-53a0-48a0-9c3b-d546be3f13ad', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'name': 'bdev_10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'nguid': '10E7459CF4304A5B8236B9FCBF95F3A9', 'uuid': '10e7459c-f430-4a5b-8236-b9fcbf95f3a9', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'name': 'bdev_aad1627f-b632-4c58-9c41-ef7d1846a13e', 'nguid': 'AAD1627FB6324C589C41EF7D1846A13E', 'uuid': 'aad1627f-b632-4c58-9c41-ef7d1846a13e', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'name': 'bdev_926c1429-34b4-4551-97c7-318bf5dfa876', 'nguid': '926C142934B4455197C7318BF5DFA876', 'uuid': '926c1429-34b4-4551-97c7-318bf5dfa876', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'name': 'bdev_29dba39d-1be4-4646-b04c-d3d692f2847a', 'nguid': '29DBA39D1BE44646B04CD3D692F2847A', 'uuid': '29dba39d-1be4-4646-b04c-d3d692f2847a', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'name': 'bdev_8303b2b0-3e51-485f-82d6-8c2e377307d0', 'nguid': '8303B2B03E51485F82D68C2E377307D0', 'uuid': '8303b2b0-3e51-485f-82d6-8c2e377307d0', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'name': 'bdev_8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'nguid': '8BA967BC4F6A461394968D3412CC4AAC', 'uuid': '8ba967bc-4f6a-4613-9496-8d3412cc4aac', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'name': 'bdev_141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'nguid': '141DDCA57F424F8896C3E6BC93FB0D08', 'uuid': '141ddca5-7f42-4f88-96c3-e6bc93fb0d08', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'name': 'bdev_035b3e5a-d391-4bf4-9e91-07424831f76f', 'nguid': '035B3E5AD3914BF49E9107424831F76F', 'uuid': 2024-03-25T09:36:31.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:30 smithi040 ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b[52580]: '035b3e5a-d391-4bf4-9e91-07424831f76f', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'name': 'bdev_dd79c772-7cf8-4fed-9a85-db14e97b125a', 'nguid': 'DD79C7727CF84FED9A85DB14E97B125A', 'uuid': 'dd79c772-7cf8-4fed-9a85-db14e97b125a', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'name': 'bdev_e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'nguid': 'E03AB02BEDC24CB3981A35A3C60CEBE7', 'uuid': 'e03ab02b-edc2-4cb3-981a-35a3c60cebe7', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'name': 'bdev_169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'nguid': '169D87CC4D4445E68A50FC26CCF7E965', 'uuid': '169d87cc-4d44-45e6-8a50-fc26ccf7e965', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'name': 'bdev_ab28eebb-ebca-411f-b32a-388f2d3fd613', 'nguid': 'AB28EEBBEBCA411FB32A388F2D3FD613', 'uuid': 'ab28eebb-ebca-411f-b32a-388f2d3fd613', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'name': 'bdev_da521597-93a5-4fb1-a071-740e044cbe6d', 'nguid': 'DA52159793A54FB1A071740E044CBE6D', 'uuid': 'da521597-93a5-4fb1-a071-740e044cbe6d', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'name': 'bdev_f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'nguid': 'F3CE6BCEADAF4D359E72C8A9CBB6A0B7', 'uuid': 'f3ce6bce-adaf-4d35-9e72-c8a9cbb6a0b7', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'name': 'bdev_23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'nguid': '23AB2E57B7CC4E00B0C828BE1B5D1C7B', 'uuid': '23ab2e57-b7cc-4e00-b0c8-28be1b5d1c7b', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'name': 'bdev_f14b3c52-f718-4626-b469-70f2660a35bd', 'nguid': 'F14B3C52F7184626B46970F2660A35BD', 'uuid': 'f14b3c52-f718-4626-b469-70f2660a35bd', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.40', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph70543347611932', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'name': 'bdev_a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'nguid': 'A19C2CA69D8D4AF8A9A446E7D4F16813', 'uuid': 'a19c2ca6-9d8d-4af8-a9a4-46e7d4f16813', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'name': 'bdev_865c2cfb-34c8-42ae-8d01-e76ef759818b', 'nguid': '865C2CFB34C842AE8D01E76EF759818B', 'uuid': '865c2cfb-34c8-42ae-8d01-e76ef759818b', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'name': 'bdev_acfee7b5-f951-45a0-b42d-b09f604dafcb', 'nguid': 'ACFEE7B5F95145A0B42DB09F604DAFCB', 'uuid': 'acfee7b5-f951-45a0-b42d-b09f604dafcb', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'name': 'bdev_4a34c4b4-f560-4567-b539-6bc6744c9b39', 'nguid': '4A34C4B4F5604567B5396BC6744C9B39', 'uuid': '4a34c4b4-f560-4567-b539-6bc6744c9b39', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'name': 'bdev_f2ad3452-90c9-4131-b6f0-d56addb6353c', 'nguid': 'F2AD345290C94131B6F0D56ADDB6353C', 'uuid': 'f2ad3452-90c9-4131-b6f0-d56addb6353c', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'name': 'bdev_112277d6-d6c6-4116-af7d-f4fc49f0462c', 'nguid': '112277D6D6C64116AF7DF4FC49F0462C', 'uuid': '112277d6-d6c6-4116-af7d-f4fc49f0462c', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'name': 'bdev_9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'nguid': '9D1EF92BA4AA4E44AD5C32586FB79017', 'uuid': '9d1ef92b-a4aa-4e44-ad5c-32586fb79017', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'name': 'bdev_63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'nguid': '63F2150C86814A8486C25CE8BD7D9CBD', 'uuid': '63f2150c-8681-4a84-86c2-5ce8bd7d9cbd', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'name': 'bdev_a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'nguid': 'A647AAC4E1364FE9B55F3AAB19D8CEEE', 'uuid': 'a647aac4-e136-4fe9-b55f-3aab19d8ceee', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'name': 'bdev_4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'nguid': '4D16AFB7D6AC479085DDEE7D5289E0CF', 'uuid': '4d16afb7-d6ac-4790-85dd-ee7d5289e0cf', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'name': 'bdev_cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'nguid': 'CD4F71866AB9492EBD7AE0FE92D12B17', 'uuid': 'cd4f7186-6ab9-492e-bd7a-e0fe92d12b17', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'name': 'bdev_9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'nguid': '9F904D8BA33841F59E74B160CF3FDAF8', 'uuid': '9f904d8b-a338-41f5-9e74-b160cf3fdaf8', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'name': 'bdev_2f7df32b-72a7-4a80-aea4-f802514d95ac', 'nguid': '2F7DF32B72A74A80AEA4F802514D95AC', 'uuid': '2f7df32b-72a7-4a80-aea4-f802514d95ac', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'name': 'bdev_f98d9d61-ba09-4787-8d61-79740491a3ab', 'nguid': 'F98D9D61BA0947878D6179740491A3AB', 'uuid': 'f98d9d61-ba09-4787-8d61-79740491a3ab', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'name': 'bdev_4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'nguid': '4ED4CB0CD52B40179A34CC7BC81F2ED6', 'uuid': '4ed4cb0c-d52b-4017-9a34-cc7bc81f2ed6', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'name': 'bdev_d94c813c-d553-4574-8478-3ae3e0121084', 'nguid': 'D94C813CD553457484783AE3E0121084', 'uuid': 'd94c813c-d553-4574-8478-3ae3e0121084', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'name': 'bdev_227db23a-385d-43e4-a0c7-d15fbb3badfc', 'nguid': '227DB23A385D43E4A0C7D15FBB3BADFC', 'uuid': '227db23a-385d-43e4-a0c7-d15fbb3badfc', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'name': 'bdev_8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'nguid': '8EAD3D18F9044E45A1FC02B8326AD2C8', 'uuid': '8ead3d18-f904-4e45-a1fc-02b8326ad2c8', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'name': 'bdev_a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'nguid': 'A641CD3C533E45F48C2AFE9277CE1239', 'uuid': 'a641cd3c-533e-45f4-8c2a-fe9277ce1239', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'name': 'bdev_79bf4b6e-621f-48b3-8331-1a0e6950f603', 'nguid': '79BF4B6E621F48B383311A0E6950F603', 'uuid': '79bf4b6e-621f-48b3-8331-1a0e6950f603', 'anagrpid': 1}]}] 2024-03-25T09:36:32.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:32 smithi040 bash[58565]: time="2024-03-25T09:36:32Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b in 10 seconds, resorting to SIGKILL" 2024-03-25T09:36:32.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:32 smithi040 podman[58565]: 2024-03-25 09:36:32.411878645 +0000 UTC m=+10.101940526 container died 58eba37f9ad454c8b65509fa9d5fb18f225e7d87b6b51ffd705763e1bcff9c67 (image=quay.io/ceph/nvmeof:1.1.0, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., version=1.1.0, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, vcs-ref=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.ceph.git.branch=tags/1.1.0, io.spdk.version=23.01.1, vcs-type=git, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=None, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.wants=ceph,rbd, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.commit=6769b6f51c9508981243042396ec2b2f097a5745, name=ceph-nvmeof, io.spdk.git.branch=ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.target-arch=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.makeflags=, io.ceph.git.commit=635ba2fc3c4eeee93025a0994decacf48590f9f1, release=, io.ceph.summary=Ceph NVMe over Fabrics Gateway, com.redhat.component=ubi9-container, vendor=Red Hat, Inc., architecture=x86_64, io.ceph.version=1.1.0, io.buildah.version=1.29.0, org.centos.version=9.0-21.el9, distribution-scope=public, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=18.2.2, io.ceph.maintainer=Ceph Developers , summary=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, build-date=2024-03-13 14:41:08 UTC, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF).) 2024-03-25T09:36:32.910 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:32 smithi040 podman[58565]: 2024-03-25 09:36:32.709694083 +0000 UTC m=+10.399755971 container cleanup 58eba37f9ad454c8b65509fa9d5fb18f225e7d87b6b51ffd705763e1bcff9c67 (image=quay.io/ceph/nvmeof:1.1.0, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b, io.ceph.git.branch=tags/1.1.0, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, io.spdk.build.makeflags=, io.ceph.git.commit=635ba2fc3c4eeee93025a0994decacf48590f9f1, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, summary=Ceph NVMe over Fabrics Gateway, io.ceph.component=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.1.0, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, name=ceph-nvmeof, io.ceph.nvmeof=None, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.branch=ceph-nvmeof, vendor=Red Hat, Inc., io.spdk.git.repo=https://github.com/ceph/spdk.git, vcs-type=git, release=, build-date=2024-03-13 14:41:08 UTC, io.spdk.build.ceph-release=18.2.2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.pkgdep-args=--rbd, io.ceph.summary=Ceph NVMe over Fabrics Gateway, org.centos.version=9.0-21.el9, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, version=1.1.0, io.ceph.maintainer=Ceph Developers , io.spdk.version=23.01.1, maintainer=Ceph Developers , io.buildah.version=1.29.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.wants=ceph,rbd, com.redhat.component=ubi9-container, url=https://github.com/ceph/ceph-nvmeof, vcs-ref=635ba2fc3c4eeee93025a0994decacf48590f9f1, architecture=x86_64, io.spdk.git.commit=6769b6f51c9508981243042396ec2b2f097a5745, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.target-arch=) 2024-03-25T09:36:32.910 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:32 smithi040 bash[58565]: ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b 2024-03-25T09:36:33.178 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:32 smithi040 podman[58606]: 2024-03-25 09:36:32.910762542 +0000 UTC m=+0.499086356 container remove 58eba37f9ad454c8b65509fa9d5fb18f225e7d87b6b51ffd705763e1bcff9c67 (image=quay.io/ceph/nvmeof:1.1.0, name=ceph-61da756e-ea87-11ee-95cd-87774f69a715-nvmeof-nvmeof-b, io.buildah.version=1.29.0, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.ceph.component=ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, vcs-ref=635ba2fc3c4eeee93025a0994decacf48590f9f1, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., version=1.1.0, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, maintainer=Ceph Developers , summary=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , io.spdk.git.commit=6769b6f51c9508981243042396ec2b2f097a5745, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, io.openshift.wants=ceph,rbd, distribution-scope=public, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, name=ceph-nvmeof, io.ceph.version=1.1.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.version=23.01.1, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.branch=ceph-nvmeof, io.spdk.build.ceph-release=18.2.2, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.target-arch=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.makeflags=, org.centos.version=9.0-21.el9, vcs-type=git, build-date=2024-03-13 14:41:08 UTC, io.ceph.git.branch=tags/1.1.0, vendor=Red Hat, Inc., architecture=x86_64, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=None, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, release=) 2024-03-25T09:36:33.178 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:32 smithi040 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.b.service: Main process exited, code=exited, status=137/n/a 2024-03-25T09:36:33.178 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:33 smithi040 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.b.service: Failed with result 'exit-code'. 2024-03-25T09:36:33.178 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:33 smithi040 systemd[1]: Stopped Ceph nvmeof.nvmeof.b for 61da756e-ea87-11ee-95cd-87774f69a715. 2024-03-25T09:36:33.178 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi040.stdout:Mar 25 09:36:33 smithi040 systemd[1]: ceph-61da756e-ea87-11ee-95cd-87774f69a715@nvmeof.nvmeof.b.service: Consumed 19min 2.950s CPU time. 2024-03-25T09:36:33.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61da756e-ea87-11ee-95cd-87774f69a715 --force --keep-logs 2024-03-25T09:36:33.915 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:36:35.419 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61da756e-ea87-11ee-95cd-87774f69a715 --force --keep-logs 2024-03-25T09:36:35.611 INFO:teuthology.orchestra.run.smithi129.stdout:Deleting cluster with fsid: 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:36:36.015 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:36:36.049 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:36:36.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:36:36.116 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-25T09:36:36.145 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-25T09:36:36.147 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi019/crash 2024-03-25T09:36:36.148 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash -- . 2024-03-25T09:36:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:tar: /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash: Cannot open: No such file or directory 2024-03-25T09:36:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:tar: Error is not recoverable: exiting now 2024-03-25T09:36:36.198 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi040/crash 2024-03-25T09:36:36.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash -- . 2024-03-25T09:36:36.243 INFO:teuthology.orchestra.run.smithi040.stderr:tar: /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash: Cannot open: No such file or directory 2024-03-25T09:36:36.244 INFO:teuthology.orchestra.run.smithi040.stderr:tar: Error is not recoverable: exiting now 2024-03-25T09:36:36.246 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi059/crash 2024-03-25T09:36:36.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash -- . 2024-03-25T09:36:36.300 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash: Cannot open: No such file or directory 2024-03-25T09:36:36.300 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2024-03-25T09:36:36.302 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi129/crash 2024-03-25T09:36:36.303 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash -- . 2024-03-25T09:36:36.393 INFO:teuthology.orchestra.run.smithi129.stderr:tar: /var/lib/ceph/61da756e-ea87-11ee-95cd-87774f69a715/crash: Cannot open: No such file or directory 2024-03-25T09:36:36.393 INFO:teuthology.orchestra.run.smithi129.stderr:tar: Error is not recoverable: exiting now 2024-03-25T09:36:36.393 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-25T09:36:36.394 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-25T09:36:36.427 INFO:teuthology.orchestra.run.smithi019.stdout:2024-03-25T09:12:36.756296+0000 mon.a (mon.0) 205 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-25T09:36:36.428 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-25T09:36:36.428 INFO:tasks.cephadm:Compressing logs... 2024-03-25T09:36:36.428 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-25T09:36:36.470 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-25T09:36:36.473 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-25T09:36:36.475 DEBUG:teuthology.orchestra.run.smithi129:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-25T09:36:36.498 INFO:teuthology.orchestra.run.smithi019.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-25T09:36:36.498 INFO:teuthology.orchestra.run.smithi019.stderr:: No such file or directory 2024-03-25T09:36:36.498 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mon.a.log 2024-03-25T09:36:36.498 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.audit.log 2024-03-25T09:36:36.498 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.1.log 2024-03-25T09:36:36.500 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mgr.x.log 2024-03-25T09:36:36.500 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.0.log 2024-03-25T09:36:36.500 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.1.log: /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.cephadm.log 2024-03-25T09:36:36.501 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.log 2024-03-25T09:36:36.501 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log 2024-03-25T09:36:36.501 INFO:teuthology.orchestra.run.smithi019.stderr: 82.7% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.cephadm.log.gz 2024-03-25T09:36:36.502 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.log: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-25T09:36:36.502 INFO:teuthology.orchestra.run.smithi019.stderr: 90.3% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.audit.log.gz 2024-03-25T09:36:36.507 INFO:teuthology.orchestra.run.smithi040.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory /var/log/ceph/cephadm.log 2024-03-25T09:36:36.507 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.audit.log 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.4.log 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.3.log 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.cephadm.log 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr: 89.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.log 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.2.log 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr: 81.6% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.cephadm.log.gz 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.log: /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mon.b.log 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log: 90.5% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.audit.log.gz 2024-03-25T09:36:36.508 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mon.b.log: 87.8% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.log.gz 2024-03-25T09:36:36.510 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log: 87.7% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.log.gz 2024-03-25T09:36:36.510 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log.gz 2024-03-25T09:36:36.510 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:: No such file or directory 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.6.log 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.audit.log 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.7.log 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.6.log: /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.5.log 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.cephadm.log 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.7.log: /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.5.log: 90.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.log 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr: 81.5% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.cephadm.log.gz 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mon.c.log 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log: /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mon.c.log: 90.5% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.audit.log.gz 2024-03-25T09:36:36.511 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph.log.gz 2024-03-25T09:36:36.512 INFO:teuthology.orchestra.run.smithi129.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-25T09:36:36.512 INFO:teuthology.orchestra.run.smithi129.stderr:: No such file or directory 2024-03-25T09:36:36.512 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log 2024-03-25T09:36:36.512 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/cephadm.log: 85.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-25T09:36:36.513 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log: 89.8% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log.gz 2024-03-25T09:36:36.513 INFO:teuthology.orchestra.run.smithi129.stderr: 2024-03-25T09:36:36.513 INFO:teuthology.orchestra.run.smithi129.stderr:real 0m0.015s 2024-03-25T09:36:36.513 INFO:teuthology.orchestra.run.smithi129.stderr:user 0m0.015s 2024-03-25T09:36:36.513 INFO:teuthology.orchestra.run.smithi129.stderr:sys 0m0.014s 2024-03-25T09:36:36.513 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log.gz 2024-03-25T09:36:36.514 INFO:teuthology.orchestra.run.smithi040.stderr: 91.1% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-volume.log.gz 2024-03-25T09:36:36.784 INFO:teuthology.orchestra.run.smithi040.stderr: 92.9% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mon.b.log.gz 2024-03-25T09:36:36.822 INFO:teuthology.orchestra.run.smithi059.stderr: 92.4% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mon.c.log.gz 2024-03-25T09:36:36.907 INFO:teuthology.orchestra.run.smithi019.stderr: 89.7% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mgr.x.log.gz 2024-03-25T09:36:37.323 INFO:teuthology.orchestra.run.smithi019.stderr: 90.4% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-mon.a.log.gz 2024-03-25T09:36:42.411 INFO:teuthology.orchestra.run.smithi019.stderr: 93.4% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.0.log.gz 2024-03-25T09:36:45.381 INFO:teuthology.orchestra.run.smithi059.stderr: 93.4% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.6.log.gz 2024-03-25T09:36:45.452 INFO:teuthology.orchestra.run.smithi040.stderr: 93.6% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.4.log.gz 2024-03-25T09:36:46.046 INFO:teuthology.orchestra.run.smithi040.stderr: 93.7% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.2.log.gz 2024-03-25T09:36:46.384 INFO:teuthology.orchestra.run.smithi059.stderr: 93.4% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.5.log.gz 2024-03-25T09:36:48.926 INFO:teuthology.orchestra.run.smithi040.stderr: 93.5% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.3.log.gz 2024-03-25T09:36:48.928 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-03-25T09:36:48.928 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m12.440s 2024-03-25T09:36:48.928 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m30.236s 2024-03-25T09:36:48.928 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.957s 2024-03-25T09:36:49.772 INFO:teuthology.orchestra.run.smithi019.stderr: 93.6% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.1.log.gz 2024-03-25T09:36:49.774 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-03-25T09:36:49.774 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m13.291s 2024-03-25T09:36:49.774 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m19.797s 2024-03-25T09:36:49.774 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.637s 2024-03-25T09:36:56.255 INFO:teuthology.orchestra.run.smithi059.stderr: 93.7% -- replaced with /var/log/ceph/61da756e-ea87-11ee-95cd-87774f69a715/ceph-osd.7.log.gz 2024-03-25T09:36:56.256 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-03-25T09:36:56.256 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m19.769s 2024-03-25T09:36:56.256 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m37.509s 2024-03-25T09:36:56.257 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m1.242s 2024-03-25T09:36:56.257 INFO:tasks.cephadm:Archiving logs... 2024-03-25T09:36:56.257 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi019/log 2024-03-25T09:36:56.258 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-25T09:36:59.265 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi040/log 2024-03-25T09:36:59.266 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-25T09:37:03.782 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi059/log 2024-03-25T09:37:03.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-25T09:37:09.367 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi129/log 2024-03-25T09:37:09.368 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-25T09:37:09.404 INFO:tasks.cephadm:Removing cluster... 2024-03-25T09:37:09.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61da756e-ea87-11ee-95cd-87774f69a715 --force 2024-03-25T09:37:09.604 INFO:teuthology.orchestra.run.smithi019.stdout:Deleting cluster with fsid: 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:37:09.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61da756e-ea87-11ee-95cd-87774f69a715 --force 2024-03-25T09:37:10.086 INFO:teuthology.orchestra.run.smithi040.stdout:Deleting cluster with fsid: 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:37:10.368 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61da756e-ea87-11ee-95cd-87774f69a715 --force 2024-03-25T09:37:10.567 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:37:10.871 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61da756e-ea87-11ee-95cd-87774f69a715 --force 2024-03-25T09:37:11.090 INFO:teuthology.orchestra.run.smithi129.stdout:Deleting cluster with fsid: 61da756e-ea87-11ee-95cd-87774f69a715 2024-03-25T09:37:11.486 INFO:tasks.cephadm:Removing cephadm ... 2024-03-25T09:37:11.486 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-25T09:37:11.505 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-25T09:37:11.523 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-25T09:37:11.540 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-25T09:37:11.556 INFO:tasks.cephadm:Teardown complete 2024-03-25T09:37:11.556 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-25T09:37:11.569 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_vallariag_ceph_fb51d73931124de2f09457eaa7f1219e2aeb2c0d/qa/tasks/nvmeof.py", line 282, in end raise RuntimeError('error during thrashing') RuntimeError: error during thrashing 2024-03-25T09:37:11.570 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-25T09:37:11.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-25T09:37:11.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-25T09:37:11.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-25T09:37:11.583 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-25T09:37:11.723 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-25T09:37:11.734 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-25T09:37:11.734 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T09:37:11.737 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T09:37:11.739 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T09:37:11.742 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T09:37:11.751 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-03-25T09:37:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-03-25T09:37:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-03-25T09:37:11.755 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2024-03-25T09:37:11.756 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T09:37:11.756 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-03-25T09:37:11.756 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 46 +1023us[+1023us] +/- 81ms 2024-03-25T09:37:11.756 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 -902us[ -893us] +/- 64ms 2024-03-25T09:37:11.756 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +125us[ +125us] +/- 84ms 2024-03-25T09:37:11.756 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:37:11.758 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T09:37:11.758 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-03-25T09:37:11.758 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 47 +1045us[+1042us] +/- 81ms 2024-03-25T09:37:11.758 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 -886us[ -889us] +/- 64ms 2024-03-25T09:37:11.758 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +134us[ +131us] +/- 84ms 2024-03-25T09:37:11.758 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:37:11.760 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T09:37:11.760 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-03-25T09:37:11.760 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 49 +993us[+1004us] +/- 81ms 2024-03-25T09:37:11.760 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 -922us[ -911us] +/- 64ms 2024-03-25T09:37:11.760 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +95us[ +95us] +/- 84ms 2024-03-25T09:37:11.760 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:37:11.761 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T09:37:11.761 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-03-25T09:37:11.761 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 46 +1041us[+1041us] +/- 81ms 2024-03-25T09:37:11.761 INFO:teuthology.orchestra.run.smithi129.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 -893us[ -855us] +/- 64ms 2024-03-25T09:37:11.762 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +127us[ +127us] +/- 84ms 2024-03-25T09:37:11.762 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T09:37:11.762 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-25T09:37:11.772 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-25T09:37:11.773 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-25T09:37:11.783 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-25T09:37:11.881 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-25T09:37:11.958 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-25T09:37:12.035 DEBUG:teuthology.orchestra.run.smithi129:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-25T09:37:12.119 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T09:37:12.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:37:12.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T09:37:12.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:37:12.184 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T09:37:12.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:37:12.216 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T09:37:12.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:37:12.249 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-25T09:37:12.267 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-25T09:37:12.328 INFO:teuthology.task.internal:Duration was 2189.371087 seconds 2024-03-25T09:37:12.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-25T09:37:12.348 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-25T09:37:12.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-25T09:37:12.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-25T09:37:12.356 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-25T09:37:12.358 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-25T09:37:12.397 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T09:37:12.401 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T09:37:12.402 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T09:37:12.403 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T09:37:12.816 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-25T09:37:12.816 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-03-25T09:37:12.816 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-25T09:37:12.839 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-03-25T09:37:12.839 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-25T09:37:12.868 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-03-25T09:37:12.868 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-25T09:37:12.897 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2024-03-25T09:37:12.898 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-25T09:37:12.923 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-25T09:37:12.924 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-25T09:37:12.927 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-25T09:37:12.929 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-25T09:37:12.940 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-25T09:37:12.993 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-25T09:37:12.993 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-25T09:37:13.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-25T09:37:13.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-25T09:37:13.012 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-25T09:37:13.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-25T09:37:13.513 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-25T09:37:13.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-25T09:37:13.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-25T09:37:13.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-25T09:37:13.593 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-25T09:37:13.620 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-25T09:37:13.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-25T09:37:13.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-25T09:37:13.636 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-25T09:37:13.638 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-25T09:37:13.656 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-03-25T09:37:13.658 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-03-25T09:37:13.660 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-03-25T09:37:13.684 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2024-03-25T09:37:13.708 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-25T09:37:13.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:37:13.733 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-25T09:37:13.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:37:13.747 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-25T09:37:13.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:37:13.762 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-25T09:37:13.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T09:37:13.776 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-25T09:37:13.788 INFO:teuthology.task.internal:Transferring archived files... 2024-03-25T09:37:13.788 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi019 2024-03-25T09:37:13.789 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-25T09:37:13.832 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi040 2024-03-25T09:37:13.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-25T09:37:13.871 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi059 2024-03-25T09:37:13.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-25T09:37:13.910 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216/remote/smithi129 2024-03-25T09:37:13.911 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-25T09:37:13.950 INFO:teuthology.task.internal:Removing archive directory... 2024-03-25T09:37:13.950 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-25T09:37:13.953 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-25T09:37:13.955 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-25T09:37:13.957 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-25T09:37:13.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-25T09:37:14.014 INFO:teuthology.task.internal:Not uploading archives. 2024-03-25T09:37:14.015 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-25T09:37:14.030 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-25T09:37:14.030 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-25T09:37:14.033 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-25T09:37:14.035 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-25T09:37:14.037 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-25T09:37:14.044 INFO:teuthology.orchestra.run.smithi019.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 25 09:37 /home/ubuntu/cephtest 2024-03-25T09:37:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 25 09:37 /home/ubuntu/cephtest 2024-03-25T09:37:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 25 09:37 /home/ubuntu/cephtest 2024-03-25T09:37:14.053 INFO:teuthology.orchestra.run.smithi129.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 25 09:37 /home/ubuntu/cephtest 2024-03-25T09:37:14.054 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-25T09:37:14.065 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-25T09:37:14.081 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during thrashing 2024-03-25T09:37:14.081 INFO:teuthology.nuke:Checking targets against current locks 2024-03-25T09:37:14.109 DEBUG:teuthology.nuke:shortname: smithi019 2024-03-25T09:37:14.109 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-25T09:37:14.131 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 08:51:26.182516', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPuIeGqnvwNV4xy88yhxozguu9uPfpxOMi1ABHJOqYA7grr6Szcuis9ENLMEpXgFvTLH+vVO5IR2rzV4ioThpIM='} 2024-03-25T09:37:14.135 DEBUG:teuthology.nuke:shortname: smithi040 2024-03-25T09:37:14.135 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-25T09:37:14.155 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 08:51:26.180907', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAueTtKLAoQDbDaO0bk6NfZrO8eSSs25Yc76HvpiK0Io6AwItJBWEQWrLRqBO6grJ9OUOfySGKfOwDdAWPw4zg4='} 2024-03-25T09:37:14.160 DEBUG:teuthology.nuke:shortname: smithi059 2024-03-25T09:37:14.160 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-25T09:37:14.180 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 08:51:26.183540', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI/qZPy6SQKMPnTGXHLa3FGz3Eun6avjX8Ndp9GfKykFNfR+kz49nSU3VmxsZgGzX+tAHUHz5aSEBBaHEiE8uN8='} 2024-03-25T09:37:14.186 DEBUG:teuthology.nuke:shortname: smithi129 2024-03-25T09:37:14.186 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-25T09:37:14.197 INFO:teuthology.orchestra.console.smithi019:Power off 2024-03-25T09:37:14.197 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T09:37:14.212 INFO:teuthology.orchestra.console.smithi040:Power off 2024-03-25T09:37:14.213 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T09:37:14.226 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-25_08:42:26-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7621216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 08:51:26.184882', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDRpG4d7Jh8rgSk32AhjKnXHGEoCFwUAwvTSc27NF0W6y3NsNfDr1BnjMXE0Gx7fmPzvkHhFDzDnXkDE6+OMoRM='} 2024-03-25T09:37:14.230 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2024-03-25T09:37:14.230 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:14.240 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-03-25T09:37:14.241 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:14.253 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-25T09:37:14.267 INFO:teuthology.orchestra.console.smithi059:Power off 2024-03-25T09:37:14.267 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T09:37:14.281 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-03-25T09:37:14.290 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2024-03-25T09:37:14.291 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:14.307 INFO:teuthology.orchestra.console.smithi129:Power off 2024-03-25T09:37:14.307 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T09:37:14.318 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-03-25T09:37:14.330 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-03-25T09:37:14.330 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:14.355 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-03-25T09:37:18.254 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:18.282 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:18.318 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:18.356 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:18.365 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-25T09:37:18.391 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-03-25T09:37:18.428 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-03-25T09:37:18.466 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-03-25T09:37:22.370 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:22.392 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:22.429 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:22.467 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:22.480 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-25T09:37:22.503 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-03-25T09:37:22.541 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-03-25T09:37:22.578 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-03-25T09:37:22.604 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-03-25T09:37:22.642 INFO:teuthology.orchestra.console.smithi059:Power off completed 2024-03-25T09:37:22.678 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-03-25T09:37:26.484 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T09:37:26.594 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-03-25T09:37:26.695 INFO:teuthology.orchestra.console.smithi019:Power off completed 2024-03-25T09:37:26.799 INFO:teuthology.run:Summary data: description: rbd:nvmeof/{base/install centos_latest conf/{disable-pool-app} workloads/nvmeof_thrash} duration: 2189.37108707428 failure_reason: error during thrashing flavor: default owner: scheduled_vallariag@teuthology status: fail success: false 2024-03-25T09:37:26.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T09:37:26.880 INFO:teuthology.run:FAIL